Aug 01 00:28:50.106465 ip-10-0-131-26 systemd[1]: Starting Kubernetes Kubelet...
Aug 01 00:28:50.574851 ip-10-0-131-26 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 01 00:28:50.574851 ip-10-0-131-26 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 01 00:28:50.574851 ip-10-0-131-26 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 01 00:28:50.574851 ip-10-0-131-26 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 01 00:28:50.574851 ip-10-0-131-26 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 01 00:28:50.576876 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.576764    2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 01 00:28:50.583557 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583533    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 01 00:28:50.583557 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583555    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 01 00:28:50.583557 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583559    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583564    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583568    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583571    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583575    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583578    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583581    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583584    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583587    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583590    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583593    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583596    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583599    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583604    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583609    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583612    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583615    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583620    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583623    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 01 00:28:50.583654 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583626    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583629    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583632    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583635    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583637    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583640    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583643    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583645    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583648    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583652    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583654    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583657    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583660    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583664    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583667    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583672    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583675    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583678    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583681    2547 feature_gate.go:328] unrecognized feature gate: Example
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583683    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 01 00:28:50.584157 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583692    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583696    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583699    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583701    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583705    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583707    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583710    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583713    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583716    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583718    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583721    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583723    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583726    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583729    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583732    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583735    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583740    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583744    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583747    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 01 00:28:50.584648 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583750    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583752    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583756    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583759    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583761    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583764    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583767    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583769    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583772    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583775    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583779    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583782    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583785    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583787    2547 feature_gate.go:328] unrecognized feature gate: Example2
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583790    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583793    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583795    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583798    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583801    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583803    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583806    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 01 00:28:50.585172 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583809    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583811    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583814    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583817    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583820    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583823    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583827    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583830    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583833    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583835    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583838    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583840    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583843    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583846    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583848    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583851    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583853    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.583856    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584620    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584627    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 01 00:28:50.585694 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584630    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584633    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584636    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584641    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584643    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584646    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584649    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584652    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584656    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584659    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584662    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584665    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584669    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584673    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584676    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584680    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584683    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584687    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 01 00:28:50.586201 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584691    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584694    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584697    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584700    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584702    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584705    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584708    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584711    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584714    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584717    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584719    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584722    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584724    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584727    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584730    2547 feature_gate.go:328] unrecognized feature gate: Example
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584732    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584737    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584740    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584744    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584748    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 01 00:28:50.586738 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584750    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584753    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584756    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584759    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584762    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584764    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584767    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584770    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584773    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584775    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584778    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584780    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584784    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584786    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584789    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584792    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584795    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584798    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584800    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584803    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 01 00:28:50.587247 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584806    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584808    2547 feature_gate.go:328] unrecognized feature gate: Example2
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584811    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584814    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584817    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584819    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584822    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584825    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584827    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584831    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584833    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584836    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584838    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584841    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584844    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584847    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584850    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584853    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584855    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 01 00:28:50.587770 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584858    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584863    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584866    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584869    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584872    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584876    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584879    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584882    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584884    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584887    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584890    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584893    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584895    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584898    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584900    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584903    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584906    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584908    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584911    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 01 00:28:50.588245 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.584913    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585347    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585353    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585369    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585372    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585375    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585378    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585380    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585383    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585386    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585389    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585392    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585395    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585398    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585401    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585404    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585406    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585409    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585412    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585414    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 01 00:28:50.588713 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585417    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585420    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585423    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585425    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585428    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585430    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585433    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585435    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585438    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585441    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585443    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585446    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585449    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585452    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585454    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585457    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585465    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585468    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585471    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 01 00:28:50.589257 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585473    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585477    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585480    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585483    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585486    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585489    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585491    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585494    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585497    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585500    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585502    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585505    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585508    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585510    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585513    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585516    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585519    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585522    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585524    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 01 00:28:50.589706 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585527    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585531    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585535    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585538    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585541    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585544    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585547    2547 feature_gate.go:328] unrecognized feature gate: Example
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585550    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585552    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585555    2547 feature_gate.go:328] unrecognized feature gate: Example2
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585559    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585569    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585573    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585576    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585578    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585581    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585584    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585588    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585591    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 01 00:28:50.590177 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585594    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585597    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585600    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585602    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585605    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585607    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585611    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585614    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585616    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585619    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585621    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585624    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585627    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585629    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585632    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585635    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585637    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585640    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585643    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585645    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 01 00:28:50.590677 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585648    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585650    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.585653    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585733    2547 flags.go:64] FLAG: --address="0.0.0.0"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585742    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585761    2547 flags.go:64] FLAG: --anonymous-auth="true"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585766    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585771    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585774    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585779    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585783    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585787    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585791    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585794    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585798    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585801    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585804    2547 flags.go:64] FLAG: --cgroup-root=""
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585807    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585810    2547 flags.go:64] FLAG: --client-ca-file=""
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585814    2547 flags.go:64] FLAG: --cloud-provider="external"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585817    2547 flags.go:64] FLAG: --cluster-dns="[]"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585822    2547 flags.go:64] FLAG: --cluster-domain=""
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585825    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585828    2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 01 00:28:50.591181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585832    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585835    2547 flags.go:64] FLAG: --container-log-max-files="5"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585839    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585842    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585845    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585849    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585852    2547 flags.go:64] FLAG: --contention-profiling="false"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585856    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585859    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585862    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585865    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585869    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585872    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585875    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585878    2547 flags.go:64] FLAG: --enable-load-reader="false"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585885    2547 flags.go:64] FLAG: --enable-server="true"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585889    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585894    2547 flags.go:64] FLAG: --event-burst="100"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585897    2547 flags.go:64] FLAG: --event-qps="50"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585900    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585904    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585907    2547 flags.go:64] FLAG: --eviction-hard=""
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585911    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585914    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585917    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 01 00:28:50.591805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585920    2547 flags.go:64] FLAG: --eviction-soft=""
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585923    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585926    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585929    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585932    2547 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585935    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585938    2547 flags.go:64] FLAG: --fail-swap-on="true"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585941    2547 flags.go:64] FLAG: --feature-gates=""
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585946    2547 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585949    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585952    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585955    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585958    2547 flags.go:64] FLAG: --healthz-port="10248"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585962    2547 flags.go:64] FLAG: --help="false"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585965    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-131-26.ec2.internal"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585968    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585971    2547 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585974    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585979    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585982    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585985    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585988    2547 flags.go:64] FLAG: --image-service-endpoint=""
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585993    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 01 00:28:50.592414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.585997    2547 flags.go:64] FLAG: --kube-api-burst="100"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586000    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586003    2547 flags.go:64] FLAG: --kube-api-qps="50"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586006    2547 flags.go:64] FLAG: --kube-reserved=""
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586009    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586012    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586016    2547 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586018    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586021    2547 flags.go:64] FLAG: --lock-file=""
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586024    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586027    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586030    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586036    2547 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586039    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586042    2547 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586045    2547 flags.go:64] FLAG: --logging-format="text"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586048    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586051    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586054    2547 flags.go:64] FLAG: --manifest-url=""
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586057    2547 flags.go:64] FLAG: --manifest-url-header=""
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586061    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586065    2547 flags.go:64] FLAG: --max-open-files="1000000"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586069    2547 flags.go:64] FLAG: --max-pods="110"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586072    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586075    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 01 00:28:50.593016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586078    2547 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586081    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586085    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586088    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586091    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586115    2547 flags.go:64] FLAG: --node-status-max-images="50"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586132    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586136    2547 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586140    2547 flags.go:64] FLAG: --pod-cidr=""
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586143    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586149    2547 flags.go:64] FLAG: --pod-manifest-path=""
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586152    2547 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586155    2547 flags.go:64] FLAG: --pods-per-core="0"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586158    2547 flags.go:64] FLAG: --port="10250"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586161    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586164    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ca703c29f872301d"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586168    2547 flags.go:64] FLAG: --qos-reserved=""
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586171    2547 flags.go:64] FLAG: --read-only-port="10255"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586174    2547 flags.go:64] FLAG: --register-node="true"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586177    2547 flags.go:64] FLAG: --register-with-taints=""
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586181    2547 flags.go:64] FLAG: --registry-burst="10"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586184    2547 flags.go:64] FLAG: --registry-qps="5"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586187    2547 flags.go:64] FLAG: --reserved-cpus=""
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586190    2547 flags.go:64] FLAG: --reserved-memory=""
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586194    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 01 00:28:50.593689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586197    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586200    2547 flags.go:64] FLAG: --rotate-certificates="false"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586204    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586207    2547 flags.go:64] FLAG: --runonce="false"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586210    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586213    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586216    2547 flags.go:64] FLAG: --seccomp-default="false"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586219    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586222    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586225    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586230    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586233    2547 flags.go:64] FLAG: --storage-driver-password="root"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586236    2547 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586241    2547 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586244    2547 flags.go:64] FLAG: --storage-driver-user="root"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586255    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586258    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586261    2547 flags.go:64] FLAG: --system-cgroups=""
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586264    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586270    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586273    2547 flags.go:64] FLAG: --tls-cert-file=""
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586276    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586286    2547 flags.go:64] FLAG: --tls-min-version=""
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586289    2547 flags.go:64] FLAG: --tls-private-key-file=""
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586292    2547 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 01 00:28:50.594633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586295    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586298    2547 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586301    2547 flags.go:64] FLAG: --v="2"
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586306    2547 flags.go:64] FLAG: --version="false"
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586310    2547 flags.go:64] FLAG: --vmodule=""
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586313    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.586317    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586474    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586478    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586481    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586484    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586487    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586489    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586492    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586495    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586498    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586501    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586505    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586508    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586511    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586515    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 01 00:28:50.595727 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586517    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586520    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586530    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586539    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586542    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586545    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586548    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586551    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586553    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586556    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586559    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586562    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586564    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586567    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586570    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586572    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586575    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586578    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586580    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586583    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 01 00:28:50.596683 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586585    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586588    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586590    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586593    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586595    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586598    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586601    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586603    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586608    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586613    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586617    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586621    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586625    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586627    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586630    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586639    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586641    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586644    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586647    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586649    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 01 00:28:50.597565 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586652    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586655    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586657    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586660    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586662    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586665    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586668    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586670    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586673    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586676    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586679    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586681    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586684    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586686    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586689    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586691    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586694    2547 feature_gate.go:328] unrecognized feature gate: Example
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586697    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586699    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586702    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 01 00:28:50.598310 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586706    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586708    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586711    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586715    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586718    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586721    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586723    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586728    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586737    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586740    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586743    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586746    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586749    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586751    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586754    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586757    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586760    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586762    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586765    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 01 00:28:50.599005 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586767    2547 feature_gate.go:328] unrecognized feature gate: Example2
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586770    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586772    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586775    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586778    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.586780    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.587664    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.596202    2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.596227    2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.596246    2547 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.596259    2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596349    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596357    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596363    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 01 00:28:50.599841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596368    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596374    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596378    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596383    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596388    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596393    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596397    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596402    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596407    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596412    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596416    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596423    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596429    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596434    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596438    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596443    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596450    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596456    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596461    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596465    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 01 00:28:50.600334 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596471    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596477    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596482    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596487    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596491    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596495    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596502    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596508    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596512    2547 feature_gate.go:328] unrecognized feature gate: Example2
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596517    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596521    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596526    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596531    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596536    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596540    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596545    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596549    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596554    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596558    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596562    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 01 00:28:50.600815 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596566    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596571    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596575    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596579    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596584    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596588    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596593    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596597    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596601    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596605    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596613    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596619    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596624    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596628    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596633    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596638    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596642    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596647    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596652    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 01 00:28:50.601373 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596657    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596662    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596666    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596670    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596675    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596679    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596683    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596688    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596691    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596695    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596699    2547 feature_gate.go:328] unrecognized feature gate: Example
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596703    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596707    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596712    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596716    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596720    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596725    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596730    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596734    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596739    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 01 00:28:50.601922 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596743    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596747    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596752    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596757    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596761    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596765    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596770    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596774    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596779    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596783    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596788    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596792    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596797    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596802    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596807    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596812    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 01 00:28:50.602473 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.596816    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.596824    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597017    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597027    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597032    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597037    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597042    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597047    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597052    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597057    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597061    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597066    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597070    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597074    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 01 00:28:50.602878 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597079    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597083    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597088    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597093    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597097    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597102    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597107    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597111    2547 feature_gate.go:328] unrecognized feature gate: Example2
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597115    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597136    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597141    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597147    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597152    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597157    2547 feature_gate.go:328] unrecognized feature gate: Example
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597161    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597166    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597171    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597175    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597180    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597184    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 01 00:28:50.603256 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597188    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597192    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597197    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597201    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597205    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597210    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597214    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597218    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597222    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597226    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597231    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597235    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597239    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597243    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597248    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597252    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597256    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597261    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597265    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597270    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 01 00:28:50.603856 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597275    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597279    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597283    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597288    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597292    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597296    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597301    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597305    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597309    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597314    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597319    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597324    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597328    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597333    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597337    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597341    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597346    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597350    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597354    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597358    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597362    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 01 00:28:50.604369 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597366    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597370    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597374    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597378    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597383    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597387    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597391    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597396    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597400    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597404    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597408    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597413    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597418    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597422    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597426    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597430    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597434    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597442    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597448    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 01 00:28:50.605158 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597453    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597457    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597463    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597468    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597473    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597478    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:50.597483    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.597491    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.597682    2547 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.601506    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.603253    2547 server.go:1019] "Starting client certificate rotation"
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.603362    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 01 00:28:50.605897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.603420    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 01 00:28:50.606822 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.606803    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 01 00:28:50.608296 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.608277    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 01 00:28:50.618453 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.618432    2547 log.go:25] "Validated CRI v1 runtime API"
Aug 01 00:28:50.622445 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.622419    2547 log.go:25] "Validated CRI v1 image API"
Aug 01 00:28:50.623379 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.623364    2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 01 00:28:50.628720 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.628677    2547 fs.go:135] Filesystem UUIDs: map[2ef7d72e-03be-4d33-a432-3b6a7614592c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 828c074c-7281-40ff-8a63-50bfda77d959:/dev/nvme0n1p4]
Aug 01 00:28:50.628720 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.628714    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 01 00:28:50.634846 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.634824    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 01 00:28:50.635419 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.635298    2547 manager.go:216] Machine: {Timestamp:2026-08-01 00:28:50.634784881 +0000 UTC m=+0.386312459 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099938 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b6799247696a44933475275d30e63 SystemUUID:ec2b6799-2476-96a4-4933-475275d30e63 BootID:c1107874-c542-4456-8c47-dfaeb004f076 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:c7:97:0d:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:c7:97:0d:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:f2:ca:22:eb:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 01 00:28:50.635419 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.635417    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 01 00:28:50.635530 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.635511    2547 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 01 00:28:50.639177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.639140    2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 01 00:28:50.639349 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.639180    2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 01 00:28:50.640108 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.640096    2547 topology_manager.go:138] "Creating topology manager with none policy"
Aug 01 00:28:50.640164 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.640110    2547 container_manager_linux.go:309] "Creating device plugin manager"
Aug 01 00:28:50.640164 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.640128    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 01 00:28:50.640164 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.640144    2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 01 00:28:50.642042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.642030    2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 01 00:28:50.647452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.647433    2547 state_mem.go:36] "Initialized new in-memory state store"
Aug 01 00:28:50.647596 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.647586    2547 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 01 00:28:50.647641 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.647618    2547 kubelet.go:486] "Attempting to sync node with API server"
Aug 01 00:28:50.647641 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.647635    2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 01 00:28:50.647705 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.647654    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 01 00:28:50.647705 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.647665    2547 kubelet.go:398] "Adding apiserver pod source"
Aug 01 00:28:50.647705 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.647676    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 01 00:28:50.648315 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.648298    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 01 00:28:50.648423 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.648330    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 01 00:28:50.652194 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.652163    2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 01 00:28:50.654041 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654024    2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 01 00:28:50.654112 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654056    2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 01 00:28:50.654891 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654880    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 01 00:28:50.654925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654896    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 01 00:28:50.654925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654902    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 01 00:28:50.654925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654907    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 01 00:28:50.654925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654917    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 01 00:28:50.654925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654922    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 01 00:28:50.655082 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654944    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 01 00:28:50.655082 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654950    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 01 00:28:50.655082 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654957    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 01 00:28:50.655082 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654962    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 01 00:28:50.655082 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654971    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 01 00:28:50.655082 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.654979    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 01 00:28:50.655810 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.655799    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 01 00:28:50.655810 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.655810    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 01 00:28:50.657588 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.657566    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cxpxc"
Aug 01 00:28:50.659171 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.659156    2547 server.go:1268] "Started kubelet"
Aug 01 00:28:50.659420 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.659391    2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 01 00:28:50.659501 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.659440    2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 01 00:28:50.659556 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.659492    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 01 00:28:50.659556 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.659502    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 01 00:28:50.659556 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.659517    2547 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 01 00:28:50.659675 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.659533    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 01 00:28:50.660087 ip-10-0-131-26 systemd[1]: Started Kubernetes Kubelet.
Aug 01 00:28:50.661351 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.661334    2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 01 00:28:50.662447 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.662431    2547 server.go:310] "Adding debug handlers to kubelet server"
Aug 01 00:28:50.662529 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.662451    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cxpxc"
Aug 01 00:28:50.664932 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.663751    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-26.ec2.internal.18c786ed36b85c07  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-26.ec2.internal,UID:ip-10-0-131-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-26.ec2.internal,},FirstTimestamp:2026-08-01 00:28:50.659113991 +0000 UTC m=+0.410641569,LastTimestamp:2026-08-01 00:28:50.659113991 +0000 UTC m=+0.410641569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-26.ec2.internal,}"
Aug 01 00:28:50.665015 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.664990    2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 01 00:28:50.671717 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.671677    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 01 00:28:50.671717 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.671701    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 01 00:28:50.671958 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.671936    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:50.672638 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.672609    2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 01 00:28:50.672638 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.672611    2547 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 01 00:28:50.672772 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.672652    2547 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 01 00:28:50.672833 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.672811    2547 factory.go:55] Registering systemd factory
Aug 01 00:28:50.672931 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.672836    2547 reconstruct.go:97] "Volume reconstruction finished"
Aug 01 00:28:50.672931 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.672847    2547 reconciler.go:29] "Reconciler: start to sync state"
Aug 01 00:28:50.672931 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.672863    2547 factory.go:223] Registration of the systemd container factory successfully
Aug 01 00:28:50.673201 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.673183    2547 factory.go:153] Registering CRI-O factory
Aug 01 00:28:50.673201 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.673202    2547 factory.go:223] Registration of the crio container factory successfully
Aug 01 00:28:50.673303 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.673272    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 01 00:28:50.673303 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.673300    2547 factory.go:103] Registering Raw factory
Aug 01 00:28:50.673406 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.673320    2547 manager.go:1196] Started watching for new ooms in manager
Aug 01 00:28:50.673877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.673863    2547 manager.go:349] Starting recovery of all containers
Aug 01 00:28:50.674222 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.674198    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 01 00:28:50.674329 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.674244    2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 01 00:28:50.684777 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.684750    2547 manager.go:354] Recovery completed
Aug 01 00:28:50.690322 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.690304    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 01 00:28:50.692642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.692621    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Aug 01 00:28:50.692746 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.692658    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Aug 01 00:28:50.692746 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.692669    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Aug 01 00:28:50.693262 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.693244    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 01 00:28:50.693262 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.693260    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 01 00:28:50.693361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.693278    2547 state_mem.go:36] "Initialized new in-memory state store"
Aug 01 00:28:50.693361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.693250    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 01 00:28:50.694062 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.694047    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Aug 01 00:28:50.694149 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.694075    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Aug 01 00:28:50.694149 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.694089    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Aug 01 00:28:50.695450 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.695438    2547 policy_none.go:49] "None policy: Start"
Aug 01 00:28:50.695487 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.695455    2547 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 01 00:28:50.695487 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.695466    2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 01 00:28:50.697516 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.697504    2547 policy_none.go:47] "Start"
Aug 01 00:28:50.743183 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.742958    2547 manager.go:337] "Starting Device Plugin manager"
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.743210    2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.743223    2547 server.go:87] "Starting device plugin registration server"
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.743490    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.743503    2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.743592    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.743676    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.743684    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.744234    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 01 00:28:50.759452 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.744278    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:50.817810 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.817772    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 01 00:28:50.818963 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.818940    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 01 00:28:50.819023 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.818996    2547 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 01 00:28:50.819061 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.819025    2547 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 01 00:28:50.819091 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.819073    2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 01 00:28:50.821498 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.821469    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 01 00:28:50.844541 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.844465    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 01 00:28:50.845418 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.845398    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Aug 01 00:28:50.845516 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.845439    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Aug 01 00:28:50.845516 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.845449    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Aug 01 00:28:50.845516 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.845478    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-26.ec2.internal"
Aug 01 00:28:50.855683 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.855663    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-26.ec2.internal"
Aug 01 00:28:50.855752 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.855705    2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-26.ec2.internal\": node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:50.874355 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.874322    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:50.919451 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.919416    2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"]
Aug 01 00:28:50.919583 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.919527    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 01 00:28:50.920526 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.920498    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Aug 01 00:28:50.920637 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.920535    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Aug 01 00:28:50.920637 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.920549    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Aug 01 00:28:50.922996 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.922976    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 01 00:28:50.923095 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.923076    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:50.923169 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.923104    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 01 00:28:50.923864 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.923848    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Aug 01 00:28:50.923917 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.923877    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Aug 01 00:28:50.923917 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.923886    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Aug 01 00:28:50.924344 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.924327    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Aug 01 00:28:50.924415 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.924362    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Aug 01 00:28:50.924415 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.924378    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Aug 01 00:28:50.926207 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.926187    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:50.926296 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.926215    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 01 00:28:50.926886 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.926867    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Aug 01 00:28:50.926979 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.926901    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Aug 01 00:28:50.926979 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:50.926915    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Aug 01 00:28:50.953102 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:50.953071    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-26.ec2.internal\" not found" node="ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.011956 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:52.011934    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-26.ec2.internal\" not found" node="ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.028635 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.028597    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/af271ecab387b6c0bf980ddd473c7e57-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"af271ecab387b6c0bf980ddd473c7e57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.028635 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.028634    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/feb9d9c9a1dacbe35f2e446392a09e3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"feb9d9c9a1dacbe35f2e446392a09e3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.028832 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.028683    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb9d9c9a1dacbe35f2e446392a09e3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"feb9d9c9a1dacbe35f2e446392a09e3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.029633 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:52.029615    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:52.128862 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.128817    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/af271ecab387b6c0bf980ddd473c7e57-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"af271ecab387b6c0bf980ddd473c7e57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.128862 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.128858    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/feb9d9c9a1dacbe35f2e446392a09e3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"feb9d9c9a1dacbe35f2e446392a09e3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.129062 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.128875    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb9d9c9a1dacbe35f2e446392a09e3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"feb9d9c9a1dacbe35f2e446392a09e3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.129062 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.128921    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/af271ecab387b6c0bf980ddd473c7e57-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"af271ecab387b6c0bf980ddd473c7e57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.129062 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.128974    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb9d9c9a1dacbe35f2e446392a09e3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"feb9d9c9a1dacbe35f2e446392a09e3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.129062 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.129005    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/feb9d9c9a1dacbe35f2e446392a09e3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"feb9d9c9a1dacbe35f2e446392a09e3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.129853 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:52.129836    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:52.230588 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:52.230559    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:52.309817 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.309775    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.315705 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.315398    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.331197 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:52.331169    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:52.431641 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:52.431600    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:52.532232 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:52.532150    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:52.632727 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:52.632693    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Aug 01 00:28:52.656889 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.656852    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 01 00:28:52.657057 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.657009    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 01 00:28:52.722720 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.722689    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 01 00:28:52.725333 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.725308    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-31 00:23:51 +0000 UTC" deadline="2028-05-03 15:42:41.151426668 +0000 UTC"
Aug 01 00:28:52.725393 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.725337    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15399h13m48.426096032s"
Aug 01 00:28:52.726442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.726422    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 01 00:28:52.726442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.726437    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.734446 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.734421    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 01 00:28:52.735943 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.735927    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Aug 01 00:28:52.736241 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.736225    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 01 00:28:52.744923 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.744901    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 01 00:28:52.754667 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.754637    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kgxpf"
Aug 01 00:28:52.761834 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.761810    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kgxpf"
Aug 01 00:28:52.863073 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.863043    2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 01 00:28:52.958244 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:52.958206    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb9d9c9a1dacbe35f2e446392a09e3c.slice/crio-acb8ed3089da2f8a17cdb6efe6566d23a0d51944a4df611621cf75ec9d722122 WatchSource:0}: Error finding container acb8ed3089da2f8a17cdb6efe6566d23a0d51944a4df611621cf75ec9d722122: Status 404 returned error can't find the container with id acb8ed3089da2f8a17cdb6efe6566d23a0d51944a4df611621cf75ec9d722122
Aug 01 00:28:52.963211 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:52.963188    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 01 00:28:52.969278 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:52.969252    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf271ecab387b6c0bf980ddd473c7e57.slice/crio-2c56bd0e905e0d8e5a2ea86527d338c2537dd23b729953de2c4d409526d8e44c WatchSource:0}: Error finding container 2c56bd0e905e0d8e5a2ea86527d338c2537dd23b729953de2c4d409526d8e44c: Status 404 returned error can't find the container with id 2c56bd0e905e0d8e5a2ea86527d338c2537dd23b729953de2c4d409526d8e44c
Aug 01 00:28:53.183676 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.183587    2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 01 00:28:53.703361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.703313    2547 apiserver.go:52] "Watching apiserver"
Aug 01 00:28:53.714123 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.714086    2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 01 00:28:53.714636 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.714600    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-p4sf5","openshift-multus/multus-vfpdd","openshift-network-diagnostics/network-check-target-wzd2h","openshift-network-operator/iptables-alerter-k97q8","kube-system/global-pull-secret-syncer-k64vg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv","openshift-image-registry/node-ca-hrxfd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal","openshift-multus/multus-additional-cni-plugins-97dgd","openshift-multus/network-metrics-daemon-677wl","openshift-ovn-kubernetes/ovnkube-node-67gnf","kube-system/konnectivity-agent-zb65f","kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qmqv9"]
Aug 01 00:28:53.718018 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.717524    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.721698 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.720319    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 01 00:28:53.721698 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.720550    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 01 00:28:53.721698 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.720740    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 01 00:28:53.721698 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.720902    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dv5t2\""
Aug 01 00:28:53.721698 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.721093    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:28:53.724113 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.722175    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:53.724113 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.722240    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:28:53.724113 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.724064    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.724676 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.724658    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 01 00:28:53.724801 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.724782    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mz2cv\""
Aug 01 00:28:53.726648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.724858    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 01 00:28:53.726648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.726337    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.728022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.727989    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 01 00:28:53.728263 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.728247    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 01 00:28:53.728842 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.728491    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 01 00:28:53.728842 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.728706    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j8gqb\""
Aug 01 00:28:53.729156 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.729138    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 01 00:28:53.729451 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.729418    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 01 00:28:53.729976 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.729950    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mbxgq\""
Aug 01 00:28:53.730790 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.730218    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.731702 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.731261    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.732320 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.732298    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 01 00:28:53.732454 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.732411    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 01 00:28:53.732648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.732628    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fp8hn\""
Aug 01 00:28:53.732971 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.732846    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 01 00:28:53.733740 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.733721    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.734948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.734928    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 01 00:28:53.735211 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735185    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 01 00:28:53.735289 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735261    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z2nt4\""
Aug 01 00:28:53.735633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735419    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 01 00:28:53.735633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735434    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 01 00:28:53.735633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735521    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 01 00:28:53.735821 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735637    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 01 00:28:53.735821 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735716    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 01 00:28:53.735821 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735819    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x6dbx\""
Aug 01 00:28:53.735960 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735863    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxd5b\" (UniqueName: \"kubernetes.io/projected/7e023f96-5a8e-4c8d-b600-4eabe1282c99-kube-api-access-fxd5b\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.735960 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735898    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-socket-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.735960 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735928    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs48r\" (UniqueName: \"kubernetes.io/projected/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-kube-api-access-bs48r\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.735960 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-kubernetes\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.735977    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-var-lib-kubelet\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736001    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-tuned\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736039    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.736200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736070    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdmp6\" (UniqueName: \"kubernetes.io/projected/5875cba7-1bd3-4a2b-a291-8a9138dbd443-kube-api-access-qdmp6\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.736200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736098    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-systemd\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736119    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-lib-modules\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736152    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fa6833a-4696-48a2-8102-849e675d1988-serviceca\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.736200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736191    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-device-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736233    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-host\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736262    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736287    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-host-slash\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736309    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1eae6f6-d17e-4028-b187-9f14b5ef1640-agent-certs\") pod \"konnectivity-agent-zb65f\" (UID: \"e1eae6f6-d17e-4028-b187-9f14b5ef1640\") " pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736348    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736379    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fa6833a-4696-48a2-8102-849e675d1988-host\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736405    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1eae6f6-d17e-4028-b187-9f14b5ef1640-konnectivity-ca\") pod \"konnectivity-agent-zb65f\" (UID: \"e1eae6f6-d17e-4028-b187-9f14b5ef1640\") " pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736430    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfvd2\" (UniqueName: \"kubernetes.io/projected/5fa6833a-4696-48a2-8102-849e675d1988-kube-api-access-cfvd2\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736463    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-modprobe-d\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736511    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysconfig\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736535    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysctl-d\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736573    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-registration-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736596    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-sys-fs\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736618    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-iptables-alerter-script\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736626    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.736646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736644    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysctl-conf\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.737372 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736669    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-run\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.737372 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736691    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-sys\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.737372 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.736712    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e023f96-5a8e-4c8d-b600-4eabe1282c99-tmp\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.738437 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.738367    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4bhtw\""
Aug 01 00:28:53.738437 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.738419    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 01 00:28:53.739394 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.739371    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.741301    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r9tnq\""
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.741737    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.742090    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.742213    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.742265    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.742275    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.742555    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.742774    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 01 00:28:53.743721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.743399    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 01 00:28:53.744959 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.744632    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.744959 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.744719    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:28:53.764810 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.764682    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-31 00:23:52 +0000 UTC" deadline="2028-02-06 04:53:14.840849601 +0000 UTC"
Aug 01 00:28:53.764810 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.764740    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13300h24m21.076113533s"
Aug 01 00:28:53.828000 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.827942    2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 01 00:28:53.837624 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837591    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-ovnkube-config\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.837786 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837638    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfvd2\" (UniqueName: \"kubernetes.io/projected/5fa6833a-4696-48a2-8102-849e675d1988-kube-api-access-cfvd2\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.837786 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837667    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-modprobe-d\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.837786 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837692    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysctl-d\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.837786 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837712    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-registration-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.837786 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837738    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-iptables-alerter-script\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.837786 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837761    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-os-release\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.837786 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837781    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-systemd\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837828    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysctl-conf\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837867    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-run\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837891    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-sys\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837924    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-var-lib-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837938    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-modprobe-d\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/415a057e-51e3-476d-9086-206c24ef9b8b-ovn-node-metrics-cert\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837980    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-socket-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.837999    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-registration-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838003    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-system-cni-dir\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838026    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-cni-bin\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838057    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-kubelet-config\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838082    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-dbus\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.838135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838094    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysctl-conf\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838138    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysctl-d\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838160    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-kubernetes\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838190    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-tuned\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838199    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-sys\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838209    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-run\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838279    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-kubernetes\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838319    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-socket-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838319    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838359    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-ovnkube-script-lib\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838380    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838385    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838422    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g8xd\" (UniqueName: \"kubernetes.io/projected/e739675e-0789-44a5-bae6-b67926f611ef-kube-api-access-7g8xd\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838454    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-k8s-cni-cncf-io\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838501    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-netns\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838522    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.838584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838547    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-env-overrides\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838575    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-device-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838600    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-host\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838627    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cni-binary-copy\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838651    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-run-netns\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838673    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-cni-bin\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-cni-netd\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838698    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-host\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838723    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-host-slash\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838747    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-device-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838767    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-os-release\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838782    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-iptables-alerter-script\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838793    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-socket-dir-parent\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838819    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838836    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-host-slash\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838842    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-multus-certs\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838868    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1eae6f6-d17e-4028-b187-9f14b5ef1640-agent-certs\") pod \"konnectivity-agent-zb65f\" (UID: \"e1eae6f6-d17e-4028-b187-9f14b5ef1640\") " pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:28:53.839309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838897    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838923    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-cni-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838947    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-cnibin\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838960    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838969    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-hostroot\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.838996    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysconfig\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839027    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-sys-fs\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839038    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-sysconfig\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839051    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e023f96-5a8e-4c8d-b600-4eabe1282c99-tmp\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839080    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839107    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839132    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxd5b\" (UniqueName: \"kubernetes.io/projected/7e023f96-5a8e-4c8d-b600-4eabe1282c99-kube-api-access-fxd5b\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839157    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs48r\" (UniqueName: \"kubernetes.io/projected/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-kube-api-access-bs48r\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839180    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-kubelet\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839206    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-daemon-config\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839220    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839084    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5875cba7-1bd3-4a2b-a291-8a9138dbd443-sys-fs\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.840042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839228    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-node-log\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839610    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-var-lib-kubelet\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839640    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdmp6\" (UniqueName: \"kubernetes.io/projected/5875cba7-1bd3-4a2b-a291-8a9138dbd443-kube-api-access-qdmp6\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839668    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-conf-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839694    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-etc-kubernetes\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839711    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-var-lib-kubelet\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839716    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-slash\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839763    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-systemd\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839782    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-lib-modules\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839807    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fa6833a-4696-48a2-8102-849e675d1988-serviceca\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839833    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cnibin\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839859    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839883    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9090f9e3-ffe1-4eb1-abaa-6625aba20605-hosts-file\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839907    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-ovn\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839931    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llg88\" (UniqueName: \"kubernetes.io/projected/415a057e-51e3-476d-9086-206c24ef9b8b-kube-api-access-llg88\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.839976    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840009    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-systemd\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.840762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840023    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4n6m\" (UniqueName: \"kubernetes.io/projected/15f4b06c-8a26-4bf9-8cc0-644523ef732c-kube-api-access-m4n6m\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840072    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-system-cni-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840095    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-cni-multus\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840115    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e023f96-5a8e-4c8d-b600-4eabe1282c99-lib-modules\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840120    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-systemd-units\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840143    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-log-socket\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840168    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840189    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xpd\" (UniqueName: \"kubernetes.io/projected/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-kube-api-access-j6xpd\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840210    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z72zg\" (UniqueName: \"kubernetes.io/projected/9090f9e3-ffe1-4eb1-abaa-6625aba20605-kube-api-access-z72zg\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840230    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-kubelet\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fa6833a-4696-48a2-8102-849e675d1988-host\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840274    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1eae6f6-d17e-4028-b187-9f14b5ef1640-konnectivity-ca\") pod \"konnectivity-agent-zb65f\" (UID: \"e1eae6f6-d17e-4028-b187-9f14b5ef1640\") " pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840304    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-cni-binary-copy\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840324    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9090f9e3-ffe1-4eb1-abaa-6625aba20605-tmp-dir\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840342    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-etc-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840512    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fa6833a-4696-48a2-8102-849e675d1988-serviceca\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.840655    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fa6833a-4696-48a2-8102-849e675d1988-host\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.841442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.841105    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1eae6f6-d17e-4028-b187-9f14b5ef1640-konnectivity-ca\") pod \"konnectivity-agent-zb65f\" (UID: \"e1eae6f6-d17e-4028-b187-9f14b5ef1640\") " pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:28:53.843793 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.843763    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e023f96-5a8e-4c8d-b600-4eabe1282c99-etc-tuned\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.844670 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.844612    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1eae6f6-d17e-4028-b187-9f14b5ef1640-agent-certs\") pod \"konnectivity-agent-zb65f\" (UID: \"e1eae6f6-d17e-4028-b187-9f14b5ef1640\") " pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:28:53.844795 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.844694    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e023f96-5a8e-4c8d-b600-4eabe1282c99-tmp\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.852724 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.851286    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 01 00:28:53.852724 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.851313    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 01 00:28:53.852724 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.851328    2547 projected.go:196] Error preparing data for projected volume kube-api-access-6t878 for pod openshift-network-diagnostics/network-check-target-wzd2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:28:53.852724 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.851453    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878 podName:27a5921f-23e9-4988-bf77-d7d831e70942 nodeName:}" failed. No retries permitted until 2026-08-01 00:28:54.3514171 +0000 UTC m=+3.048586157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6t878" (UniqueName: "kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878") pod "network-check-target-wzd2h" (UID: "27a5921f-23e9-4988-bf77-d7d831e70942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:28:53.852724 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.852238    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfvd2\" (UniqueName: \"kubernetes.io/projected/5fa6833a-4696-48a2-8102-849e675d1988-kube-api-access-cfvd2\") pod \"node-ca-hrxfd\" (UID: \"5fa6833a-4696-48a2-8102-849e675d1988\") " pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:53.854078 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.854051    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxd5b\" (UniqueName: \"kubernetes.io/projected/7e023f96-5a8e-4c8d-b600-4eabe1282c99-kube-api-access-fxd5b\") pod \"tuned-qmqv9\" (UID: \"7e023f96-5a8e-4c8d-b600-4eabe1282c99\") " pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:53.854517 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.854495    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs48r\" (UniqueName: \"kubernetes.io/projected/5f8ac495-58e7-48ac-b469-2db3bc7e5a10-kube-api-access-bs48r\") pod \"iptables-alerter-k97q8\" (UID: \"5f8ac495-58e7-48ac-b469-2db3bc7e5a10\") " pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:53.854758 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.854732    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdmp6\" (UniqueName: \"kubernetes.io/projected/5875cba7-1bd3-4a2b-a291-8a9138dbd443-kube-api-access-qdmp6\") pod \"aws-ebs-csi-driver-node-8vghv\" (UID: \"5875cba7-1bd3-4a2b-a291-8a9138dbd443\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:53.880389 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.880268    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" event={"ID":"af271ecab387b6c0bf980ddd473c7e57","Type":"ContainerStarted","Data":"2c56bd0e905e0d8e5a2ea86527d338c2537dd23b729953de2c4d409526d8e44c"}
Aug 01 00:28:53.882437 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.882390    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"feb9d9c9a1dacbe35f2e446392a09e3c","Type":"ContainerStarted","Data":"acb8ed3089da2f8a17cdb6efe6566d23a0d51944a4df611621cf75ec9d722122"}
Aug 01 00:28:53.941401 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941351    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.941612 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941415    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.941612 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941470    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.941612 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941535    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-kubelet\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.941612 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941579    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-daemon-config\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.941612 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-node-log\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941615    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-kubelet\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941631    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-conf-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941653    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-etc-kubernetes\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941676    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-slash\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cnibin\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941709    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-conf-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941727    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-etc-kubernetes\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941746    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cnibin\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941747    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941773    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-slash\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941783    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9090f9e3-ffe1-4eb1-abaa-6625aba20605-hosts-file\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941810    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-ovn\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941827    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9090f9e3-ffe1-4eb1-abaa-6625aba20605-hosts-file\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941835    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llg88\" (UniqueName: \"kubernetes.io/projected/415a057e-51e3-476d-9086-206c24ef9b8b-kube-api-access-llg88\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941874    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-ovn\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.941877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941874    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4n6m\" (UniqueName: \"kubernetes.io/projected/15f4b06c-8a26-4bf9-8cc0-644523ef732c-kube-api-access-m4n6m\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941893    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941912    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-system-cni-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941938    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-cni-multus\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941963    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-systemd-units\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941987    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-log-socket\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942013    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.941673    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-node-log\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942069    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xpd\" (UniqueName: \"kubernetes.io/projected/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-kube-api-access-j6xpd\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942096    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z72zg\" (UniqueName: \"kubernetes.io/projected/9090f9e3-ffe1-4eb1-abaa-6625aba20605-kube-api-access-z72zg\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942107    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-systemd-units\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942120    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-kubelet\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942118    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942127    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-daemon-config\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942154    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-system-cni-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942149    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-cni-binary-copy\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942185    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-cni-multus\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942192    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-log-socket\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.942642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942204    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9090f9e3-ffe1-4eb1-abaa-6625aba20605-tmp-dir\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942225    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-kubelet\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942233    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-etc-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.942240    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942259    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-ovnkube-config\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942297    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-os-release\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.942318    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret podName:33c5e0f2-39ae-4f8d-a811-ffcd53e43241 nodeName:}" failed. No retries permitted until 2026-08-01 00:28:54.442299336 +0000 UTC m=+3.139468377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret") pod "global-pull-secret-syncer-k64vg" (UID: "33c5e0f2-39ae-4f8d-a811-ffcd53e43241") : object "kube-system"/"original-pull-secret" not registered
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942347    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-systemd\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942358    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-etc-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942377    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-var-lib-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942405    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/415a057e-51e3-476d-9086-206c24ef9b8b-ovn-node-metrics-cert\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942431    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-run-systemd\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942472    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-var-lib-openvswitch\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942433    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-system-cni-dir\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942529    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-cni-bin\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942554    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-kubelet-config\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942366    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-os-release\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.943507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942475    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15f4b06c-8a26-4bf9-8cc0-644523ef732c-system-cni-dir\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942577    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-dbus\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942628    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-kubelet-config\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942622    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942649    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-var-lib-cni-bin\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942652    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9090f9e3-ffe1-4eb1-abaa-6625aba20605-tmp-dir\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942661    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-ovnkube-script-lib\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942688    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942713    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8xd\" (UniqueName: \"kubernetes.io/projected/e739675e-0789-44a5-bae6-b67926f611ef-kube-api-access-7g8xd\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942738    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-k8s-cni-cncf-io\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942749    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-cni-binary-copy\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942764    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-netns\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942790    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-dbus\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.942830    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942839    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942876    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-k8s-cni-cncf-io\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:53.942890    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs podName:e739675e-0789-44a5-bae6-b67926f611ef nodeName:}" failed. No retries permitted until 2026-08-01 00:28:54.442872822 +0000 UTC m=+3.140041867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs") pod "network-metrics-daemon-677wl" (UID: "e739675e-0789-44a5-bae6-b67926f611ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:28:53.944309 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942912    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-netns\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942790    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942962    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-env-overrides\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.942990    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cni-binary-copy\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943017    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-run-netns\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943040    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-cni-bin\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943066    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-cni-netd\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943089    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-os-release\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943114    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-socket-dir-parent\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943134    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-cni-bin\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943179    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943205    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-os-release\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943216    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-cni-netd\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943085    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943137    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943265    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-multus-certs\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943292    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-cni-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943311    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-socket-dir-parent\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943315    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-cnibin\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943345    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-hostroot\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943353    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-cnibin\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943265    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/415a057e-51e3-476d-9086-206c24ef9b8b-host-run-netns\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943418    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-hostroot\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943454    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-host-run-multus-certs\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943524    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-multus-cni-dir\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943606    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-ovnkube-config\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943615    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15f4b06c-8a26-4bf9-8cc0-644523ef732c-cni-binary-copy\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.943962    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-ovnkube-script-lib\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.944179    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/415a057e-51e3-476d-9086-206c24ef9b8b-env-overrides\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.945936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.945340    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/415a057e-51e3-476d-9086-206c24ef9b8b-ovn-node-metrics-cert\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.965056 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.965018    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z72zg\" (UniqueName: \"kubernetes.io/projected/9090f9e3-ffe1-4eb1-abaa-6625aba20605-kube-api-access-z72zg\") pod \"node-resolver-p4sf5\" (UID: \"9090f9e3-ffe1-4eb1-abaa-6625aba20605\") " pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:53.966300 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.966272    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8xd\" (UniqueName: \"kubernetes.io/projected/e739675e-0789-44a5-bae6-b67926f611ef-kube-api-access-7g8xd\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:53.966671 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.966637    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xpd\" (UniqueName: \"kubernetes.io/projected/2b15bf55-b4d2-480c-8ebc-47ca150cbdc7-kube-api-access-j6xpd\") pod \"multus-vfpdd\" (UID: \"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7\") " pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:53.966892 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.966865    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llg88\" (UniqueName: \"kubernetes.io/projected/415a057e-51e3-476d-9086-206c24ef9b8b-kube-api-access-llg88\") pod \"ovnkube-node-67gnf\" (UID: \"415a057e-51e3-476d-9086-206c24ef9b8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:53.966972 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.966875    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4n6m\" (UniqueName: \"kubernetes.io/projected/15f4b06c-8a26-4bf9-8cc0-644523ef732c-kube-api-access-m4n6m\") pod \"multus-additional-cni-plugins-97dgd\" (UID: \"15f4b06c-8a26-4bf9-8cc0-644523ef732c\") " pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:53.990805 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:53.990762    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 01 00:28:54.038823 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.038783    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hrxfd"
Aug 01 00:28:54.048058 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.048028    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:28:54.060840 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.060809    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k97q8"
Aug 01 00:28:54.069789 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.069757    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qmqv9"
Aug 01 00:28:54.077645 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.077619    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv"
Aug 01 00:28:54.087594 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.087558    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-97dgd"
Aug 01 00:28:54.095618 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.095582    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4sf5"
Aug 01 00:28:54.113630 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.113593    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vfpdd"
Aug 01 00:28:54.119772 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.119739    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:28:54.447198 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.447097    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:54.447410 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.447280    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:28:54.447410 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.447288    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:54.447410 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.447356    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs podName:e739675e-0789-44a5-bae6-b67926f611ef nodeName:}" failed. No retries permitted until 2026-08-01 00:28:55.447336209 +0000 UTC m=+4.144505250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs") pod "network-metrics-daemon-677wl" (UID: "e739675e-0789-44a5-bae6-b67926f611ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:28:54.447410 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.447391    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 01 00:28:54.447410 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.447411    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 01 00:28:54.447703 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.447416    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:54.447703 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.447441    2547 projected.go:196] Error preparing data for projected volume kube-api-access-6t878 for pod openshift-network-diagnostics/network-check-target-wzd2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:28:54.447703 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.447517    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878 podName:27a5921f-23e9-4988-bf77-d7d831e70942 nodeName:}" failed. No retries permitted until 2026-08-01 00:28:55.447476338 +0000 UTC m=+4.144645381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6t878" (UniqueName: "kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878") pod "network-check-target-wzd2h" (UID: "27a5921f-23e9-4988-bf77-d7d831e70942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:28:54.447703 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.447553    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 01 00:28:54.447703 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.447611    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret podName:33c5e0f2-39ae-4f8d-a811-ffcd53e43241 nodeName:}" failed. No retries permitted until 2026-08-01 00:28:55.447596184 +0000 UTC m=+4.144765241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret") pod "global-pull-secret-syncer-k64vg" (UID: "33c5e0f2-39ae-4f8d-a811-ffcd53e43241") : object "kube-system"/"original-pull-secret" not registered
Aug 01 00:28:54.764948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.764887    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-31 00:23:52 +0000 UTC" deadline="2028-03-23 00:19:01.737581872 +0000 UTC"
Aug 01 00:28:54.764948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.764940    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14399h50m6.972643902s"
Aug 01 00:28:54.874282 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.874248    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:54.874456 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:54.874262    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:54.874456 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.874369    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:28:54.874557 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:54.874469    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:28:55.026262 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.026234    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415a057e_51e3_476d_9086_206c24ef9b8b.slice/crio-1921fcfc9e088f1810d386e6bd9c4dc4d0bd9366088200b21f2367bbd3e39b82 WatchSource:0}: Error finding container 1921fcfc9e088f1810d386e6bd9c4dc4d0bd9366088200b21f2367bbd3e39b82: Status 404 returned error can't find the container with id 1921fcfc9e088f1810d386e6bd9c4dc4d0bd9366088200b21f2367bbd3e39b82
Aug 01 00:28:55.027903 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.027876    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa6833a_4696_48a2_8102_849e675d1988.slice/crio-9b2f325eed821f4c4d27d06b332c25db611b83c4030487ea143cc0b47096d1c8 WatchSource:0}: Error finding container 9b2f325eed821f4c4d27d06b332c25db611b83c4030487ea143cc0b47096d1c8: Status 404 returned error can't find the container with id 9b2f325eed821f4c4d27d06b332c25db611b83c4030487ea143cc0b47096d1c8
Aug 01 00:28:55.028990 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.028738    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e023f96_5a8e_4c8d_b600_4eabe1282c99.slice/crio-845f3d4936c34c8760ae827fd74ed7d828d42e42c25f4c82d933813da0829da4 WatchSource:0}: Error finding container 845f3d4936c34c8760ae827fd74ed7d828d42e42c25f4c82d933813da0829da4: Status 404 returned error can't find the container with id 845f3d4936c34c8760ae827fd74ed7d828d42e42c25f4c82d933813da0829da4
Aug 01 00:28:55.035680 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.035651    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8ac495_58e7_48ac_b469_2db3bc7e5a10.slice/crio-0fed4f6e7c8ab2c516d9cc7c88f39e11af82ff793732f63b380fe9b6e741982b WatchSource:0}: Error finding container 0fed4f6e7c8ab2c516d9cc7c88f39e11af82ff793732f63b380fe9b6e741982b: Status 404 returned error can't find the container with id 0fed4f6e7c8ab2c516d9cc7c88f39e11af82ff793732f63b380fe9b6e741982b
Aug 01 00:28:55.036450 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.036417    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9090f9e3_ffe1_4eb1_abaa_6625aba20605.slice/crio-8a7f193dfc6d90857cfa6f0bd51bfad57e1267b4564d6b7a60d5db56a6cf82c0 WatchSource:0}: Error finding container 8a7f193dfc6d90857cfa6f0bd51bfad57e1267b4564d6b7a60d5db56a6cf82c0: Status 404 returned error can't find the container with id 8a7f193dfc6d90857cfa6f0bd51bfad57e1267b4564d6b7a60d5db56a6cf82c0
Aug 01 00:28:55.037915 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.037860    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1eae6f6_d17e_4028_b187_9f14b5ef1640.slice/crio-78a2f03f6e952fba4414bf7ee6f26ec33ec37a13de24e8f1b46d1679529461e3 WatchSource:0}: Error finding container 78a2f03f6e952fba4414bf7ee6f26ec33ec37a13de24e8f1b46d1679529461e3: Status 404 returned error can't find the container with id 78a2f03f6e952fba4414bf7ee6f26ec33ec37a13de24e8f1b46d1679529461e3
Aug 01 00:28:55.038899 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.038871    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5875cba7_1bd3_4a2b_a291_8a9138dbd443.slice/crio-e76a7e8b2855f73a5738c5682ac7e1bbb04c9238f934cf5096085695843ed6f0 WatchSource:0}: Error finding container e76a7e8b2855f73a5738c5682ac7e1bbb04c9238f934cf5096085695843ed6f0: Status 404 returned error can't find the container with id e76a7e8b2855f73a5738c5682ac7e1bbb04c9238f934cf5096085695843ed6f0
Aug 01 00:28:55.041330 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.041304    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b15bf55_b4d2_480c_8ebc_47ca150cbdc7.slice/crio-8a8b0de346170eeb9ad38fab6b75a0e64e5d884b173808e16c00a2b3121b25a1 WatchSource:0}: Error finding container 8a8b0de346170eeb9ad38fab6b75a0e64e5d884b173808e16c00a2b3121b25a1: Status 404 returned error can't find the container with id 8a8b0de346170eeb9ad38fab6b75a0e64e5d884b173808e16c00a2b3121b25a1
Aug 01 00:28:55.041821 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:28:55.041796    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f4b06c_8a26_4bf9_8cc0_644523ef732c.slice/crio-3bb66be61460431effcabd253c7fbc697996744061965e342c97239b3a979278 WatchSource:0}: Error finding container 3bb66be61460431effcabd253c7fbc697996744061965e342c97239b3a979278: Status 404 returned error can't find the container with id 3bb66be61460431effcabd253c7fbc697996744061965e342c97239b3a979278
Aug 01 00:28:55.455366 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.455107    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:55.455549 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.455396    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:55.455549 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.455439    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:55.455549 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.455313    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 01 00:28:55.455549 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.455501    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 01 00:28:55.455549 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.455521    2547 projected.go:196] Error preparing data for projected volume kube-api-access-6t878 for pod openshift-network-diagnostics/network-check-target-wzd2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:28:55.455749 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.455584    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 01 00:28:55.455749 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.455596    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:28:55.455749 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.455594    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878 podName:27a5921f-23e9-4988-bf77-d7d831e70942 nodeName:}" failed. No retries permitted until 2026-08-01 00:28:57.455571707 +0000 UTC m=+6.152740765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6t878" (UniqueName: "kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878") pod "network-check-target-wzd2h" (UID: "27a5921f-23e9-4988-bf77-d7d831e70942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:28:55.455749 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.455658    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret podName:33c5e0f2-39ae-4f8d-a811-ffcd53e43241 nodeName:}" failed. No retries permitted until 2026-08-01 00:28:57.455644037 +0000 UTC m=+6.152813082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret") pod "global-pull-secret-syncer-k64vg" (UID: "33c5e0f2-39ae-4f8d-a811-ffcd53e43241") : object "kube-system"/"original-pull-secret" not registered
Aug 01 00:28:55.455749 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.455675    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs podName:e739675e-0789-44a5-bae6-b67926f611ef nodeName:}" failed. No retries permitted until 2026-08-01 00:28:57.455668079 +0000 UTC m=+6.152837123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs") pod "network-metrics-daemon-677wl" (UID: "e739675e-0789-44a5-bae6-b67926f611ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:28:55.874323 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.874235    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:55.874969 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:55.874407    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:28:55.899134 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.899095    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerStarted","Data":"3bb66be61460431effcabd253c7fbc697996744061965e342c97239b3a979278"}
Aug 01 00:28:55.903174 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.903138    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv" event={"ID":"5875cba7-1bd3-4a2b-a291-8a9138dbd443","Type":"ContainerStarted","Data":"e76a7e8b2855f73a5738c5682ac7e1bbb04c9238f934cf5096085695843ed6f0"}
Aug 01 00:28:55.905318 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.905281    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qmqv9" event={"ID":"7e023f96-5a8e-4c8d-b600-4eabe1282c99","Type":"ContainerStarted","Data":"845f3d4936c34c8760ae827fd74ed7d828d42e42c25f4c82d933813da0829da4"}
Aug 01 00:28:55.907408 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.907376    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hrxfd" event={"ID":"5fa6833a-4696-48a2-8102-849e675d1988","Type":"ContainerStarted","Data":"9b2f325eed821f4c4d27d06b332c25db611b83c4030487ea143cc0b47096d1c8"}
Aug 01 00:28:55.913880 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.913845    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" event={"ID":"af271ecab387b6c0bf980ddd473c7e57","Type":"ContainerStarted","Data":"8e79db34247570c0bd6284862fa99969e20aba12009033da9a476b0a498c8ba9"}
Aug 01 00:28:55.933528 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.933466    2547 generic.go:356] "Generic (PLEG): container finished" podID="feb9d9c9a1dacbe35f2e446392a09e3c" containerID="996065f9ca275a9ec621fb5d0a978e0266a4a8c94421727ece378c136f74fc21" exitCode=0
Aug 01 00:28:55.933746 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.933598    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"feb9d9c9a1dacbe35f2e446392a09e3c","Type":"ContainerDied","Data":"996065f9ca275a9ec621fb5d0a978e0266a4a8c94421727ece378c136f74fc21"}
Aug 01 00:28:55.940597 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.940530    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" podStartSLOduration=3.940509804 podStartE2EDuration="3.940509804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:28:55.939337403 +0000 UTC m=+4.636506462" watchObservedRunningTime="2026-08-01 00:28:55.940509804 +0000 UTC m=+4.637678868"
Aug 01 00:28:55.941018 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.940957    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vfpdd" event={"ID":"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7","Type":"ContainerStarted","Data":"8a8b0de346170eeb9ad38fab6b75a0e64e5d884b173808e16c00a2b3121b25a1"}
Aug 01 00:28:55.948648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.948616    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zb65f" event={"ID":"e1eae6f6-d17e-4028-b187-9f14b5ef1640","Type":"ContainerStarted","Data":"78a2f03f6e952fba4414bf7ee6f26ec33ec37a13de24e8f1b46d1679529461e3"}
Aug 01 00:28:55.966905 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.963932    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4sf5" event={"ID":"9090f9e3-ffe1-4eb1-abaa-6625aba20605","Type":"ContainerStarted","Data":"8a7f193dfc6d90857cfa6f0bd51bfad57e1267b4564d6b7a60d5db56a6cf82c0"}
Aug 01 00:28:55.975347 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.974894    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k97q8" event={"ID":"5f8ac495-58e7-48ac-b469-2db3bc7e5a10","Type":"ContainerStarted","Data":"0fed4f6e7c8ab2c516d9cc7c88f39e11af82ff793732f63b380fe9b6e741982b"}
Aug 01 00:28:55.985243 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:55.985202    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"1921fcfc9e088f1810d386e6bd9c4dc4d0bd9366088200b21f2367bbd3e39b82"}
Aug 01 00:28:56.873871 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:56.873835    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:56.874087 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:56.873975    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:28:56.874501 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:56.874395    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:56.874936 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:56.874530    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:28:57.014448 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:57.014296    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"feb9d9c9a1dacbe35f2e446392a09e3c","Type":"ContainerStarted","Data":"a59dfc0a31b1547086c5c400079c77affa4a987f8bb5844c3864d99f8c0cbe07"}
Aug 01 00:28:57.473500 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:57.473441    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:57.473675 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:57.473543    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:57.473675 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:57.473571    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:57.473799 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.473715    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 01 00:28:57.473799 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.473777    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret podName:33c5e0f2-39ae-4f8d-a811-ffcd53e43241 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:01.473758348 +0000 UTC m=+10.170927387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret") pod "global-pull-secret-syncer-k64vg" (UID: "33c5e0f2-39ae-4f8d-a811-ffcd53e43241") : object "kube-system"/"original-pull-secret" not registered
Aug 01 00:28:57.474228 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.474193    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:28:57.474338 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.474247    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs podName:e739675e-0789-44a5-bae6-b67926f611ef nodeName:}" failed. No retries permitted until 2026-08-01 00:29:01.474230482 +0000 UTC m=+10.171399523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs") pod "network-metrics-daemon-677wl" (UID: "e739675e-0789-44a5-bae6-b67926f611ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:28:57.474338 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.474326    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 01 00:28:57.474452 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.474343    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 01 00:28:57.474452 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.474356    2547 projected.go:196] Error preparing data for projected volume kube-api-access-6t878 for pod openshift-network-diagnostics/network-check-target-wzd2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:28:57.474452 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.474395    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878 podName:27a5921f-23e9-4988-bf77-d7d831e70942 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:01.474383372 +0000 UTC m=+10.171552418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6t878" (UniqueName: "kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878") pod "network-check-target-wzd2h" (UID: "27a5921f-23e9-4988-bf77-d7d831e70942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:28:57.874466 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:57.874369    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:57.874657 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:57.874561    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:28:58.874306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:58.874268    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:28:58.874503 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:58.874315    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:28:58.874503 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:58.874418    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:28:58.874606 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:58.874561    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:28:59.878304 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:28:59.877800    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:28:59.878304 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:28:59.877936    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:00.874344 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:00.874269    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:00.874571 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:00.874315    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:00.874571 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:00.874445    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:00.874571 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:00.874551    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:01.509063 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:01.508929    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:01.509063 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:01.508992    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:01.509063 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:01.509048    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:01.509694 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.509125    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 01 00:29:01.509694 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.509151    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 01 00:29:01.509694 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.509165    2547 projected.go:196] Error preparing data for projected volume kube-api-access-6t878 for pod openshift-network-diagnostics/network-check-target-wzd2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:29:01.509694 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.509196    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:29:01.509694 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.509229    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878 podName:27a5921f-23e9-4988-bf77-d7d831e70942 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:09.509207477 +0000 UTC m=+18.206376522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6t878" (UniqueName: "kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878") pod "network-check-target-wzd2h" (UID: "27a5921f-23e9-4988-bf77-d7d831e70942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:29:01.509694 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.509253    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs podName:e739675e-0789-44a5-bae6-b67926f611ef nodeName:}" failed. No retries permitted until 2026-08-01 00:29:09.509242229 +0000 UTC m=+18.206411282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs") pod "network-metrics-daemon-677wl" (UID: "e739675e-0789-44a5-bae6-b67926f611ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:29:01.509694 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.509282    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 01 00:29:01.509694 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.509319    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret podName:33c5e0f2-39ae-4f8d-a811-ffcd53e43241 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:09.509303872 +0000 UTC m=+18.206472925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret") pod "global-pull-secret-syncer-k64vg" (UID: "33c5e0f2-39ae-4f8d-a811-ffcd53e43241") : object "kube-system"/"original-pull-secret" not registered
Aug 01 00:29:01.875124 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:01.874627    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:01.875124 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:01.874743    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:02.873886 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:02.873836    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:02.873886 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:02.873874    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:02.874443 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:02.873992    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:02.874443 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:02.874153    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:03.877771 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:03.877730    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:03.878275 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:03.877878    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:04.874205 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:04.874159    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:04.874374 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:04.874169    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:04.874374 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:04.874288    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:04.874581 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:04.874389    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:05.873837 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:05.873790    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:05.874294 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:05.873936    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:06.873783 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:06.873747    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:06.873948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:06.873747    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:06.873948 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:06.873890    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:06.874325 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:06.873946    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:07.874578 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:07.874535    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:07.875033 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:07.874695    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:08.873878 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:08.873832    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:08.874113 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:08.873832    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:08.874113 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:08.873987    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:08.874113 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:08.874050    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:09.572642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:09.572596    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:09.572642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:09.572645    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:09.572700    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.572829    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.572826    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.572901    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs podName:e739675e-0789-44a5-bae6-b67926f611ef nodeName:}" failed. No retries permitted until 2026-08-01 00:29:25.572874821 +0000 UTC m=+34.270043877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs") pod "network-metrics-daemon-677wl" (UID: "e739675e-0789-44a5-bae6-b67926f611ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.572921    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.572941    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.572997    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret podName:33c5e0f2-39ae-4f8d-a811-ffcd53e43241 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:25.572984273 +0000 UTC m=+34.270153316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret") pod "global-pull-secret-syncer-k64vg" (UID: "33c5e0f2-39ae-4f8d-a811-ffcd53e43241") : object "kube-system"/"original-pull-secret" not registered
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.572950    2547 projected.go:196] Error preparing data for projected volume kube-api-access-6t878 for pod openshift-network-diagnostics/network-check-target-wzd2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:29:09.573176 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.573034    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878 podName:27a5921f-23e9-4988-bf77-d7d831e70942 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:25.573027945 +0000 UTC m=+34.270196984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6t878" (UniqueName: "kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878") pod "network-check-target-wzd2h" (UID: "27a5921f-23e9-4988-bf77-d7d831e70942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:29:09.874598 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:09.874509    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:09.874745 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:09.874624    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:10.873902 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:10.873858    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:10.874421 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:10.874015    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:10.874421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:10.874085    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:10.874421 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:10.874209    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:11.874895 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:11.874862    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:11.875334 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:11.874963    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:12.874055 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:12.874010    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:12.874243 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:12.874022    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:12.874243 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:12.874156    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:12.874355 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:12.874236    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:13.874223 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:13.874001    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:13.875179 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:13.874339    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:14.050306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.049919    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vfpdd" event={"ID":"2b15bf55-b4d2-480c-8ebc-47ca150cbdc7","Type":"ContainerStarted","Data":"c3abdf8af4b152737006eb62f0cff28ea684b4cd485c4ccd09a4641045eecd0b"}
Aug 01 00:29:14.051496 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.051456    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zb65f" event={"ID":"e1eae6f6-d17e-4028-b187-9f14b5ef1640","Type":"ContainerStarted","Data":"0d0634cd2109b029b975076f1f862b0fadf4111439bbb7658dff411677a00fab"}
Aug 01 00:29:14.052941 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.052920    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4sf5" event={"ID":"9090f9e3-ffe1-4eb1-abaa-6625aba20605","Type":"ContainerStarted","Data":"a293bb8c186d00d3e91fb8fe6a4eb37346ae8884783457024f67047de157a95a"}
Aug 01 00:29:14.055377 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.055352    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"3577cc3a5a546cc59d938ce74b59ed8555eba11d4054bc1c88290bbc220d06fe"}
Aug 01 00:29:14.055497 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.055420    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"0b88a40c4ab35d3a61652f1d337bafd0bdb75b7824842f887199b90328e48ba2"}
Aug 01 00:29:14.055497 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.055451    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"60865b162eba0b2a1f2c348dfb8b0b9f975fc97cced1096e6cf41f79fbb72f66"}
Aug 01 00:29:14.055596 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.055507    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"117ba7212ed92c40d5cf9011e04b56d49570fc8c8fc9cb519efdecd094b4da0f"}
Aug 01 00:29:14.056668 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.056644    2547 generic.go:356] "Generic (PLEG): container finished" podID="15f4b06c-8a26-4bf9-8cc0-644523ef732c" containerID="d6c26ce2e177879301cf6534081ce241150c2f1568112141368572a094471dd2" exitCode=0
Aug 01 00:29:14.056760 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.056720    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerDied","Data":"d6c26ce2e177879301cf6534081ce241150c2f1568112141368572a094471dd2"}
Aug 01 00:29:14.058060 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.058031    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv" event={"ID":"5875cba7-1bd3-4a2b-a291-8a9138dbd443","Type":"ContainerStarted","Data":"1454f1f45afaa550a139d3ce295ac7c5b7ee205912f73c85b7b7a133dc6c22c1"}
Aug 01 00:29:14.059379 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.059360    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qmqv9" event={"ID":"7e023f96-5a8e-4c8d-b600-4eabe1282c99","Type":"ContainerStarted","Data":"1ac6175074631108fec179b2409e69d98e7ff045b2dfd0172057e034fb922218"}
Aug 01 00:29:14.060839 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.060814    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hrxfd" event={"ID":"5fa6833a-4696-48a2-8102-849e675d1988","Type":"ContainerStarted","Data":"c48b713514962f4f0ea097ea74dcbce2cf4d518e4b4f5369ce5d4884b65a05ca"}
Aug 01 00:29:14.067259 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.067219    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" podStartSLOduration=22.067205046 podStartE2EDuration="22.067205046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:28:57.027727898 +0000 UTC m=+5.724896961" watchObservedRunningTime="2026-08-01 00:29:14.067205046 +0000 UTC m=+22.764374180"
Aug 01 00:29:14.067794 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.067761    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vfpdd" podStartSLOduration=4.44442683 podStartE2EDuration="23.067749274s" totalImagesPullingTime="18.623322444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:14.066848697 +0000 UTC m=+22.764017760" watchObservedRunningTime="2026-08-01 00:29:14.067749274 +0000 UTC m=+22.764918336"
Aug 01 00:29:14.087742 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.087694    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zb65f" podStartSLOduration=8.23560433 podStartE2EDuration="23.087676948s" totalImagesPullingTime="14.852072618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:14.087127553 +0000 UTC m=+22.784296616" watchObservedRunningTime="2026-08-01 00:29:14.087676948 +0000 UTC m=+22.784846009"
Aug 01 00:29:14.121118 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.121070    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hrxfd" podStartSLOduration=4.560865431 podStartE2EDuration="23.121052959s" totalImagesPullingTime="18.560187528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:14.104702919 +0000 UTC m=+22.801872076" watchObservedRunningTime="2026-08-01 00:29:14.121052959 +0000 UTC m=+22.818222020"
Aug 01 00:29:14.121558 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.121454    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qmqv9" podStartSLOduration=4.547299592 podStartE2EDuration="23.121448189s" totalImagesPullingTime="18.574148597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:14.120914225 +0000 UTC m=+22.818083325" watchObservedRunningTime="2026-08-01 00:29:14.121448189 +0000 UTC m=+22.818617251"
Aug 01 00:29:14.156227 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.156174    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p4sf5" podStartSLOduration=4.603348991 podStartE2EDuration="23.156158954s" totalImagesPullingTime="18.552809963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:14.156090883 +0000 UTC m=+22.853259945" watchObservedRunningTime="2026-08-01 00:29:14.156158954 +0000 UTC m=+22.853328013"
Aug 01 00:29:14.874167 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.874066    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:14.874381 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:14.874088    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:14.874381 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:14.874232    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:14.874381 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:14.874365    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:15.067385 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:15.067348    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"6ed6e7b5b6033f73cdc6ff5bb0d07afdafebcb3beb6b61760f5125433670a4b0"}
Aug 01 00:29:15.067604 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:15.067448    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"7e6878889c14ee8ec23ae0d72bce0a6388897961e0715af126103fa1c8bf1498"}
Aug 01 00:29:15.188647 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:15.188613    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 01 00:29:15.810171 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:15.810040    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-01T00:29:15.188639416Z","UUID":"c1db8059-9813-4e58-b035-e53681c66094","Handler":null,"Name":"","Endpoint":""}
Aug 01 00:29:15.811784 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:15.811760    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 01 00:29:15.811950 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:15.811805    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 01 00:29:15.873704 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:15.873675    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:15.873955 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:15.873824    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:16.073527 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:16.073416    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k97q8" event={"ID":"5f8ac495-58e7-48ac-b469-2db3bc7e5a10","Type":"ContainerStarted","Data":"27a65dbf09de2c8c3299c41e183d4199f062f8e7d1a924d3d136c47581eb037d"}
Aug 01 00:29:16.075313 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:16.075288    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv" event={"ID":"5875cba7-1bd3-4a2b-a291-8a9138dbd443","Type":"ContainerStarted","Data":"e1e45948bcf70785886386850e7bab95a876037b192102e8766b1a5929f927d4"}
Aug 01 00:29:16.873684 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:16.873648    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:16.873880 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:16.873783    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:16.874048 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:16.873652    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:16.874178 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:16.874152    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:17.081852 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:17.081795    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"20192d13f677d7286e47909188084986a430f630fb1a96853542a272c3631893"}
Aug 01 00:29:17.874282 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:17.874240    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:17.874492 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:17.874390    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:18.086761 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:18.086561    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv" event={"ID":"5875cba7-1bd3-4a2b-a291-8a9138dbd443","Type":"ContainerStarted","Data":"d3386a2550b8b75bedf382edee5ad24a490e7ba7a39ea0ef170a0f8f18d6eb2f"}
Aug 01 00:29:18.102577 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:18.102522    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k97q8" podStartSLOduration=8.548204269 podStartE2EDuration="27.102500498s" totalImagesPullingTime="18.554296229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:16.085551352 +0000 UTC m=+24.782720416" watchObservedRunningTime="2026-08-01 00:29:18.102500498 +0000 UTC m=+26.799669560"
Aug 01 00:29:18.102762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:18.102686    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vghv" podStartSLOduration=5.244605497 podStartE2EDuration="27.102680702s" totalImagesPullingTime="21.858075205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:18.102432611 +0000 UTC m=+26.799601673" watchObservedRunningTime="2026-08-01 00:29:18.102680702 +0000 UTC m=+26.799849764"
Aug 01 00:29:18.760560 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:18.760525    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:29:18.761248 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:18.761221    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:29:18.873550 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:18.873528    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:18.873740 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:18.873528    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:18.873740 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:18.873626    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:18.873740 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:18.873690    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:19.094640 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:19.094526    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" event={"ID":"415a057e-51e3-476d-9086-206c24ef9b8b","Type":"ContainerStarted","Data":"3cdbfb99d8f067da58b0077eaee5860d7ed44d3242745f736c746ed231d7fd73"}
Aug 01 00:29:19.096076 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:19.095318    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:29:19.096076 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:19.095422    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zb65f"
Aug 01 00:29:19.118212 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:19.118170    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf" podStartSLOduration=8.486072993 podStartE2EDuration="27.118155606s" totalImagesPullingTime="18.632082613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:19.118029706 +0000 UTC m=+27.815198769" watchObservedRunningTime="2026-08-01 00:29:19.118155606 +0000 UTC m=+27.815324668"
Aug 01 00:29:19.874233 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:19.874025    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:19.874380 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:19.874325    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:20.097617 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.097578    2547 generic.go:356] "Generic (PLEG): container finished" podID="15f4b06c-8a26-4bf9-8cc0-644523ef732c" containerID="0bebcd61badc41d87dd5c87fea6c827c977c9c51c1e149034844d6274bfc3b2d" exitCode=0
Aug 01 00:29:20.098307 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.097628    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerDied","Data":"0bebcd61badc41d87dd5c87fea6c827c977c9c51c1e149034844d6274bfc3b2d"}
Aug 01 00:29:20.098307 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.098293    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:29:20.098832 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.098365    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:29:20.098832 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.098408    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:29:20.115109 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.115078    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:29:20.115258 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.115191    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:29:20.873811 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.873772    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:20.874093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:20.873790    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:20.874093 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:20.873889    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:20.874093 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:20.873960    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:21.287549 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:21.287510    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-677wl"]
Aug 01 00:29:21.288175 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:21.287697    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:21.288175 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:21.287824    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:21.288462 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:21.288441    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k64vg"]
Aug 01 00:29:21.288689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:21.288673    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:21.288804 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:21.288782    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:21.289142 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:21.289117    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wzd2h"]
Aug 01 00:29:21.289229 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:21.289203    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:21.289292 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:21.289276    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:22.874506 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:22.874245    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:22.874941 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:22.874291    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:22.874941 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:22.874545    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:22.874941 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:22.874291    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:22.874941 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:22.874628    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:22.874941 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:22.874686    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:23.107023 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:23.106989    2547 generic.go:356] "Generic (PLEG): container finished" podID="15f4b06c-8a26-4bf9-8cc0-644523ef732c" containerID="05f1c47961622bba8bfa61125632ef908170295d39265d30ee7439055673d23f" exitCode=0
Aug 01 00:29:23.107217 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:23.107070    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerDied","Data":"05f1c47961622bba8bfa61125632ef908170295d39265d30ee7439055673d23f"}
Aug 01 00:29:24.873781 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:24.873746    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:24.873781 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:24.873767    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:24.873781 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:24.873794    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:24.874385 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:24.873875    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k64vg" podUID="33c5e0f2-39ae-4f8d-a811-ffcd53e43241"
Aug 01 00:29:24.874385 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:24.873949    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-677wl" podUID="e739675e-0789-44a5-bae6-b67926f611ef"
Aug 01 00:29:24.874385 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:24.873979    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzd2h" podUID="27a5921f-23e9-4988-bf77-d7d831e70942"
Aug 01 00:29:25.114594 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:25.114557    2547 generic.go:356] "Generic (PLEG): container finished" podID="15f4b06c-8a26-4bf9-8cc0-644523ef732c" containerID="07c5d1bf73c4585a60f825a6aeb0035993b95eb7fa9ef6546cbae723a57e503b" exitCode=0
Aug 01 00:29:25.114771 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:25.114609    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerDied","Data":"07c5d1bf73c4585a60f825a6aeb0035993b95eb7fa9ef6546cbae723a57e503b"}
Aug 01 00:29:25.593316 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:25.593273    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:25.593316 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:25.593316    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:25.593574 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:25.593355    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:25.593574 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:25.593451    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:29:25.593574 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:25.593497    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 01 00:29:25.593574 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:25.593454    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 01 00:29:25.593574 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:25.593552    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 01 00:29:25.593574 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:25.593533    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs podName:e739675e-0789-44a5-bae6-b67926f611ef nodeName:}" failed. No retries permitted until 2026-08-01 00:29:57.593512877 +0000 UTC m=+66.290681920 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs") pod "network-metrics-daemon-677wl" (UID: "e739675e-0789-44a5-bae6-b67926f611ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 01 00:29:25.593574 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:25.593566    2547 projected.go:196] Error preparing data for projected volume kube-api-access-6t878 for pod openshift-network-diagnostics/network-check-target-wzd2h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:29:25.593819 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:25.593597    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret podName:33c5e0f2-39ae-4f8d-a811-ffcd53e43241 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:57.593571475 +0000 UTC m=+66.290740522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret") pod "global-pull-secret-syncer-k64vg" (UID: "33c5e0f2-39ae-4f8d-a811-ffcd53e43241") : object "kube-system"/"original-pull-secret" not registered
Aug 01 00:29:25.593819 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:25.593622    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878 podName:27a5921f-23e9-4988-bf77-d7d831e70942 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:57.5936079 +0000 UTC m=+66.290776943 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6t878" (UniqueName: "kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878") pod "network-check-target-wzd2h" (UID: "27a5921f-23e9-4988-bf77-d7d831e70942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 01 00:29:26.603231 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.603198    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeReady"
Aug 01 00:29:26.604022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.603357    2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 01 00:29:26.646442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.646407    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d2kr9"]
Aug 01 00:29:26.650178 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.650156    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-twdgh"]
Aug 01 00:29:26.650293 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.650272    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.652357 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.652335    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 01 00:29:26.652690 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.652673    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fl89b\""
Aug 01 00:29:26.652806 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.652675    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 01 00:29:26.654108 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.654090    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-twdgh"
Aug 01 00:29:26.658348 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.658067    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 01 00:29:26.658348 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.658162    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 01 00:29:26.658348 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.658019    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-stmw4\""
Aug 01 00:29:26.658348 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.658112    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 01 00:29:26.658663 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.658530    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-twdgh"]
Aug 01 00:29:26.660212 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.660141    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d2kr9"]
Aug 01 00:29:26.803165 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.803121    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e0c425-c34c-4375-a04e-3b4531220873-tmp-dir\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.803165 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.803167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e27711d-9e58-4e1b-90c4-b39f5c43bf1d-cert\") pod \"ingress-canary-twdgh\" (UID: \"6e27711d-9e58-4e1b-90c4-b39f5c43bf1d\") " pod="openshift-ingress-canary/ingress-canary-twdgh"
Aug 01 00:29:26.803397 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.803220    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvgvz\" (UniqueName: \"kubernetes.io/projected/53e0c425-c34c-4375-a04e-3b4531220873-kube-api-access-kvgvz\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.803397 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.803247    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53e0c425-c34c-4375-a04e-3b4531220873-config-volume\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.803397 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.803277    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.803397 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.803299    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht24q\" (UniqueName: \"kubernetes.io/projected/6e27711d-9e58-4e1b-90c4-b39f5c43bf1d-kube-api-access-ht24q\") pod \"ingress-canary-twdgh\" (UID: \"6e27711d-9e58-4e1b-90c4-b39f5c43bf1d\") " pod="openshift-ingress-canary/ingress-canary-twdgh"
Aug 01 00:29:26.874333 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.874238    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:26.874333 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.874295    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:26.874583 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.874246    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:26.876753 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.876725    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 01 00:29:26.876753 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.876730    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 01 00:29:26.876947 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.876769    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 01 00:29:26.876947 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.876769    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2x5h\""
Aug 01 00:29:26.876947 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.876842    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bnzmh\""
Aug 01 00:29:26.877125 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.877109    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 01 00:29:26.904032 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.903998    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e0c425-c34c-4375-a04e-3b4531220873-tmp-dir\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.904306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.904044    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e27711d-9e58-4e1b-90c4-b39f5c43bf1d-cert\") pod \"ingress-canary-twdgh\" (UID: \"6e27711d-9e58-4e1b-90c4-b39f5c43bf1d\") " pod="openshift-ingress-canary/ingress-canary-twdgh"
Aug 01 00:29:26.904306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.904104    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvgvz\" (UniqueName: \"kubernetes.io/projected/53e0c425-c34c-4375-a04e-3b4531220873-kube-api-access-kvgvz\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.904306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.904131    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53e0c425-c34c-4375-a04e-3b4531220873-config-volume\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.904306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.904157    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.904306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.904184    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht24q\" (UniqueName: \"kubernetes.io/projected/6e27711d-9e58-4e1b-90c4-b39f5c43bf1d-kube-api-access-ht24q\") pod \"ingress-canary-twdgh\" (UID: \"6e27711d-9e58-4e1b-90c4-b39f5c43bf1d\") " pod="openshift-ingress-canary/ingress-canary-twdgh"
Aug 01 00:29:26.904686 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.904411    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e0c425-c34c-4375-a04e-3b4531220873-tmp-dir\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.904686 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:26.904520    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 01 00:29:26.904686 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:26.904577    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls podName:53e0c425-c34c-4375-a04e-3b4531220873 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:27.404560748 +0000 UTC m=+36.101729803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls") pod "dns-default-d2kr9" (UID: "53e0c425-c34c-4375-a04e-3b4531220873") : secret "dns-default-metrics-tls" not found
Aug 01 00:29:26.904925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.904737    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53e0c425-c34c-4375-a04e-3b4531220873-config-volume\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.909789 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.909763    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e27711d-9e58-4e1b-90c4-b39f5c43bf1d-cert\") pod \"ingress-canary-twdgh\" (UID: \"6e27711d-9e58-4e1b-90c4-b39f5c43bf1d\") " pod="openshift-ingress-canary/ingress-canary-twdgh"
Aug 01 00:29:26.914839 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.914812    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvgvz\" (UniqueName: \"kubernetes.io/projected/53e0c425-c34c-4375-a04e-3b4531220873-kube-api-access-kvgvz\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:26.915173 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.915111    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht24q\" (UniqueName: \"kubernetes.io/projected/6e27711d-9e58-4e1b-90c4-b39f5c43bf1d-kube-api-access-ht24q\") pod \"ingress-canary-twdgh\" (UID: \"6e27711d-9e58-4e1b-90c4-b39f5c43bf1d\") " pod="openshift-ingress-canary/ingress-canary-twdgh"
Aug 01 00:29:26.972398 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:26.972353    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-twdgh"
Aug 01 00:29:27.136343 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:27.136105    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-twdgh"]
Aug 01 00:29:27.140043 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:29:27.140018    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e27711d_9e58_4e1b_90c4_b39f5c43bf1d.slice/crio-0162d764b72cac14f7ee820397cca80d4fefa8fe90a002d62b5cfc8a94e70854 WatchSource:0}: Error finding container 0162d764b72cac14f7ee820397cca80d4fefa8fe90a002d62b5cfc8a94e70854: Status 404 returned error can't find the container with id 0162d764b72cac14f7ee820397cca80d4fefa8fe90a002d62b5cfc8a94e70854
Aug 01 00:29:27.407606 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:27.407475    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:27.407763 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:27.407601    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 01 00:29:27.407763 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:27.407701    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls podName:53e0c425-c34c-4375-a04e-3b4531220873 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:28.40768203 +0000 UTC m=+37.104851075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls") pod "dns-default-d2kr9" (UID: "53e0c425-c34c-4375-a04e-3b4531220873") : secret "dns-default-metrics-tls" not found
Aug 01 00:29:28.125138 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:28.125096    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-twdgh" event={"ID":"6e27711d-9e58-4e1b-90c4-b39f5c43bf1d","Type":"ContainerStarted","Data":"0162d764b72cac14f7ee820397cca80d4fefa8fe90a002d62b5cfc8a94e70854"}
Aug 01 00:29:28.418093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:28.417981    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:28.418253 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:28.418112    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 01 00:29:28.418253 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:28.418187    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls podName:53e0c425-c34c-4375-a04e-3b4531220873 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:30.418167534 +0000 UTC m=+39.115336577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls") pod "dns-default-d2kr9" (UID: "53e0c425-c34c-4375-a04e-3b4531220873") : secret "dns-default-metrics-tls" not found
Aug 01 00:29:30.433669 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:30.433623    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:30.434104 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:30.433814    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 01 00:29:30.434104 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:30.433930    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls podName:53e0c425-c34c-4375-a04e-3b4531220873 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:34.43390564 +0000 UTC m=+43.131074687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls") pod "dns-default-d2kr9" (UID: "53e0c425-c34c-4375-a04e-3b4531220873") : secret "dns-default-metrics-tls" not found
Aug 01 00:29:31.139612 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:31.139578    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerStarted","Data":"721375458d9fb75b977980bc321de006993c103ef5b25f0a46f6f6dc8edccaec"}
Aug 01 00:29:32.143622 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:32.143582    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-twdgh" event={"ID":"6e27711d-9e58-4e1b-90c4-b39f5c43bf1d","Type":"ContainerStarted","Data":"3a5fee72801f09b8ac1e64e83c08f791c8f0d68dad1b01a22d845ee3f3f8f5bb"}
Aug 01 00:29:32.146360 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:32.146325    2547 generic.go:356] "Generic (PLEG): container finished" podID="15f4b06c-8a26-4bf9-8cc0-644523ef732c" containerID="721375458d9fb75b977980bc321de006993c103ef5b25f0a46f6f6dc8edccaec" exitCode=0
Aug 01 00:29:32.146619 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:32.146372    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerDied","Data":"721375458d9fb75b977980bc321de006993c103ef5b25f0a46f6f6dc8edccaec"}
Aug 01 00:29:32.158051 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:32.157978    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-twdgh" podStartSLOduration=2.279158279 podStartE2EDuration="6.157957037s" totalImagesPullingTime="3.878798758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:32.156608586 +0000 UTC m=+40.853777647" watchObservedRunningTime="2026-08-01 00:29:32.157957037 +0000 UTC m=+40.855126080"
Aug 01 00:29:33.151882 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:33.151840    2547 generic.go:356] "Generic (PLEG): container finished" podID="15f4b06c-8a26-4bf9-8cc0-644523ef732c" containerID="a3dd64d37b3db809e422d91bf172a9e26f8bec5a0dbf3c37896903a6d6101d64" exitCode=0
Aug 01 00:29:33.152314 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:33.151937    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerDied","Data":"a3dd64d37b3db809e422d91bf172a9e26f8bec5a0dbf3c37896903a6d6101d64"}
Aug 01 00:29:34.158171 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:34.158136    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-97dgd" event={"ID":"15f4b06c-8a26-4bf9-8cc0-644523ef732c","Type":"ContainerStarted","Data":"0ca517acb0638b17b9817a3625a2a843ccd839f901334cf9cdfd09a890139d15"}
Aug 01 00:29:34.179788 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:34.179738    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-97dgd" podStartSLOduration=10.337688124 podStartE2EDuration="43.179718538s" totalImagesPullingTime="32.842030414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:34.178556685 +0000 UTC m=+42.875725749" watchObservedRunningTime="2026-08-01 00:29:34.179718538 +0000 UTC m=+42.876887600"
Aug 01 00:29:34.462729 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:34.462639    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:34.462872 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:34.462774    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 01 00:29:34.462872 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:34.462830    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls podName:53e0c425-c34c-4375-a04e-3b4531220873 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:42.462815443 +0000 UTC m=+51.159984483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls") pod "dns-default-d2kr9" (UID: "53e0c425-c34c-4375-a04e-3b4531220873") : secret "dns-default-metrics-tls" not found
Aug 01 00:29:38.394292 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.394255    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv"]
Aug 01 00:29:38.412155 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.412114    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fdcdd856c-v5z98"]
Aug 01 00:29:38.412336 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.412256    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv"
Aug 01 00:29:38.414293 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.414266    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wm46l\""
Aug 01 00:29:38.437032 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.436992    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"]
Aug 01 00:29:38.437191 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.437121    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.439218 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.439194    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4jrsr\""
Aug 01 00:29:38.439371 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.439227    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 01 00:29:38.439422 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.439377    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 01 00:29:38.439497 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.439462    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 01 00:29:38.444410 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.444384    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 01 00:29:38.454083 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.454046    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv"]
Aug 01 00:29:38.454083 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.454086    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"]
Aug 01 00:29:38.454306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.454099    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fdcdd856c-v5z98"]
Aug 01 00:29:38.454306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.454255    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.456372 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.456350    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 01 00:29:38.456531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.456355    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 01 00:29:38.456531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.456447    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w8q4m\""
Aug 01 00:29:38.456654 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.456639    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 01 00:29:38.456754 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.456738    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 01 00:29:38.495383 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.495347    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7"]
Aug 01 00:29:38.516962 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.516929    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"]
Aug 01 00:29:38.517133 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.517095    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7"
Aug 01 00:29:38.519596 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.519566    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 01 00:29:38.519818 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.519795    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-t8rc6\""
Aug 01 00:29:38.520006 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.519984    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 01 00:29:38.533025 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.532905    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7df4f94764-jnbqw"]
Aug 01 00:29:38.533177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.533109    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:38.535063 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.535037    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 01 00:29:38.535190 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.535157    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jfwjg\""
Aug 01 00:29:38.535190 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.535168    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 01 00:29:38.539739 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.539718    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7"]
Aug 01 00:29:38.539825 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.539757    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"]
Aug 01 00:29:38.539825 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.539781    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7df4f94764-jnbqw"]
Aug 01 00:29:38.539919 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.539884    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.542083 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.542053    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Aug 01 00:29:38.542083 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.542069    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 01 00:29:38.542261 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.542125    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Aug 01 00:29:38.542261 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.542133    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Aug 01 00:29:38.542371 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.542294    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hz4c\""
Aug 01 00:29:38.542425 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.542390    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Aug 01 00:29:38.542425 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.542396    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 01 00:29:38.592760 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.592724    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-trusted-ca\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.592966 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.592778    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54tfc\" (UniqueName: \"kubernetes.io/projected/3a200e2c-a560-4cef-ae8e-8b74af405811-kube-api-access-54tfc\") pod \"network-check-source-65bdbbff45-bghcv\" (UID: \"3a200e2c-a560-4cef-ae8e-8b74af405811\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv"
Aug 01 00:29:38.592966 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.592799    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-image-registry-private-configuration\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.592966 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.592821    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-bound-sa-token\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.592966 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.592894    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-certificates\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.592966 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.592931    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gwfv\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-kube-api-access-2gwfv\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.592966 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.592962    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.593226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.592998    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grhsf\" (UniqueName: \"kubernetes.io/projected/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-kube-api-access-grhsf\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.593226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.593066    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.593226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.593097    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-installation-pull-secrets\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.593226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.593139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b7767cd-27cb-49f8-99e3-de1bb779c004-ca-trust-extracted\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.593226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.593177    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.596918 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.596887    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-855l6"]
Aug 01 00:29:38.631412 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.631368    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-855l6"]
Aug 01 00:29:38.631589 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.631427    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.633583 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.633553    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tnlsz\""
Aug 01 00:29:38.633734 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.633600    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 01 00:29:38.633821 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.633804    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 01 00:29:38.634059 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.634042    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 01 00:29:38.634158 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.634135    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 01 00:29:38.639149 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.638987    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 01 00:29:38.693672 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693576    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54tfc\" (UniqueName: \"kubernetes.io/projected/3a200e2c-a560-4cef-ae8e-8b74af405811-kube-api-access-54tfc\") pod \"network-check-source-65bdbbff45-bghcv\" (UID: \"3a200e2c-a560-4cef-ae8e-8b74af405811\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv"
Aug 01 00:29:38.693672 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693614    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-image-registry-private-configuration\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.693672 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693637    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-bound-sa-token\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.693672 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693659    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693683    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvncp\" (UniqueName: \"kubernetes.io/projected/21764f3a-5c04-4e8b-bfa9-d29e519ea939-kube-api-access-cvncp\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693717    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-certificates\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693743    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gwfv\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-kube-api-access-2gwfv\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693765    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-stats-auth\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693793    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693818    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-default-certificate\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693847    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grhsf\" (UniqueName: \"kubernetes.io/projected/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-kube-api-access-grhsf\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693874    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693900    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693963    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.693982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.693986    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-installation-pull-secrets\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.694517 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.694036    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65zcs\" (UniqueName: \"kubernetes.io/projected/dbf9d58e-afc2-4130-8f39-23568a253b94-kube-api-access-65zcs\") pod \"volume-data-source-validator-5b8776669-78cr7\" (UID: \"dbf9d58e-afc2-4130-8f39-23568a253b94\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7"
Aug 01 00:29:38.694517 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:38.694159    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 01 00:29:38.694517 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:38.694180    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdcdd856c-v5z98: secret "image-registry-tls" not found
Aug 01 00:29:38.694517 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:38.694253    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls podName:8b7767cd-27cb-49f8-99e3-de1bb779c004 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:39.194230161 +0000 UTC m=+47.891399216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls") pod "image-registry-7fdcdd856c-v5z98" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004") : secret "image-registry-tls" not found
Aug 01 00:29:38.694517 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.694298    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b7767cd-27cb-49f8-99e3-de1bb779c004-ca-trust-extracted\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.694517 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.694360    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.694517 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.694393    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-trusted-ca\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.694517 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.694420    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.694969 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.694646    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b7767cd-27cb-49f8-99e3-de1bb779c004-ca-trust-extracted\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.694969 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.694877    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-certificates\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.695077 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.695046    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.696088 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.696064    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-trusted-ca\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.697341 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.697320    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.697443 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.697368    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-image-registry-private-configuration\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.697443 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.697435    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-installation-pull-secrets\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.702320 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.702295    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-bound-sa-token\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.702565 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.702540    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grhsf\" (UniqueName: \"kubernetes.io/projected/a2ceeaa9-1cfa-467d-adde-1769ebae2d7e-kube-api-access-grhsf\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54sb2\" (UID: \"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.702679 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.702638    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54tfc\" (UniqueName: \"kubernetes.io/projected/3a200e2c-a560-4cef-ae8e-8b74af405811-kube-api-access-54tfc\") pod \"network-check-source-65bdbbff45-bghcv\" (UID: \"3a200e2c-a560-4cef-ae8e-8b74af405811\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv"
Aug 01 00:29:38.703083 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.703062    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gwfv\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-kube-api-access-2gwfv\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:38.721904 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.721861    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv"
Aug 01 00:29:38.763428 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.763396    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"
Aug 01 00:29:38.795889 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.795843    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.796044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.795900    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvncp\" (UniqueName: \"kubernetes.io/projected/21764f3a-5c04-4e8b-bfa9-d29e519ea939-kube-api-access-cvncp\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.796044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.795929    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-stats-auth\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.796044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.795947    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-default-certificate\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.796170 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:38.796074    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:39.296045061 +0000 UTC m=+47.993214104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : configmap references non-existent config key: service-ca.crt
Aug 01 00:29:38.796170 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.796124    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:38.796170 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.796162    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ade4353-b324-47a7-b522-4e3923b3fee4-config\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.796282 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.796232    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65zcs\" (UniqueName: \"kubernetes.io/projected/dbf9d58e-afc2-4130-8f39-23568a253b94-kube-api-access-65zcs\") pod \"volume-data-source-validator-5b8776669-78cr7\" (UID: \"dbf9d58e-afc2-4130-8f39-23568a253b94\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7"
Aug 01 00:29:38.796318 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.796291    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ade4353-b324-47a7-b522-4e3923b3fee4-serving-cert\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.796357 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.796335    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:38.796357 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:38.796342    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 01 00:29:38.796423 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.796393    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.796423 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:38.796419    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert podName:6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:39.296398938 +0000 UTC m=+47.993567996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-zcg7s" (UID: "6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1") : secret "networking-console-plugin-cert" not found
Aug 01 00:29:38.796519 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.796459    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ade4353-b324-47a7-b522-4e3923b3fee4-trusted-ca\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.796519 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:38.796465    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 01 00:29:38.796592 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:38.796540    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:39.296526456 +0000 UTC m=+47.993695496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : secret "router-metrics-certs-default" not found
Aug 01 00:29:38.796759 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.796740    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts7jc\" (UniqueName: \"kubernetes.io/projected/3ade4353-b324-47a7-b522-4e3923b3fee4-kube-api-access-ts7jc\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.797605 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.797580    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:38.798551 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.798529    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-default-certificate\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.799318 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.799297    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-stats-auth\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.806806 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.806575    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvncp\" (UniqueName: \"kubernetes.io/projected/21764f3a-5c04-4e8b-bfa9-d29e519ea939-kube-api-access-cvncp\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:38.807966 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.807942    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65zcs\" (UniqueName: \"kubernetes.io/projected/dbf9d58e-afc2-4130-8f39-23568a253b94-kube-api-access-65zcs\") pod \"volume-data-source-validator-5b8776669-78cr7\" (UID: \"dbf9d58e-afc2-4130-8f39-23568a253b94\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7"
Aug 01 00:29:38.829957 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.829923    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7"
Aug 01 00:29:38.898310 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.898190    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ade4353-b324-47a7-b522-4e3923b3fee4-trusted-ca\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.898310 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.898233    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts7jc\" (UniqueName: \"kubernetes.io/projected/3ade4353-b324-47a7-b522-4e3923b3fee4-kube-api-access-ts7jc\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.898310 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.898303    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ade4353-b324-47a7-b522-4e3923b3fee4-config\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.898604 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.898418    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ade4353-b324-47a7-b522-4e3923b3fee4-serving-cert\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.899527 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.899469    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ade4353-b324-47a7-b522-4e3923b3fee4-trusted-ca\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.899696 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.899568    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ade4353-b324-47a7-b522-4e3923b3fee4-config\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.901424 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.901404    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ade4353-b324-47a7-b522-4e3923b3fee4-serving-cert\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.910297 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.910257    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts7jc\" (UniqueName: \"kubernetes.io/projected/3ade4353-b324-47a7-b522-4e3923b3fee4-kube-api-access-ts7jc\") pod \"console-operator-5ccd6b445f-855l6\" (UID: \"3ade4353-b324-47a7-b522-4e3923b3fee4\") " pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.914123 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.913943    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv"]
Aug 01 00:29:38.921675 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:29:38.921636    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a200e2c_a560_4cef_ae8e_8b74af405811.slice/crio-4499a9ad4dcdc32da5fc79b4b4e9ef8f4fe1b4f99ebc5952344d277468d16864 WatchSource:0}: Error finding container 4499a9ad4dcdc32da5fc79b4b4e9ef8f4fe1b4f99ebc5952344d277468d16864: Status 404 returned error can't find the container with id 4499a9ad4dcdc32da5fc79b4b4e9ef8f4fe1b4f99ebc5952344d277468d16864
Aug 01 00:29:38.941451 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.941417    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:38.951506 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:38.951405    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2"]
Aug 01 00:29:38.955295 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:29:38.955264    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ceeaa9_1cfa_467d_adde_1769ebae2d7e.slice/crio-a2b0d127d883c618e4c8793846ee7eab9efa5e9154f7d60c5c976ef6fd2c8514 WatchSource:0}: Error finding container a2b0d127d883c618e4c8793846ee7eab9efa5e9154f7d60c5c976ef6fd2c8514: Status 404 returned error can't find the container with id a2b0d127d883c618e4c8793846ee7eab9efa5e9154f7d60c5c976ef6fd2c8514
Aug 01 00:29:39.006754 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.006716    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7"]
Aug 01 00:29:39.103141 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.103108    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-855l6"]
Aug 01 00:29:39.106453 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:29:39.106419    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ade4353_b324_47a7_b522_4e3923b3fee4.slice/crio-d16e3726e1baa13e7205c7d9b38f8138d11e31c142aaa290551a20d5833f2ff2 WatchSource:0}: Error finding container d16e3726e1baa13e7205c7d9b38f8138d11e31c142aaa290551a20d5833f2ff2: Status 404 returned error can't find the container with id d16e3726e1baa13e7205c7d9b38f8138d11e31c142aaa290551a20d5833f2ff2
Aug 01 00:29:39.172051 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.172013    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7" event={"ID":"dbf9d58e-afc2-4130-8f39-23568a253b94","Type":"ContainerStarted","Data":"a98d69e5416a97d42722a9e1c07a7c82b8f8b582ed17f2dceb327ad71a5c65cd"}
Aug 01 00:29:39.173125 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.173096    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2" event={"ID":"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e","Type":"ContainerStarted","Data":"a2b0d127d883c618e4c8793846ee7eab9efa5e9154f7d60c5c976ef6fd2c8514"}
Aug 01 00:29:39.174117 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.174085    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6" event={"ID":"3ade4353-b324-47a7-b522-4e3923b3fee4","Type":"ContainerStarted","Data":"d16e3726e1baa13e7205c7d9b38f8138d11e31c142aaa290551a20d5833f2ff2"}
Aug 01 00:29:39.175916 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.175878    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv" event={"ID":"3a200e2c-a560-4cef-ae8e-8b74af405811","Type":"ContainerStarted","Data":"4499a9ad4dcdc32da5fc79b4b4e9ef8f4fe1b4f99ebc5952344d277468d16864"}
Aug 01 00:29:39.201098 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.201053    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:39.201276 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:39.201220    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 01 00:29:39.201276 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:39.201241    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdcdd856c-v5z98: secret "image-registry-tls" not found
Aug 01 00:29:39.201345 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:39.201299    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls podName:8b7767cd-27cb-49f8-99e3-de1bb779c004 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:40.201282537 +0000 UTC m=+48.898451576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls") pod "image-registry-7fdcdd856c-v5z98" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004") : secret "image-registry-tls" not found
Aug 01 00:29:39.301905 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.301802    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:39.302101 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:39.301910    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 01 00:29:39.302101 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.301961    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:39.302101 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:39.301968    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:40.301954352 +0000 UTC m=+48.999123393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : secret "router-metrics-certs-default" not found
Aug 01 00:29:39.302101 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:39.302003    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:39.302258 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:39.302122    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 01 00:29:39.302258 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:39.302124    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:40.302108716 +0000 UTC m=+48.999277778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : configmap references non-existent config key: service-ca.crt
Aug 01 00:29:39.302258 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:39.302164    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert podName:6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:40.302156992 +0000 UTC m=+48.999326032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-zcg7s" (UID: "6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1") : secret "networking-console-plugin-cert" not found
Aug 01 00:29:40.211835 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:40.211792    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:40.212306 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:40.211974    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 01 00:29:40.212306 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:40.212003    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdcdd856c-v5z98: secret "image-registry-tls" not found
Aug 01 00:29:40.212306 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:40.212069    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls podName:8b7767cd-27cb-49f8-99e3-de1bb779c004 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:42.212047788 +0000 UTC m=+50.909216849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls") pod "image-registry-7fdcdd856c-v5z98" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004") : secret "image-registry-tls" not found
Aug 01 00:29:40.313082 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:40.313038    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:40.313268 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:40.313105    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:40.313268 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:40.313244    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:42.31321867 +0000 UTC m=+51.010387717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : configmap references non-existent config key: service-ca.crt
Aug 01 00:29:40.313397 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:40.313316    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 01 00:29:40.313397 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:40.313371    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert podName:6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:42.313354093 +0000 UTC m=+51.010523135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-zcg7s" (UID: "6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1") : secret "networking-console-plugin-cert" not found
Aug 01 00:29:40.313397 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:40.313312    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:40.313397 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:40.313389    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 01 00:29:40.313629 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:40.313428    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:42.313416233 +0000 UTC m=+51.010585287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : secret "router-metrics-certs-default" not found
Aug 01 00:29:42.229919 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:42.229876    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:42.230403 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.230056    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 01 00:29:42.230403 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.230072    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdcdd856c-v5z98: secret "image-registry-tls" not found
Aug 01 00:29:42.230403 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.230139    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls podName:8b7767cd-27cb-49f8-99e3-de1bb779c004 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:46.230118237 +0000 UTC m=+54.927287287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls") pod "image-registry-7fdcdd856c-v5z98" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004") : secret "image-registry-tls" not found
Aug 01 00:29:42.331047 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:42.331008    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:42.331047 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:42.331059    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:42.331332 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:42.331087    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:42.331332 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.331194    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 01 00:29:42.331332 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.331219    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:46.331198188 +0000 UTC m=+55.028367233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : configmap references non-existent config key: service-ca.crt
Aug 01 00:29:42.331332 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.331264    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:46.331250221 +0000 UTC m=+55.028419261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : secret "router-metrics-certs-default" not found
Aug 01 00:29:42.331332 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.331280    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 01 00:29:42.331332 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.331328    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert podName:6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:46.33131738 +0000 UTC m=+55.028486421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-zcg7s" (UID: "6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1") : secret "networking-console-plugin-cert" not found
Aug 01 00:29:42.532892 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:42.532802    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:42.533071 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.532987    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 01 00:29:42.533129 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:42.533078    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls podName:53e0c425-c34c-4375-a04e-3b4531220873 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:58.533055226 +0000 UTC m=+67.230224269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls") pod "dns-default-d2kr9" (UID: "53e0c425-c34c-4375-a04e-3b4531220873") : secret "dns-default-metrics-tls" not found
Aug 01 00:29:44.191707 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.191677    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/0.log"
Aug 01 00:29:44.192180 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.191719    2547 generic.go:356] "Generic (PLEG): container finished" podID="3ade4353-b324-47a7-b522-4e3923b3fee4" containerID="3b7b111fbe40ecd03c06de71de6ceb73fbbb07eaf5cdac4067b371481062f121" exitCode=255
Aug 01 00:29:44.192180 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.191760    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6" event={"ID":"3ade4353-b324-47a7-b522-4e3923b3fee4","Type":"ContainerDied","Data":"3b7b111fbe40ecd03c06de71de6ceb73fbbb07eaf5cdac4067b371481062f121"}
Aug 01 00:29:44.192180 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.192116    2547 scope.go:117] "RemoveContainer" containerID="3b7b111fbe40ecd03c06de71de6ceb73fbbb07eaf5cdac4067b371481062f121"
Aug 01 00:29:44.193666 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.193616    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv" event={"ID":"3a200e2c-a560-4cef-ae8e-8b74af405811","Type":"ContainerStarted","Data":"4ec54df500a0cbae61cc742996d28d4b27e42af3197bb22b7528afbd8b2a014d"}
Aug 01 00:29:44.195311 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.195278    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7" event={"ID":"dbf9d58e-afc2-4130-8f39-23568a253b94","Type":"ContainerStarted","Data":"3a9f18deaa1b7b4dd2e66f31b096ce68e946baa409f9cd97cb9e1c8100ed0a41"}
Aug 01 00:29:44.196759 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.196738    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2" event={"ID":"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e","Type":"ContainerStarted","Data":"88707f19b99040f226d0a480d2f906f1b2e88162a1c1fc6f69a1746505882654"}
Aug 01 00:29:44.223523 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.223290    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-78cr7" podStartSLOduration=1.32660713 podStartE2EDuration="6.223271823s" totalImagesPullingTime="4.896664693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:44.222829315 +0000 UTC m=+52.919998377" watchObservedRunningTime="2026-08-01 00:29:44.223271823 +0000 UTC m=+52.920440885"
Aug 01 00:29:44.253627 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.253532    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-bghcv" podStartSLOduration=1.254260726 podStartE2EDuration="6.253511482s" totalImagesPullingTime="4.999250756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:44.237895312 +0000 UTC m=+52.935064375" watchObservedRunningTime="2026-08-01 00:29:44.253511482 +0000 UTC m=+52.950680542"
Aug 01 00:29:44.254374 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:44.254335    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2" podStartSLOduration=1.298308633 podStartE2EDuration="6.254323584s" totalImagesPullingTime="4.956014951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:44.253404081 +0000 UTC m=+52.950573133" watchObservedRunningTime="2026-08-01 00:29:44.254323584 +0000 UTC m=+52.951492729"
Aug 01 00:29:45.202153 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.202122    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:29:45.202659 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.202568    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/0.log"
Aug 01 00:29:45.202659 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.202603    2547 generic.go:356] "Generic (PLEG): container finished" podID="3ade4353-b324-47a7-b522-4e3923b3fee4" containerID="e516835c501c7eb22803a07c49d68611e99f5d246a96842c574f7dab5d0fdddd" exitCode=255
Aug 01 00:29:45.202659 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.202640    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6" event={"ID":"3ade4353-b324-47a7-b522-4e3923b3fee4","Type":"ContainerDied","Data":"e516835c501c7eb22803a07c49d68611e99f5d246a96842c574f7dab5d0fdddd"}
Aug 01 00:29:45.202829 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.202720    2547 scope.go:117] "RemoveContainer" containerID="3b7b111fbe40ecd03c06de71de6ceb73fbbb07eaf5cdac4067b371481062f121"
Aug 01 00:29:45.202980 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.202962    2547 scope.go:117] "RemoveContainer" containerID="e516835c501c7eb22803a07c49d68611e99f5d246a96842c574f7dab5d0fdddd"
Aug 01 00:29:45.203209 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:45.203187    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-855l6_openshift-console-operator(3ade4353-b324-47a7-b522-4e3923b3fee4)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6" podUID="3ade4353-b324-47a7-b522-4e3923b3fee4"
Aug 01 00:29:45.887876 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.887839    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f2g5z"]
Aug 01 00:29:45.912442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.912403    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f2g5z"]
Aug 01 00:29:45.912621 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.912561    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:45.914772 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.914742    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 01 00:29:45.914965 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.914775    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 01 00:29:45.914965 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.914806    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9ldw2\""
Aug 01 00:29:45.914965 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.914919    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 01 00:29:45.915413 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.915394    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 01 00:29:45.965843 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.965796    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b94ea98c-7710-4a28-afd6-a8782c08abd4-data-volume\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:45.966054 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.965935    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b94ea98c-7710-4a28-afd6-a8782c08abd4-crio-socket\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:45.966054 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.966013    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnftw\" (UniqueName: \"kubernetes.io/projected/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-api-access-lnftw\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:45.966177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.966097    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:45.966177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:45.966133    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.067019 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.066977    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnftw\" (UniqueName: \"kubernetes.io/projected/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-api-access-lnftw\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.067194 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.067046    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.067194 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.067133    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:46.067194 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.067152    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.067194 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.067188    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:46.567173759 +0000 UTC m=+55.264342799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:46.067413 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.067217    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b94ea98c-7710-4a28-afd6-a8782c08abd4-data-volume\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.067413 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.067223    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 01 00:29:46.067413 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.067282    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:46.567269329 +0000 UTC m=+55.264438369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : configmap "kube-rbac-proxy" not found
Aug 01 00:29:46.067413 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.067355    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b94ea98c-7710-4a28-afd6-a8782c08abd4-crio-socket\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.067592 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.067564    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b94ea98c-7710-4a28-afd6-a8782c08abd4-crio-socket\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.067646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.067627    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b94ea98c-7710-4a28-afd6-a8782c08abd4-data-volume\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.077133 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.077110    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnftw\" (UniqueName: \"kubernetes.io/projected/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-api-access-lnftw\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.207181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.207094    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:29:46.207669 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.207550    2547 scope.go:117] "RemoveContainer" containerID="e516835c501c7eb22803a07c49d68611e99f5d246a96842c574f7dab5d0fdddd"
Aug 01 00:29:46.207776 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.207753    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-855l6_openshift-console-operator(3ade4353-b324-47a7-b522-4e3923b3fee4)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6" podUID="3ade4353-b324-47a7-b522-4e3923b3fee4"
Aug 01 00:29:46.269832 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.269783    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:46.270031 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.269891    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 01 00:29:46.270031 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.269904    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdcdd856c-v5z98: secret "image-registry-tls" not found
Aug 01 00:29:46.270031 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.269951    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls podName:8b7767cd-27cb-49f8-99e3-de1bb779c004 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:54.269937123 +0000 UTC m=+62.967106162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls") pod "image-registry-7fdcdd856c-v5z98" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004") : secret "image-registry-tls" not found
Aug 01 00:29:46.370876 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.370836    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:46.371029 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.370894    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:46.371029 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.370919    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:46.371029 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.370997    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 01 00:29:46.371029 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.371019    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 01 00:29:46.371229 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.371072    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:54.371056753 +0000 UTC m=+63.068225809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : configmap references non-existent config key: service-ca.crt
Aug 01 00:29:46.371229 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.371091    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert podName:6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:54.371084719 +0000 UTC m=+63.068253759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-zcg7s" (UID: "6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1") : secret "networking-console-plugin-cert" not found
Aug 01 00:29:46.371229 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.371101    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:54.371096152 +0000 UTC m=+63.068265191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : secret "router-metrics-certs-default" not found
Aug 01 00:29:46.572547 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.572472    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.572547 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:46.572558    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:46.572797 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.572627    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:46.572797 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.572678    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 01 00:29:46.572797 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.572693    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:47.572677198 +0000 UTC m=+56.269846237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:46.572797 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:46.572724    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:47.572710554 +0000 UTC m=+56.269879595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : configmap "kube-rbac-proxy" not found
Aug 01 00:29:47.582450 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:47.582397    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:47.582450 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:47.582446    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:47.582947 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:47.582536    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 01 00:29:47.582947 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:47.582581    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:47.582947 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:47.582588    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:49.582574648 +0000 UTC m=+58.279743689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : configmap "kube-rbac-proxy" not found
Aug 01 00:29:47.582947 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:47.582642    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:49.582629587 +0000 UTC m=+58.279798628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:48.629987 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:48.629958    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4sf5_9090f9e3-ffe1-4eb1-abaa-6625aba20605/dns-node-resolver/0.log"
Aug 01 00:29:48.942674 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:48.942576    2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:48.942674 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:48.942650    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:29:48.942998 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:48.942985    2547 scope.go:117] "RemoveContainer" containerID="e516835c501c7eb22803a07c49d68611e99f5d246a96842c574f7dab5d0fdddd"
Aug 01 00:29:48.943154 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:48.943135    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-855l6_openshift-console-operator(3ade4353-b324-47a7-b522-4e3923b3fee4)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6" podUID="3ade4353-b324-47a7-b522-4e3923b3fee4"
Aug 01 00:29:49.600755 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:49.600699    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:49.600755 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:49.600754    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:49.601042 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:49.600860    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:49.601042 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:49.600910    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 01 00:29:49.601042 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:49.600929    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:53.600910906 +0000 UTC m=+62.298079946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:49.601042 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:49.600970    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:29:53.600954017 +0000 UTC m=+62.298123062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : configmap "kube-rbac-proxy" not found
Aug 01 00:29:49.633744 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:49.633719    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hrxfd_5fa6833a-4696-48a2-8102-849e675d1988/node-ca/0.log"
Aug 01 00:29:50.630278 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:50.630246    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-twdgh_6e27711d-9e58-4e1b-90c4-b39f5c43bf1d/serve-healthcheck-canary/0.log"
Aug 01 00:29:51.230461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:51.230429    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-54sb2_a2ceeaa9-1cfa-467d-adde-1769ebae2d7e/kube-storage-version-migrator-operator/0.log"
Aug 01 00:29:52.117850 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:52.117816    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67gnf"
Aug 01 00:29:53.639244 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:53.639195    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:53.639244 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:53.639243    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:29:53.639778 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:53.639368    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 01 00:29:53.639778 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:53.639375    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:53.639778 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:53.639425    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:01.639410954 +0000 UTC m=+70.336579994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : configmap "kube-rbac-proxy" not found
Aug 01 00:29:53.639778 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:53.639460    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:01.639441846 +0000 UTC m=+70.336610900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : secret "insights-runtime-extractor-tls" not found
Aug 01 00:29:54.345287 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:54.345232    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:29:54.345522 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:54.345391    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 01 00:29:54.345522 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:54.345411    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdcdd856c-v5z98: secret "image-registry-tls" not found
Aug 01 00:29:54.345522 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:54.345465    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls podName:8b7767cd-27cb-49f8-99e3-de1bb779c004 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:10.345450018 +0000 UTC m=+79.042619062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls") pod "image-registry-7fdcdd856c-v5z98" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004") : secret "image-registry-tls" not found
Aug 01 00:29:54.446305 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:54.446253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:54.446466 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:54.446329    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:29:54.446466 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:54.446352    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:29:54.446466 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:54.446422    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 01 00:29:54.446634 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:54.446436    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 01 00:29:54.446634 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:54.446531    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:10.44647558 +0000 UTC m=+79.143644620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : configmap references non-existent config key: service-ca.crt
Aug 01 00:29:54.446634 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:54.446552    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs podName:21764f3a-5c04-4e8b-bfa9-d29e519ea939 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:10.44654547 +0000 UTC m=+79.143714510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs") pod "router-default-7df4f94764-jnbqw" (UID: "21764f3a-5c04-4e8b-bfa9-d29e519ea939") : secret "router-metrics-certs-default" not found
Aug 01 00:29:54.446634 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:54.446563    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert podName:6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:10.446557584 +0000 UTC m=+79.143726624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-zcg7s" (UID: "6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1") : secret "networking-console-plugin-cert" not found
Aug 01 00:29:57.674630 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.674584    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:29:57.675086 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.674647    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:57.675086 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.674739    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:57.676859 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.676837    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 01 00:29:57.676965 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.676895    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 01 00:29:57.677350 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.677330    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t878\" (UniqueName: \"kubernetes.io/projected/27a5921f-23e9-4988-bf77-d7d831e70942-kube-api-access-6t878\") pod \"network-check-target-wzd2h\" (UID: \"27a5921f-23e9-4988-bf77-d7d831e70942\") " pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:57.684826 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:57.684799    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 01 00:29:57.684937 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:29:57.684870    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs podName:e739675e-0789-44a5-bae6-b67926f611ef nodeName:}" failed. No retries permitted until 2026-08-01 00:31:01.684850697 +0000 UTC m=+130.382019740 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs") pod "network-metrics-daemon-677wl" (UID: "e739675e-0789-44a5-bae6-b67926f611ef") : secret "metrics-daemon-secret" not found
Aug 01 00:29:57.687216 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.687191    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c5e0f2-39ae-4f8d-a811-ffcd53e43241-original-pull-secret\") pod \"global-pull-secret-syncer-k64vg\" (UID: \"33c5e0f2-39ae-4f8d-a811-ffcd53e43241\") " pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:57.786258 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.786220    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bnzmh\""
Aug 01 00:29:57.789250 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.789229    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k64vg"
Aug 01 00:29:57.795048 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.795025    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:57.928615 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.928534    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k64vg"]
Aug 01 00:29:57.931760 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:29:57.931733    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c5e0f2_39ae_4f8d_a811_ffcd53e43241.slice/crio-76d80baf91dbe452096e95ad80c9f192d0e05060abca30729975d8e787d75fc2 WatchSource:0}: Error finding container 76d80baf91dbe452096e95ad80c9f192d0e05060abca30729975d8e787d75fc2: Status 404 returned error can't find the container with id 76d80baf91dbe452096e95ad80c9f192d0e05060abca30729975d8e787d75fc2
Aug 01 00:29:57.946565 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:57.946528    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wzd2h"]
Aug 01 00:29:58.238231 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.238196    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k64vg" event={"ID":"33c5e0f2-39ae-4f8d-a811-ffcd53e43241","Type":"ContainerStarted","Data":"76d80baf91dbe452096e95ad80c9f192d0e05060abca30729975d8e787d75fc2"}
Aug 01 00:29:58.239638 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.239613    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wzd2h" event={"ID":"27a5921f-23e9-4988-bf77-d7d831e70942","Type":"ContainerStarted","Data":"2199d710af28eff7505f72184c6d1e8131cdd797db17c3ee3de68e9974688201"}
Aug 01 00:29:58.239776 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.239653    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wzd2h" event={"ID":"27a5921f-23e9-4988-bf77-d7d831e70942","Type":"ContainerStarted","Data":"4865e3e71991c74607f0a9b69b110d4cae6dd48daa2d8d2342e6b4206c836354"}
Aug 01 00:29:58.239776 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.239754    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:29:58.253914 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.253863    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wzd2h" podStartSLOduration=67.253845251 podStartE2EDuration="1m7.253845251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:28:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:29:58.25365151 +0000 UTC m=+66.950820573" watchObservedRunningTime="2026-08-01 00:29:58.253845251 +0000 UTC m=+66.951014312"
Aug 01 00:29:58.583069 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.582984    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:58.585709 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.585682    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e0c425-c34c-4375-a04e-3b4531220873-metrics-tls\") pod \"dns-default-d2kr9\" (UID: \"53e0c425-c34c-4375-a04e-3b4531220873\") " pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:58.769579 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.769546    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fl89b\""
Aug 01 00:29:58.777368 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.777334    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:29:58.926850 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:58.926820    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d2kr9"]
Aug 01 00:29:58.929317 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:29:58.929283    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e0c425_c34c_4375_a04e_3b4531220873.slice/crio-7a7cd7e3375d0f2b12a3ca704a66107c0876f578f8a38c9d39a68198100810b5 WatchSource:0}: Error finding container 7a7cd7e3375d0f2b12a3ca704a66107c0876f578f8a38c9d39a68198100810b5: Status 404 returned error can't find the container with id 7a7cd7e3375d0f2b12a3ca704a66107c0876f578f8a38c9d39a68198100810b5
Aug 01 00:29:59.244544 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:59.244501    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d2kr9" event={"ID":"53e0c425-c34c-4375-a04e-3b4531220873","Type":"ContainerStarted","Data":"7a7cd7e3375d0f2b12a3ca704a66107c0876f578f8a38c9d39a68198100810b5"}
Aug 01 00:29:59.874366 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:29:59.874333    2547 scope.go:117] "RemoveContainer" containerID="e516835c501c7eb22803a07c49d68611e99f5d246a96842c574f7dab5d0fdddd"
Aug 01 00:30:00.251325 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:00.251295    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:30:00.251558 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:00.251389    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6" event={"ID":"3ade4353-b324-47a7-b522-4e3923b3fee4","Type":"ContainerStarted","Data":"12dc0fac7c9b807e3debd7d850d622d771bcad4725cd385cf15d0948bdb0c853"}
Aug 01 00:30:00.251896 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:00.251873    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:30:00.267974 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:00.267907    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6" podStartSLOduration=17.463262276 podStartE2EDuration="22.267884701s" totalImagesPullingTime="4.804622425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:00.266813931 +0000 UTC m=+68.963982994" watchObservedRunningTime="2026-08-01 00:30:00.267884701 +0000 UTC m=+68.965053765"
Aug 01 00:30:00.667068 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:00.666988    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-855l6"
Aug 01 00:30:01.713970 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:01.713913    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:30:01.713970 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:01.713977    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:30:01.714455 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:30:01.714085    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 01 00:30:01.714455 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:30:01.714163    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls podName:b94ea98c-7710-4a28-afd6-a8782c08abd4 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:17.714141262 +0000 UTC m=+86.411310308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f2g5z" (UID: "b94ea98c-7710-4a28-afd6-a8782c08abd4") : secret "insights-runtime-extractor-tls" not found
Aug 01 00:30:01.714580 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:01.714564    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b94ea98c-7710-4a28-afd6-a8782c08abd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:30:03.272306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:03.272268    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k64vg" event={"ID":"33c5e0f2-39ae-4f8d-a811-ffcd53e43241","Type":"ContainerStarted","Data":"20e1403fa1891c5b076abd9fe69b22535a1d886e90a45afdca073741526c531b"}
Aug 01 00:30:03.274122 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:03.274101    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d2kr9" event={"ID":"53e0c425-c34c-4375-a04e-3b4531220873","Type":"ContainerStarted","Data":"df96a32cd3f6c7cf37664b9ea5b01d21d4ff6ce99dd19e2b7af1e56ec8e3db41"}
Aug 01 00:30:03.274188 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:03.274144    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d2kr9" event={"ID":"53e0c425-c34c-4375-a04e-3b4531220873","Type":"ContainerStarted","Data":"c520b4f8820e19efb36663da6926f926ee07cd6a8363cb4fc6b0af8b4746bbcc"}
Aug 01 00:30:03.274188 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:03.274165    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:30:03.285811 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:03.285753    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k64vg" podStartSLOduration=66.991782714 podStartE2EDuration="1m11.285735343s" totalImagesPullingTime="4.293952629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:03.284836932 +0000 UTC m=+71.982005993" watchObservedRunningTime="2026-08-01 00:30:03.285735343 +0000 UTC m=+71.982904441"
Aug 01 00:30:03.299893 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:03.299840    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d2kr9" podStartSLOduration=34.015372863 podStartE2EDuration="37.299821073s" totalImagesPullingTime="3.28444821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:03.298872604 +0000 UTC m=+71.996041667" watchObservedRunningTime="2026-08-01 00:30:03.299821073 +0000 UTC m=+71.996990134"
Aug 01 00:30:08.591837 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.591795    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fdcdd856c-v5z98"]
Aug 01 00:30:08.592352 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:30:08.592038    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98" podUID="8b7767cd-27cb-49f8-99e3-de1bb779c004"
Aug 01 00:30:08.663676 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.663638    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-qd5rp"]
Aug 01 00:30:08.666169 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.666149    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f75947677-76hxl"]
Aug 01 00:30:08.666284 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.666267    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-qd5rp"
Aug 01 00:30:08.668414 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.668392    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.669183 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.669158    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 01 00:30:08.669306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.669281    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 01 00:30:08.669407 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.669389    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bw4pr\""
Aug 01 00:30:08.678163 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.678134    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-qd5rp"]
Aug 01 00:30:08.680750 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.680722    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f75947677-76hxl"]
Aug 01 00:30:08.771507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771447    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-bound-sa-token\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.771507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771507    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af85d939-36a9-40c3-be87-c4359ad5c3c0-image-registry-private-configuration\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.771719 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771575    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af85d939-36a9-40c3-be87-c4359ad5c3c0-installation-pull-secrets\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.771719 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771607    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af85d939-36a9-40c3-be87-c4359ad5c3c0-ca-trust-extracted\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.771719 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771627    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af85d939-36a9-40c3-be87-c4359ad5c3c0-trusted-ca\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.771719 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771644    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l4sr\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-kube-api-access-2l4sr\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.771719 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771665    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af85d939-36a9-40c3-be87-c4359ad5c3c0-registry-certificates\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.771873 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771715    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzr6\" (UniqueName: \"kubernetes.io/projected/cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe-kube-api-access-5tzr6\") pod \"downloads-77c974ffcf-qd5rp\" (UID: \"cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe\") " pod="openshift-console/downloads-77c974ffcf-qd5rp"
Aug 01 00:30:08.771873 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.771817    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-registry-tls\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873070 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.872961    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-bound-sa-token\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873070 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873018    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af85d939-36a9-40c3-be87-c4359ad5c3c0-image-registry-private-configuration\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873070 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873049    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af85d939-36a9-40c3-be87-c4359ad5c3c0-installation-pull-secrets\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873076    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af85d939-36a9-40c3-be87-c4359ad5c3c0-ca-trust-extracted\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873098    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af85d939-36a9-40c3-be87-c4359ad5c3c0-trusted-ca\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873323    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l4sr\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-kube-api-access-2l4sr\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873550 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873361    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af85d939-36a9-40c3-be87-c4359ad5c3c0-registry-certificates\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873550 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873389    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzr6\" (UniqueName: \"kubernetes.io/projected/cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe-kube-api-access-5tzr6\") pod \"downloads-77c974ffcf-qd5rp\" (UID: \"cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe\") " pod="openshift-console/downloads-77c974ffcf-qd5rp"
Aug 01 00:30:08.873624 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873592    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af85d939-36a9-40c3-be87-c4359ad5c3c0-ca-trust-extracted\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.873676 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.873624    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-registry-tls\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.874347 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.874324    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af85d939-36a9-40c3-be87-c4359ad5c3c0-registry-certificates\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.874465 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.874423    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af85d939-36a9-40c3-be87-c4359ad5c3c0-trusted-ca\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.875745 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.875724    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af85d939-36a9-40c3-be87-c4359ad5c3c0-installation-pull-secrets\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.875840 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.875770    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af85d939-36a9-40c3-be87-c4359ad5c3c0-image-registry-private-configuration\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.876024 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.876007    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-registry-tls\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.886859 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.886822    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l4sr\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-kube-api-access-2l4sr\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.886975 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.886951    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af85d939-36a9-40c3-be87-c4359ad5c3c0-bound-sa-token\") pod \"image-registry-7f75947677-76hxl\" (UID: \"af85d939-36a9-40c3-be87-c4359ad5c3c0\") " pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:08.887496 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.887459    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzr6\" (UniqueName: \"kubernetes.io/projected/cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe-kube-api-access-5tzr6\") pod \"downloads-77c974ffcf-qd5rp\" (UID: \"cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe\") " pod="openshift-console/downloads-77c974ffcf-qd5rp"
Aug 01 00:30:08.976635 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.976594    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-qd5rp"
Aug 01 00:30:08.985694 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.985662    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4jrsr\""
Aug 01 00:30:08.994416 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:08.994383    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:09.133710 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.133632    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-qd5rp"]
Aug 01 00:30:09.136973 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:09.136940    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdcb61b8_e5d8_4b99_bb9a_4cb4454cf7fe.slice/crio-f4a158c8249e83ea84029d8ee6606df63d20fbcc38fff7345bf0002371761bd5 WatchSource:0}: Error finding container f4a158c8249e83ea84029d8ee6606df63d20fbcc38fff7345bf0002371761bd5: Status 404 returned error can't find the container with id f4a158c8249e83ea84029d8ee6606df63d20fbcc38fff7345bf0002371761bd5
Aug 01 00:30:09.148140 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.148112    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f75947677-76hxl"]
Aug 01 00:30:09.151266 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:09.151236    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf85d939_36a9_40c3_be87_c4359ad5c3c0.slice/crio-8cc31cc7a079b5508d2459fbcfe71aac5617d9a4c462b744de59cbffaa81b017 WatchSource:0}: Error finding container 8cc31cc7a079b5508d2459fbcfe71aac5617d9a4c462b744de59cbffaa81b017: Status 404 returned error can't find the container with id 8cc31cc7a079b5508d2459fbcfe71aac5617d9a4c462b744de59cbffaa81b017
Aug 01 00:30:09.299921 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.299880    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f75947677-76hxl" event={"ID":"af85d939-36a9-40c3-be87-c4359ad5c3c0","Type":"ContainerStarted","Data":"f7e14a04a5032b6745edc68372752d25b33b9eb7d6de9a837330d8585d8f4f51"}
Aug 01 00:30:09.300119 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.299952    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:09.300119 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.299977    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f75947677-76hxl" event={"ID":"af85d939-36a9-40c3-be87-c4359ad5c3c0","Type":"ContainerStarted","Data":"8cc31cc7a079b5508d2459fbcfe71aac5617d9a4c462b744de59cbffaa81b017"}
Aug 01 00:30:09.300980 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.300953    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-qd5rp" event={"ID":"cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe","Type":"ContainerStarted","Data":"f4a158c8249e83ea84029d8ee6606df63d20fbcc38fff7345bf0002371761bd5"}
Aug 01 00:30:09.301088 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.300997    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:30:09.306961 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.306937    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:30:09.318970 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.318917    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f75947677-76hxl" podStartSLOduration=1.318894766 podStartE2EDuration="1.318894766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:09.317789965 +0000 UTC m=+78.014959028" watchObservedRunningTime="2026-08-01 00:30:09.318894766 +0000 UTC m=+78.016063827"
Aug 01 00:30:09.380912 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.380876    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b7767cd-27cb-49f8-99e3-de1bb779c004-ca-trust-extracted\") pod \"8b7767cd-27cb-49f8-99e3-de1bb779c004\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") "
Aug 01 00:30:09.381099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.380932    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-image-registry-private-configuration\") pod \"8b7767cd-27cb-49f8-99e3-de1bb779c004\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") "
Aug 01 00:30:09.381099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.380969    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-installation-pull-secrets\") pod \"8b7767cd-27cb-49f8-99e3-de1bb779c004\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") "
Aug 01 00:30:09.381099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.381001    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gwfv\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-kube-api-access-2gwfv\") pod \"8b7767cd-27cb-49f8-99e3-de1bb779c004\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") "
Aug 01 00:30:09.381099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.381027    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-bound-sa-token\") pod \"8b7767cd-27cb-49f8-99e3-de1bb779c004\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") "
Aug 01 00:30:09.381099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.381067    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-trusted-ca\") pod \"8b7767cd-27cb-49f8-99e3-de1bb779c004\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") "
Aug 01 00:30:09.381368 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.381162    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-certificates\") pod \"8b7767cd-27cb-49f8-99e3-de1bb779c004\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") "
Aug 01 00:30:09.381368 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.381224    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b7767cd-27cb-49f8-99e3-de1bb779c004-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8b7767cd-27cb-49f8-99e3-de1bb779c004" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:30:09.381580 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.381554    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8b7767cd-27cb-49f8-99e3-de1bb779c004" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:30:09.382223 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.381789    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8b7767cd-27cb-49f8-99e3-de1bb779c004" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:30:09.382223 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.382200    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-certificates\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:09.382223 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.382227    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b7767cd-27cb-49f8-99e3-de1bb779c004-ca-trust-extracted\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:09.382521 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.382244    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b7767cd-27cb-49f8-99e3-de1bb779c004-trusted-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:09.383588 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.383558    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8b7767cd-27cb-49f8-99e3-de1bb779c004" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:30:09.383746 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.383600    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8b7767cd-27cb-49f8-99e3-de1bb779c004" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:30:09.383746 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.383660    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8b7767cd-27cb-49f8-99e3-de1bb779c004" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:30:09.383973 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.383951    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-kube-api-access-2gwfv" (OuterVolumeSpecName: "kube-api-access-2gwfv") pod "8b7767cd-27cb-49f8-99e3-de1bb779c004" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004"). InnerVolumeSpecName "kube-api-access-2gwfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:30:09.482816 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.482775    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gwfv\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-kube-api-access-2gwfv\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:09.482816 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.482810    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-bound-sa-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:09.482816 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.482820    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-image-registry-private-configuration\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:09.483050 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:09.482830    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b7767cd-27cb-49f8-99e3-de1bb779c004-installation-pull-secrets\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:10.305081 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.305045    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:30:10.333308 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.333274    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fdcdd856c-v5z98"]
Aug 01 00:30:10.338638 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.338608    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fdcdd856c-v5z98"]
Aug 01 00:30:10.391590 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.391556    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:30:10.394108 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.394066    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"image-registry-7fdcdd856c-v5z98\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") " pod="openshift-image-registry/image-registry-7fdcdd856c-v5z98"
Aug 01 00:30:10.493345 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.493307    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") pod \"8b7767cd-27cb-49f8-99e3-de1bb779c004\" (UID: \"8b7767cd-27cb-49f8-99e3-de1bb779c004\") "
Aug 01 00:30:10.493538 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.493448    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:10.493592 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.493539    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:10.493592 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.493580    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:30:10.494184 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.494155    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21764f3a-5c04-4e8b-bfa9-d29e519ea939-service-ca-bundle\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:10.495508 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.495454    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8b7767cd-27cb-49f8-99e3-de1bb779c004" (UID: "8b7767cd-27cb-49f8-99e3-de1bb779c004"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:30:10.495813 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.495793    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21764f3a-5c04-4e8b-bfa9-d29e519ea939-metrics-certs\") pod \"router-default-7df4f94764-jnbqw\" (UID: \"21764f3a-5c04-4e8b-bfa9-d29e519ea939\") " pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:10.495861 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.495851    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-zcg7s\" (UID: \"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:30:10.595007 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.594916    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b7767cd-27cb-49f8-99e3-de1bb779c004-registry-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:10.643923 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.643886    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jfwjg\""
Aug 01 00:30:10.651185 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.651159    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hz4c\""
Aug 01 00:30:10.652186 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.652168    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"
Aug 01 00:30:10.660113 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.660073    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:10.796789 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.796750    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s"]
Aug 01 00:30:10.803489 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:10.803412    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3768ff_b3a0_4c74_ad8e_5e6e86fe1ba1.slice/crio-289864fa5aed90cd55aead35d9d32e72956c5ddd3c9fec3df6f91dcb09529c79 WatchSource:0}: Error finding container 289864fa5aed90cd55aead35d9d32e72956c5ddd3c9fec3df6f91dcb09529c79: Status 404 returned error can't find the container with id 289864fa5aed90cd55aead35d9d32e72956c5ddd3c9fec3df6f91dcb09529c79
Aug 01 00:30:10.819024 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:10.818987    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7df4f94764-jnbqw"]
Aug 01 00:30:10.822811 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:10.822783    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21764f3a_5c04_4e8b_bfa9_d29e519ea939.slice/crio-e8209633018efb0422fc5277ff1477ae015ee2720a936e069a9f85eea8cc9129 WatchSource:0}: Error finding container e8209633018efb0422fc5277ff1477ae015ee2720a936e069a9f85eea8cc9129: Status 404 returned error can't find the container with id e8209633018efb0422fc5277ff1477ae015ee2720a936e069a9f85eea8cc9129
Aug 01 00:30:11.314174 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:11.314132    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s" event={"ID":"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1","Type":"ContainerStarted","Data":"289864fa5aed90cd55aead35d9d32e72956c5ddd3c9fec3df6f91dcb09529c79"}
Aug 01 00:30:11.316556 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:11.316510    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7df4f94764-jnbqw" event={"ID":"21764f3a-5c04-4e8b-bfa9-d29e519ea939","Type":"ContainerStarted","Data":"cfe399ddd3e5bdec6ed08c3ba4cb02b8963f61eea94cae3f4ce0a5b281fd5327"}
Aug 01 00:30:11.316764 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:11.316567    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7df4f94764-jnbqw" event={"ID":"21764f3a-5c04-4e8b-bfa9-d29e519ea939","Type":"ContainerStarted","Data":"e8209633018efb0422fc5277ff1477ae015ee2720a936e069a9f85eea8cc9129"}
Aug 01 00:30:11.340693 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:11.340626    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7df4f94764-jnbqw" podStartSLOduration=33.340604631 podStartE2EDuration="33.340604631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:29:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:11.339003303 +0000 UTC m=+80.036172378" watchObservedRunningTime="2026-08-01 00:30:11.340604631 +0000 UTC m=+80.037773693"
Aug 01 00:30:11.660368 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:11.660287    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:11.663600 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:11.663567    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:11.879930 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:11.879874    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b7767cd-27cb-49f8-99e3-de1bb779c004" path="/var/lib/kubelet/pods/8b7767cd-27cb-49f8-99e3-de1bb779c004/volumes"
Aug 01 00:30:12.322450 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:12.322359    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s" event={"ID":"6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1","Type":"ContainerStarted","Data":"5495b362dcabe7e393ae5992b613a01e1c78bc20fa5b2d07abfb3ef43e814516"}
Aug 01 00:30:12.322912 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:12.322590    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:12.324043 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:12.324018    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7df4f94764-jnbqw"
Aug 01 00:30:12.337567 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:12.337507    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-zcg7s" podStartSLOduration=33.098921711 podStartE2EDuration="34.337474232s" totalImagesPullingTime="1.238552521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:12.336147054 +0000 UTC m=+81.033316118" watchObservedRunningTime="2026-08-01 00:30:12.337474232 +0000 UTC m=+81.034643294"
Aug 01 00:30:13.283067 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:13.283031    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d2kr9"
Aug 01 00:30:14.801227 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:14.801192    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"]
Aug 01 00:30:14.827322 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:14.827270    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"]
Aug 01 00:30:14.827322 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:14.827314    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"
Aug 01 00:30:14.829548 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:14.829511    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 01 00:30:14.829684 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:14.829611    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dk48l\""
Aug 01 00:30:14.934848 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:14.934804    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/07736491-4551-4022-90f2-d0de1025a057-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-k4tpk\" (UID: \"07736491-4551-4022-90f2-d0de1025a057\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"
Aug 01 00:30:15.036253 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.036195    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/07736491-4551-4022-90f2-d0de1025a057-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-k4tpk\" (UID: \"07736491-4551-4022-90f2-d0de1025a057\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"
Aug 01 00:30:15.039518 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.039472    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/07736491-4551-4022-90f2-d0de1025a057-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-k4tpk\" (UID: \"07736491-4551-4022-90f2-d0de1025a057\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"
Aug 01 00:30:15.138873 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.138785    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"
Aug 01 00:30:15.307038 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.306999    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"]
Aug 01 00:30:15.311114 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:15.311083    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07736491_4551_4022_90f2_d0de1025a057.slice/crio-2ae58560e70634f2364a4306115092eb01c4555d24e40c523202840eada5b979 WatchSource:0}: Error finding container 2ae58560e70634f2364a4306115092eb01c4555d24e40c523202840eada5b979: Status 404 returned error can't find the container with id 2ae58560e70634f2364a4306115092eb01c4555d24e40c523202840eada5b979
Aug 01 00:30:15.334908 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.334874    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk" event={"ID":"07736491-4551-4022-90f2-d0de1025a057","Type":"ContainerStarted","Data":"2ae58560e70634f2364a4306115092eb01c4555d24e40c523202840eada5b979"}
Aug 01 00:30:15.561432 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.561394    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5565d8899f-6crxt"]
Aug 01 00:30:15.564945 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.564914    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.567229 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.567204    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 01 00:30:15.567387 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.567324    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 01 00:30:15.567972 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.567947    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 01 00:30:15.568213 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.568181    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 01 00:30:15.568302 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.568230    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mc5mx\""
Aug 01 00:30:15.568603 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.568587    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 01 00:30:15.572442 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.572420    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 01 00:30:15.574430 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.574410    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5565d8899f-6crxt"]
Aug 01 00:30:15.742730 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.742694    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8mfp\" (UniqueName: \"kubernetes.io/projected/a6ad3d58-e40a-4c94-b268-8124e6cddab2-kube-api-access-m8mfp\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.742946 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.742763    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-oauth-config\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.742946 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.742847    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-service-ca\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.742946 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.742898    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-config\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.743207 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.743009    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-trusted-ca-bundle\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.743207 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.743053    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-serving-cert\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.743207 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.743094    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-oauth-serving-cert\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.844271 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.844181    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-trusted-ca-bundle\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.844271 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.844247    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-serving-cert\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.844910 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.844275    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-oauth-serving-cert\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.844910 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.844302    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8mfp\" (UniqueName: \"kubernetes.io/projected/a6ad3d58-e40a-4c94-b268-8124e6cddab2-kube-api-access-m8mfp\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.844910 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.844648    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-oauth-config\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.844910 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.844703    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-service-ca\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.844910 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.844741    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-config\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.845166 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.845126    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-oauth-serving-cert\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.845251 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.845228    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-trusted-ca-bundle\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.845440 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.845414    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-config\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.845559 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.845516    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-service-ca\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.847431 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.847404    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-serving-cert\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.848100 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.848056    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-oauth-config\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.852572 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.852545    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8mfp\" (UniqueName: \"kubernetes.io/projected/a6ad3d58-e40a-4c94-b268-8124e6cddab2-kube-api-access-m8mfp\") pod \"console-5565d8899f-6crxt\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") " pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:15.877911 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:15.877876    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:16.034554 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:16.034518    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5565d8899f-6crxt"]
Aug 01 00:30:16.037633 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:16.037594    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ad3d58_e40a_4c94_b268_8124e6cddab2.slice/crio-496529b270fe592f568ac47881346481c94ae05ab93cc15aef2a23c283a2051e WatchSource:0}: Error finding container 496529b270fe592f568ac47881346481c94ae05ab93cc15aef2a23c283a2051e: Status 404 returned error can't find the container with id 496529b270fe592f568ac47881346481c94ae05ab93cc15aef2a23c283a2051e
Aug 01 00:30:16.339949 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:16.339915    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5565d8899f-6crxt" event={"ID":"a6ad3d58-e40a-4c94-b268-8124e6cddab2","Type":"ContainerStarted","Data":"496529b270fe592f568ac47881346481c94ae05ab93cc15aef2a23c283a2051e"}
Aug 01 00:30:17.346463 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.346416    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk" event={"ID":"07736491-4551-4022-90f2-d0de1025a057","Type":"ContainerStarted","Data":"da9900dfcba650379d0c0d68d5c6a54dfc65fbcbf52b39137974ca1b316feee6"}
Aug 01 00:30:17.346976 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.346808    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"
Aug 01 00:30:17.353301 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.353266    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk"
Aug 01 00:30:17.364174 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.363974    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4tpk" podStartSLOduration=2.2790336030000002 podStartE2EDuration="3.363955929s" totalImagesPullingTime="1.084922326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:17.362542917 +0000 UTC m=+86.059711980" watchObservedRunningTime="2026-08-01 00:30:17.363955929 +0000 UTC m=+86.061124990"
Aug 01 00:30:17.764213 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.764156    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:30:17.767138 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.767101    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b94ea98c-7710-4a28-afd6-a8782c08abd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f2g5z\" (UID: \"b94ea98c-7710-4a28-afd6-a8782c08abd4\") " pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:30:17.867218 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.867181    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"]
Aug 01 00:30:17.871190 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.871166    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:17.873496 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.873220    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 01 00:30:17.873496 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.873306    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8g7fk\""
Aug 01 00:30:17.874149 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.874123    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 01 00:30:17.874364 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.874345    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 01 00:30:17.874926 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.874577    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 01 00:30:17.874926 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.874763    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 01 00:30:17.882237 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.882211    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"]
Aug 01 00:30:17.966424 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.966382    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:17.966625 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.966437    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:17.966625 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.966510    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4slq\" (UniqueName: \"kubernetes.io/projected/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-kube-api-access-j4slq\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:17.966625 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:17.966551    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.024337 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.024245    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9ldw2\""
Aug 01 00:30:18.033001 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.032964    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f2g5z"
Aug 01 00:30:18.067361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.067321    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.067601 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.067379    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.067601 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.067522    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4slq\" (UniqueName: \"kubernetes.io/projected/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-kube-api-access-j4slq\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.067601 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.067585    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.067765 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:30:18.067714    2547 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 01 00:30:18.067823 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:30:18.067789    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-tls podName:830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:18.567765229 +0000 UTC m=+87.264934269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-v5lf7" (UID: "830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32") : secret "prometheus-operator-tls" not found
Aug 01 00:30:18.068199 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.068173    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.070405 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.070379    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.077955 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.077926    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4slq\" (UniqueName: \"kubernetes.io/projected/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-kube-api-access-j4slq\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.572855 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.572803    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.576244 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.576209    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-v5lf7\" (UID: \"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:18.783736 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:18.783473    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"
Aug 01 00:30:19.128022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:19.127770    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f2g5z"]
Aug 01 00:30:19.131345 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:19.131234    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94ea98c_7710_4a28_afd6_a8782c08abd4.slice/crio-970f7c17354748a751c4be441217f7233b69db40e81cffc02b733a643b213432 WatchSource:0}: Error finding container 970f7c17354748a751c4be441217f7233b69db40e81cffc02b733a643b213432: Status 404 returned error can't find the container with id 970f7c17354748a751c4be441217f7233b69db40e81cffc02b733a643b213432
Aug 01 00:30:19.146352 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:19.146322    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-v5lf7"]
Aug 01 00:30:19.150868 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:19.150745    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830d9c7f_70f3_4dfb_b3cc_c9e8105d6f32.slice/crio-18cdc2b17cb1fca2913c2653aa493a12fd524f9272c9c55cdf63445130530c2a WatchSource:0}: Error finding container 18cdc2b17cb1fca2913c2653aa493a12fd524f9272c9c55cdf63445130530c2a: Status 404 returned error can't find the container with id 18cdc2b17cb1fca2913c2653aa493a12fd524f9272c9c55cdf63445130530c2a
Aug 01 00:30:19.358178 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:19.358063    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5565d8899f-6crxt" event={"ID":"a6ad3d58-e40a-4c94-b268-8124e6cddab2","Type":"ContainerStarted","Data":"44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e"}
Aug 01 00:30:19.359977 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:19.359941    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f2g5z" event={"ID":"b94ea98c-7710-4a28-afd6-a8782c08abd4","Type":"ContainerStarted","Data":"b8ede8e182fd61a01a75eb9ea8aec17ac252dbb401ee0acb742473fac55a6baf"}
Aug 01 00:30:19.360145 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:19.360009    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f2g5z" event={"ID":"b94ea98c-7710-4a28-afd6-a8782c08abd4","Type":"ContainerStarted","Data":"970f7c17354748a751c4be441217f7233b69db40e81cffc02b733a643b213432"}
Aug 01 00:30:19.361249 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:19.361216    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7" event={"ID":"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32","Type":"ContainerStarted","Data":"18cdc2b17cb1fca2913c2653aa493a12fd524f9272c9c55cdf63445130530c2a"}
Aug 01 00:30:19.375711 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:19.375656    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5565d8899f-6crxt" podStartSLOduration=1.382517126 podStartE2EDuration="4.375633785s" totalImagesPullingTime="2.993116659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:19.374295615 +0000 UTC m=+88.071464678" watchObservedRunningTime="2026-08-01 00:30:19.375633785 +0000 UTC m=+88.072802849"
Aug 01 00:30:20.367698 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:20.367663    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f2g5z" event={"ID":"b94ea98c-7710-4a28-afd6-a8782c08abd4","Type":"ContainerStarted","Data":"4ec04d9cc4925beac7c91250bad4bf5c3e7daa51bd0a25ed6ba9c69bfc2a8eee"}
Aug 01 00:30:21.374557 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:21.374509    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7" event={"ID":"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32","Type":"ContainerStarted","Data":"e87cbb42bff57ebe8f0295ffae5d98c4d69c7cdf71df3ce1e54782ca2f519211"}
Aug 01 00:30:21.375035 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:21.374616    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7" event={"ID":"830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32","Type":"ContainerStarted","Data":"228ba876e7ae4bc74ae5c2daa4370393dc43eebeac5225a55cc7ca584017dc67"}
Aug 01 00:30:21.390767 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:21.390701    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-v5lf7" podStartSLOduration=2.7845650969999998 podStartE2EDuration="4.390655273s" totalImagesPullingTime="1.606090176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:21.389969321 +0000 UTC m=+90.087138386" watchObservedRunningTime="2026-08-01 00:30:21.390655273 +0000 UTC m=+90.087824336"
Aug 01 00:30:23.240953 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.240914    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"]
Aug 01 00:30:23.244626 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.244601    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.246681 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.246654    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 01 00:30:23.246849 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.246698    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 01 00:30:23.246905 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.246874    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5l4dr\""
Aug 01 00:30:23.255600 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.255348    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"]
Aug 01 00:30:23.261641 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.261614    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cs7pq"]
Aug 01 00:30:23.265018 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.264994    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.268036 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.267739    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 01 00:30:23.268036 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.268007    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 01 00:30:23.268320 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.268297    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x7kb2\""
Aug 01 00:30:23.268438 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.268297    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 01 00:30:23.416396 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416350    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b2a9172-9b05-4e41-b31f-28a1736f845f-metrics-client-ca\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.416396 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416406    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.416676 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416509    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.416676 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416566    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-textfile\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.416676 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416600    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5btn\" (UniqueName: \"kubernetes.io/projected/9b2a9172-9b05-4e41-b31f-28a1736f845f-kube-api-access-n5btn\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.416676 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416643    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-wtmp\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.416872 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416703    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xggxq\" (UniqueName: \"kubernetes.io/projected/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-kube-api-access-xggxq\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.416872 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416727    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.416872 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416811    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-tls\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.416872 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416855    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-root\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.417057 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416885    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-sys\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.417057 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416942    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.417057 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.416990    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.517732 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517635    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.517732 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517693    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.517732 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517724    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b2a9172-9b05-4e41-b31f-28a1736f845f-metrics-client-ca\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517752    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.518016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517779    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517803    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-textfile\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517831    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5btn\" (UniqueName: \"kubernetes.io/projected/9b2a9172-9b05-4e41-b31f-28a1736f845f-kube-api-access-n5btn\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517868    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-wtmp\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517919    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xggxq\" (UniqueName: \"kubernetes.io/projected/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-kube-api-access-xggxq\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.518016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.517944    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518016 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.518009    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-tls\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518383 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.518038    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-root\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518383 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.518068    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-sys\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518383 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.518171    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-sys\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518383 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.518305    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-wtmp\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518621 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.518507    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.518621 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.518541    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b2a9172-9b05-4e41-b31f-28a1736f845f-root\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.518751 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.518727    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-textfile\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.519033 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.519007    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b2a9172-9b05-4e41-b31f-28a1736f845f-metrics-client-ca\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.519524 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.519463    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.521143 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.521119    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.521289 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.521267    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b2a9172-9b05-4e41-b31f-28a1736f845f-node-exporter-tls\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.521368 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.521324    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.521424 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.521362    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.526282 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.526257    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5btn\" (UniqueName: \"kubernetes.io/projected/9b2a9172-9b05-4e41-b31f-28a1736f845f-kube-api-access-n5btn\") pod \"node-exporter-cs7pq\" (UID: \"9b2a9172-9b05-4e41-b31f-28a1736f845f\") " pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:23.526393 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.526339    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xggxq\" (UniqueName: \"kubernetes.io/projected/3fb050a6-76b9-4a6b-924d-b4b34ddffdee-kube-api-access-xggxq\") pod \"openshift-state-metrics-6bb4d7b4dd-bdqks\" (UID: \"3fb050a6-76b9-4a6b-924d-b4b34ddffdee\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.556192 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.556145    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"
Aug 01 00:30:23.576921 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:23.576885    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cs7pq"
Aug 01 00:30:24.339032 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.338991    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 01 00:30:24.343278 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.343248    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.345965 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.345939    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 01 00:30:24.346147 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.346010    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 01 00:30:24.346147 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.346014    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 01 00:30:24.346633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.346526    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wn8mt\""
Aug 01 00:30:24.346759 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.346643    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 01 00:30:24.346759 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.346591    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 01 00:30:24.346894 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.346526    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 01 00:30:24.346894 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.346604    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 01 00:30:24.346998 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.346607    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 01 00:30:24.347234 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.347215    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 01 00:30:24.368542 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.368507    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 01 00:30:24.427438 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427390    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427438 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427440    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427671 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427494    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427671 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427564    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-config-out\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427671 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427600    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-config-volume\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427671 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427650    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427818 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427719    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427818 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427753    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zgss\" (UniqueName: \"kubernetes.io/projected/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-kube-api-access-7zgss\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427818 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427798    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427931 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427833    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427931 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427887    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.427931 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427911    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-web-config\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.428031 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.427953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.528586 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.528541    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.528586 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.528591    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-web-config\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.528811 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.528721    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.528811 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.528789    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.528913 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.528823    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.528913 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.528867    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.529022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.528909    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-config-out\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.529022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.528940    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-config-volume\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.529022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.529001    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.529161 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:30:24.529027    2547 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Aug 01 00:30:24.529161 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.529043    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.529161 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.529070    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zgss\" (UniqueName: \"kubernetes.io/projected/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-kube-api-access-7zgss\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.529161 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:30:24.529103    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-main-tls podName:edc211e1-5bbe-4658-b671-90fe0fcc0fb6 nodeName:}" failed. No retries permitted until 2026-08-01 00:30:25.029079263 +0000 UTC m=+93.726248347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "edc211e1-5bbe-4658-b671-90fe0fcc0fb6") : secret "alertmanager-main-tls" not found
Aug 01 00:30:24.529161 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.529147    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.529388 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.529183    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.531435 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.530747    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.531435 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.530841    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.531435 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.531390    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.532038 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.531807    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.532038 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.531819    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-web-config\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.532451 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.532416    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-config-out\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.532640 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.532622    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.533290 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.533249    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.533878 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.533854    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.534068 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.534046    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.534282 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.534260    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-config-volume\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:24.540052 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:24.540023    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zgss\" (UniqueName: \"kubernetes.io/projected/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-kube-api-access-7zgss\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:25.033204 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:25.033160    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:25.036139 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:25.036108    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/edc211e1-5bbe-4658-b671-90fe0fcc0fb6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"edc211e1-5bbe-4658-b671-90fe0fcc0fb6\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:25.255735 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:25.255695    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 01 00:30:25.879495 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:25.879453    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:25.879908 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:25.879538    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:25.884093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:25.884060    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:26.407698 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:26.407656    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:30:29.081137 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.081028    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 01 00:30:29.085963 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:29.085919    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc211e1_5bbe_4658_b671_90fe0fcc0fb6.slice/crio-443e0d5d89af337203b50147f353dd332c9e369ccc095909a888ab5f45758212 WatchSource:0}: Error finding container 443e0d5d89af337203b50147f353dd332c9e369ccc095909a888ab5f45758212: Status 404 returned error can't find the container with id 443e0d5d89af337203b50147f353dd332c9e369ccc095909a888ab5f45758212
Aug 01 00:30:29.093286 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.093257    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks"]
Aug 01 00:30:29.096886 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:29.096853    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb050a6_76b9_4a6b_924d_b4b34ddffdee.slice/crio-544dafaf0c80f2348a43cfa5b78f97db53ebb4a05a3bd70ef526c02a03aee066 WatchSource:0}: Error finding container 544dafaf0c80f2348a43cfa5b78f97db53ebb4a05a3bd70ef526c02a03aee066: Status 404 returned error can't find the container with id 544dafaf0c80f2348a43cfa5b78f97db53ebb4a05a3bd70ef526c02a03aee066
Aug 01 00:30:29.247867 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.247567    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wzd2h"
Aug 01 00:30:29.419351 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.419260    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-qd5rp" event={"ID":"cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe","Type":"ContainerStarted","Data":"c9c0647f7ec29c5000a0b732607804da88bdf52dae1bce888552dd34271ad21c"}
Aug 01 00:30:29.421646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.420621    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-qd5rp"
Aug 01 00:30:29.425578 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.425529    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f2g5z" event={"ID":"b94ea98c-7710-4a28-afd6-a8782c08abd4","Type":"ContainerStarted","Data":"f389a555797927ca76debe3ae23ee4928a88edab302b087913165143ba36643f"}
Aug 01 00:30:29.428304 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.428247    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edc211e1-5bbe-4658-b671-90fe0fcc0fb6","Type":"ContainerStarted","Data":"443e0d5d89af337203b50147f353dd332c9e369ccc095909a888ab5f45758212"}
Aug 01 00:30:29.433064 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.433027    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks" event={"ID":"3fb050a6-76b9-4a6b-924d-b4b34ddffdee","Type":"ContainerStarted","Data":"4d43eaaf54bc64ae73c68be13a6c41c5f25d7b8d883477d0b41f8a4cca32e9e3"}
Aug 01 00:30:29.433205 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.433092    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks" event={"ID":"3fb050a6-76b9-4a6b-924d-b4b34ddffdee","Type":"ContainerStarted","Data":"0c430e4ba4ea407e7b7f63be9d774777f5cea9c4809496979888719b222e4582"}
Aug 01 00:30:29.433205 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.433111    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks" event={"ID":"3fb050a6-76b9-4a6b-924d-b4b34ddffdee","Type":"ContainerStarted","Data":"544dafaf0c80f2348a43cfa5b78f97db53ebb4a05a3bd70ef526c02a03aee066"}
Aug 01 00:30:29.434864 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.434834    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cs7pq" event={"ID":"9b2a9172-9b05-4e41-b31f-28a1736f845f","Type":"ContainerStarted","Data":"15a27a9401d969658b4931fd338ecbe41eb1d856e69d698e9c247693a14b9caa"}
Aug 01 00:30:29.437416 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.437276    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-qd5rp"
Aug 01 00:30:29.442063 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.441981    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-qd5rp" podStartSLOduration=1.6058264119999999 podStartE2EDuration="21.441959392s" totalImagesPullingTime="19.83613298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:29.440347583 +0000 UTC m=+98.137516673" watchObservedRunningTime="2026-08-01 00:30:29.441959392 +0000 UTC m=+98.139128455"
Aug 01 00:30:29.484878 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:29.482454    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f2g5z" podStartSLOduration=34.866396622 podStartE2EDuration="44.48243102s" totalImagesPullingTime="9.616034398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 00:29:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:29.481133321 +0000 UTC m=+98.178302384" watchObservedRunningTime="2026-08-01 00:30:29.48243102 +0000 UTC m=+98.179600084"
Aug 01 00:30:30.313681 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:30.313646    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f75947677-76hxl"
Aug 01 00:30:31.446192 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.446148    2547 generic.go:356] "Generic (PLEG): container finished" podID="edc211e1-5bbe-4658-b671-90fe0fcc0fb6" containerID="b0491d21b4488f01cfea5657064e25b8a6e905751ee1c119c0870180c164bb37" exitCode=0
Aug 01 00:30:31.446715 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.446249    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edc211e1-5bbe-4658-b671-90fe0fcc0fb6","Type":"ContainerDied","Data":"b0491d21b4488f01cfea5657064e25b8a6e905751ee1c119c0870180c164bb37"}
Aug 01 00:30:31.448704 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.448625    2547 generic.go:356] "Generic (PLEG): container finished" podID="9b2a9172-9b05-4e41-b31f-28a1736f845f" containerID="94517a4d9c7d569d92467da6d9084c04388d1fea67cf0ef9e0eb8bf3bc3511cb" exitCode=0
Aug 01 00:30:31.448881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.448834    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cs7pq" event={"ID":"9b2a9172-9b05-4e41-b31f-28a1736f845f","Type":"ContainerDied","Data":"94517a4d9c7d569d92467da6d9084c04388d1fea67cf0ef9e0eb8bf3bc3511cb"}
Aug 01 00:30:31.559896 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.559858    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56855b96bf-fkvm5"]
Aug 01 00:30:31.587320 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.585375    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56855b96bf-fkvm5"]
Aug 01 00:30:31.587320 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.585532    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.696342 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.696247    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-oauth-config\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.696656 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.696369    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-oauth-serving-cert\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.696656 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.696532    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-config\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.696656 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.696587    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz6xz\" (UniqueName: \"kubernetes.io/projected/3bcc9699-eaf6-4ad4-9807-61ea153aad46-kube-api-access-dz6xz\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.696656 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.696619    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-serving-cert\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.696656 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.696642    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-service-ca\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.697083 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.696668    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-trusted-ca-bundle\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.797114 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.797070    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-config\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.797114 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.797118    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz6xz\" (UniqueName: \"kubernetes.io/projected/3bcc9699-eaf6-4ad4-9807-61ea153aad46-kube-api-access-dz6xz\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.797354 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.797140    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-serving-cert\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.797354 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.797214    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-service-ca\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.797354 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.797257    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-trusted-ca-bundle\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.797531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.797360    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-oauth-config\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.797531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.797405    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-oauth-serving-cert\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.797993 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.797940    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-config\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.798448 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.798422    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-service-ca\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.798582 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.798452    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-oauth-serving-cert\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.798709 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.798685    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-trusted-ca-bundle\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.800138 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.800114    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-serving-cert\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.800254 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.800232    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-oauth-config\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.806324 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.806299    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz6xz\" (UniqueName: \"kubernetes.io/projected/3bcc9699-eaf6-4ad4-9807-61ea153aad46-kube-api-access-dz6xz\") pod \"console-56855b96bf-fkvm5\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") " pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:31.899111 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:31.899077    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:32.081059 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.080986    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56855b96bf-fkvm5"]
Aug 01 00:30:32.191597 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:32.191557    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bcc9699_eaf6_4ad4_9807_61ea153aad46.slice/crio-023021c9b5216db59ed3628d6d09b8a5d20d14996370918c9afd312103b4c5c3 WatchSource:0}: Error finding container 023021c9b5216db59ed3628d6d09b8a5d20d14996370918c9afd312103b4c5c3: Status 404 returned error can't find the container with id 023021c9b5216db59ed3628d6d09b8a5d20d14996370918c9afd312103b4c5c3
Aug 01 00:30:32.457225 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.457151    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56855b96bf-fkvm5" event={"ID":"3bcc9699-eaf6-4ad4-9807-61ea153aad46","Type":"ContainerStarted","Data":"a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77"}
Aug 01 00:30:32.457225 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.457213    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56855b96bf-fkvm5" event={"ID":"3bcc9699-eaf6-4ad4-9807-61ea153aad46","Type":"ContainerStarted","Data":"023021c9b5216db59ed3628d6d09b8a5d20d14996370918c9afd312103b4c5c3"}
Aug 01 00:30:32.460898 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.460864    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks" event={"ID":"3fb050a6-76b9-4a6b-924d-b4b34ddffdee","Type":"ContainerStarted","Data":"b587c78d3943890da73dd38cd90b4419f12ad64f0e53ea4798589b431c8bb190"}
Aug 01 00:30:32.463681 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.463648    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cs7pq" event={"ID":"9b2a9172-9b05-4e41-b31f-28a1736f845f","Type":"ContainerStarted","Data":"51687e733c34d45b000bcbb2b37223f73d37903eb1d3470607ed662a604ba493"}
Aug 01 00:30:32.463833 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.463713    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cs7pq" event={"ID":"9b2a9172-9b05-4e41-b31f-28a1736f845f","Type":"ContainerStarted","Data":"922fd78b3fc77809d07885f75147ed55b3fe7c7748c14d927c88d55ff61588d7"}
Aug 01 00:30:32.478079 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.478011    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56855b96bf-fkvm5" podStartSLOduration=1.477985214 podStartE2EDuration="1.477985214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:32.47663871 +0000 UTC m=+101.173807793" watchObservedRunningTime="2026-08-01 00:30:32.477985214 +0000 UTC m=+101.175154278"
Aug 01 00:30:32.496677 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.496617    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cs7pq" podStartSLOduration=7.246338389 podStartE2EDuration="9.496594938s" totalImagesPullingTime="2.153190978s" totalInitContainerRuntime="97.065571ms" isStatefulPod=true podCreationTimestamp="2026-08-01 00:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:32.495987268 +0000 UTC m=+101.193156365" watchObservedRunningTime="2026-08-01 00:30:32.496594938 +0000 UTC m=+101.193764001"
Aug 01 00:30:32.514316 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.513043    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdqks" podStartSLOduration=6.544628507 podStartE2EDuration="9.513021766s" totalImagesPullingTime="2.968393259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:32.511634784 +0000 UTC m=+101.208803876" watchObservedRunningTime="2026-08-01 00:30:32.513021766 +0000 UTC m=+101.210190830"
Aug 01 00:30:32.993741 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:32.993702    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56855b96bf-fkvm5"]
Aug 01 00:30:33.024758 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.024714    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78c846bdd4-fzm6l"]
Aug 01 00:30:33.039129 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.039091    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c846bdd4-fzm6l"]
Aug 01 00:30:33.039318 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.039211    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.113421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.113041    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-config\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.113421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.113095    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-oauth-config\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.113421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.113124    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-424bg\" (UniqueName: \"kubernetes.io/projected/46bd55dd-c42d-4414-9a35-612caefaa9f2-kube-api-access-424bg\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.113421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.113167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-oauth-serving-cert\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.113421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.113202    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-trusted-ca-bundle\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.113421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.113269    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-service-ca\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.113421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.113295    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-serving-cert\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215151 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.214724    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-trusted-ca-bundle\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215151 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.214858    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-service-ca\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215151 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.214891    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-serving-cert\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215151 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.214942    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-config\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215151 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.214972    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-oauth-config\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215151 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.215001    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-424bg\" (UniqueName: \"kubernetes.io/projected/46bd55dd-c42d-4414-9a35-612caefaa9f2-kube-api-access-424bg\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215151 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.215051    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-oauth-serving-cert\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215819 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.215792    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-service-ca\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.215819 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.215812    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-oauth-serving-cert\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.216136 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.216055    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-trusted-ca-bundle\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.216443 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.216417    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-config\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.219597 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.219549    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-serving-cert\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.221638 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.221507    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-oauth-config\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.224387 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.224290    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-424bg\" (UniqueName: \"kubernetes.io/projected/46bd55dd-c42d-4414-9a35-612caefaa9f2-kube-api-access-424bg\") pod \"console-78c846bdd4-fzm6l\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") " pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.351827 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.351725    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:33.771537 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:33.771497    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c846bdd4-fzm6l"]
Aug 01 00:30:33.781202 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:30:33.781149    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46bd55dd_c42d_4414_9a35_612caefaa9f2.slice/crio-41a1c9bec1e38419d40996f037651582afb41c20a2a3fd8b92ce9dad55d8d3d7 WatchSource:0}: Error finding container 41a1c9bec1e38419d40996f037651582afb41c20a2a3fd8b92ce9dad55d8d3d7: Status 404 returned error can't find the container with id 41a1c9bec1e38419d40996f037651582afb41c20a2a3fd8b92ce9dad55d8d3d7
Aug 01 00:30:34.503975 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:34.503879    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edc211e1-5bbe-4658-b671-90fe0fcc0fb6","Type":"ContainerStarted","Data":"ed75d903a56994c73d8ea2d8bc961dbcf468a95d795094500a0ff1837a418b08"}
Aug 01 00:30:34.504174 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:34.504008    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edc211e1-5bbe-4658-b671-90fe0fcc0fb6","Type":"ContainerStarted","Data":"2ae6076f784b25f307a54faf1f5540a63e0b416ce7264ccf30376a48ec90a130"}
Aug 01 00:30:34.504174 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:34.504050    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edc211e1-5bbe-4658-b671-90fe0fcc0fb6","Type":"ContainerStarted","Data":"ea40ed821ba25bab98b51d8269bf3ec31d503e9dfaea96a813182138374a8592"}
Aug 01 00:30:34.506182 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:34.506122    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c846bdd4-fzm6l" event={"ID":"46bd55dd-c42d-4414-9a35-612caefaa9f2","Type":"ContainerStarted","Data":"ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be"}
Aug 01 00:30:34.506356 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:34.506212    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c846bdd4-fzm6l" event={"ID":"46bd55dd-c42d-4414-9a35-612caefaa9f2","Type":"ContainerStarted","Data":"41a1c9bec1e38419d40996f037651582afb41c20a2a3fd8b92ce9dad55d8d3d7"}
Aug 01 00:30:34.544904 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:34.544851    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78c846bdd4-fzm6l" podStartSLOduration=1.544823268 podStartE2EDuration="1.544823268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:34.543550699 +0000 UTC m=+103.240719762" watchObservedRunningTime="2026-08-01 00:30:34.544823268 +0000 UTC m=+103.241992330"
Aug 01 00:30:35.514982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:35.514939    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edc211e1-5bbe-4658-b671-90fe0fcc0fb6","Type":"ContainerStarted","Data":"9d629fcfb64259a9f0c09362b9ba60f98b6c40cdfbac431d59ee291019aa8278"}
Aug 01 00:30:35.515563 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:35.515035    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edc211e1-5bbe-4658-b671-90fe0fcc0fb6","Type":"ContainerStarted","Data":"6093d62090d9dc6ecb187a2299409e70aa0425325806e7aa437e562e736897e1"}
Aug 01 00:30:36.524400 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:36.524357    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"edc211e1-5bbe-4658-b671-90fe0fcc0fb6","Type":"ContainerStarted","Data":"aac8b3298a81d08848c9df3f96406ab584f6892b523312bc64b46b9f683ab8ad"}
Aug 01 00:30:36.549644 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:36.549579    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.739065539 podStartE2EDuration="12.549557261s" totalImagesPullingTime="5.800549954s" totalInitContainerRuntime="9.941768ms" isStatefulPod=false podCreationTimestamp="2026-08-01 00:30:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:30:36.547716204 +0000 UTC m=+105.244885296" watchObservedRunningTime="2026-08-01 00:30:36.549557261 +0000 UTC m=+105.246726322"
Aug 01 00:30:41.899816 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:41.899773    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:43.352438 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:43.352390    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:43.352855 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:43.352464    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:43.357533 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:43.357501    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:43.558759 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:43.558728    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:30:43.605940 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:43.605842    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5565d8899f-6crxt"]
Aug 01 00:30:59.534008 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.533928    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56855b96bf-fkvm5" podUID="3bcc9699-eaf6-4ad4-9807-61ea153aad46" containerName="console" containerID="cri-o://a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77" gracePeriod=15
Aug 01 00:30:59.617744 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.617654    2547 generic.go:356] "Generic (PLEG): container finished" podID="a2ceeaa9-1cfa-467d-adde-1769ebae2d7e" containerID="88707f19b99040f226d0a480d2f906f1b2e88162a1c1fc6f69a1746505882654" exitCode=0
Aug 01 00:30:59.617883 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.617736    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2" event={"ID":"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e","Type":"ContainerDied","Data":"88707f19b99040f226d0a480d2f906f1b2e88162a1c1fc6f69a1746505882654"}
Aug 01 00:30:59.618106 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.618089    2547 scope.go:117] "RemoveContainer" containerID="88707f19b99040f226d0a480d2f906f1b2e88162a1c1fc6f69a1746505882654"
Aug 01 00:30:59.828044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.828009    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:30:59.973076 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973040    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-service-ca\") pod \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") "
Aug 01 00:30:59.973263 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973101    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz6xz\" (UniqueName: \"kubernetes.io/projected/3bcc9699-eaf6-4ad4-9807-61ea153aad46-kube-api-access-dz6xz\") pod \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") "
Aug 01 00:30:59.973263 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973142    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-serving-cert\") pod \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") "
Aug 01 00:30:59.973263 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973211    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-oauth-config\") pod \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") "
Aug 01 00:30:59.973263 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973239    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-config\") pod \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") "
Aug 01 00:30:59.973457 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973264    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-trusted-ca-bundle\") pod \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") "
Aug 01 00:30:59.973457 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973327    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-oauth-serving-cert\") pod \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\" (UID: \"3bcc9699-eaf6-4ad4-9807-61ea153aad46\") "
Aug 01 00:30:59.973597 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973462    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-service-ca" (OuterVolumeSpecName: "service-ca") pod "3bcc9699-eaf6-4ad4-9807-61ea153aad46" (UID: "3bcc9699-eaf6-4ad4-9807-61ea153aad46"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:30:59.973840 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973815    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:30:59.973948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973841    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3bcc9699-eaf6-4ad4-9807-61ea153aad46" (UID: "3bcc9699-eaf6-4ad4-9807-61ea153aad46"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:30:59.973948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973869    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3bcc9699-eaf6-4ad4-9807-61ea153aad46" (UID: "3bcc9699-eaf6-4ad4-9807-61ea153aad46"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:30:59.973948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.973926    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-config" (OuterVolumeSpecName: "console-config") pod "3bcc9699-eaf6-4ad4-9807-61ea153aad46" (UID: "3bcc9699-eaf6-4ad4-9807-61ea153aad46"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:30:59.975687 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.975664    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3bcc9699-eaf6-4ad4-9807-61ea153aad46" (UID: "3bcc9699-eaf6-4ad4-9807-61ea153aad46"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:30:59.975687 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.975677    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bcc9699-eaf6-4ad4-9807-61ea153aad46-kube-api-access-dz6xz" (OuterVolumeSpecName: "kube-api-access-dz6xz") pod "3bcc9699-eaf6-4ad4-9807-61ea153aad46" (UID: "3bcc9699-eaf6-4ad4-9807-61ea153aad46"). InnerVolumeSpecName "kube-api-access-dz6xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:30:59.975808 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:30:59.975727    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3bcc9699-eaf6-4ad4-9807-61ea153aad46" (UID: "3bcc9699-eaf6-4ad4-9807-61ea153aad46"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:31:00.074392 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.074349    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz6xz\" (UniqueName: \"kubernetes.io/projected/3bcc9699-eaf6-4ad4-9807-61ea153aad46-kube-api-access-dz6xz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:00.074392 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.074382    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-serving-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:00.074392 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.074392    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-oauth-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:00.074392 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.074403    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-console-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:00.074674 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.074411    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-trusted-ca-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:00.074674 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.074420    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3bcc9699-eaf6-4ad4-9807-61ea153aad46-oauth-serving-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:00.623336 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.623302    2547 generic.go:356] "Generic (PLEG): container finished" podID="3bcc9699-eaf6-4ad4-9807-61ea153aad46" containerID="a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77" exitCode=0
Aug 01 00:31:00.623819 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.623356    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56855b96bf-fkvm5"
Aug 01 00:31:00.623819 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.623388    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56855b96bf-fkvm5" event={"ID":"3bcc9699-eaf6-4ad4-9807-61ea153aad46","Type":"ContainerDied","Data":"a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77"}
Aug 01 00:31:00.623819 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.623446    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56855b96bf-fkvm5" event={"ID":"3bcc9699-eaf6-4ad4-9807-61ea153aad46","Type":"ContainerDied","Data":"023021c9b5216db59ed3628d6d09b8a5d20d14996370918c9afd312103b4c5c3"}
Aug 01 00:31:00.623819 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.623474    2547 scope.go:117] "RemoveContainer" containerID="a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77"
Aug 01 00:31:00.625437 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.625414    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54sb2" event={"ID":"a2ceeaa9-1cfa-467d-adde-1769ebae2d7e","Type":"ContainerStarted","Data":"f91f245347bbd171b0c92f6d29a44bebaaa203081f1e9da858b0dd189377ef8c"}
Aug 01 00:31:00.634040 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.634018    2547 scope.go:117] "RemoveContainer" containerID="a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77"
Aug 01 00:31:00.634389 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:31:00.634360    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77\": container with ID starting with a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77 not found: ID does not exist" containerID="a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77"
Aug 01 00:31:00.634509 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.634396    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77"} err="failed to get container status \"a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77\": rpc error: code = NotFound desc = could not find container \"a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77\": container with ID starting with a0128f043fa8148fbbccca61c8785384fe8edb6614ed66eb0bd202378b27ee77 not found: ID does not exist"
Aug 01 00:31:00.652723 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.652639    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56855b96bf-fkvm5"]
Aug 01 00:31:00.661900 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:00.658555    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56855b96bf-fkvm5"]
Aug 01 00:31:01.688659 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:01.688619    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:31:01.691137 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:01.691112    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e739675e-0789-44a5-bae6-b67926f611ef-metrics-certs\") pod \"network-metrics-daemon-677wl\" (UID: \"e739675e-0789-44a5-bae6-b67926f611ef\") " pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:31:01.696137 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:01.696112    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2x5h\""
Aug 01 00:31:01.704232 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:01.704201    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-677wl"
Aug 01 00:31:01.872271 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:01.872170    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-677wl"]
Aug 01 00:31:01.875277 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:31:01.875241    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode739675e_0789_44a5_bae6_b67926f611ef.slice/crio-a7cf36ae45bd6887e8b7b977b7692f0cae0f3a13a785020431567db7ef111ab9 WatchSource:0}: Error finding container a7cf36ae45bd6887e8b7b977b7692f0cae0f3a13a785020431567db7ef111ab9: Status 404 returned error can't find the container with id a7cf36ae45bd6887e8b7b977b7692f0cae0f3a13a785020431567db7ef111ab9
Aug 01 00:31:01.880473 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:01.880376    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bcc9699-eaf6-4ad4-9807-61ea153aad46" path="/var/lib/kubelet/pods/3bcc9699-eaf6-4ad4-9807-61ea153aad46/volumes"
Aug 01 00:31:02.635714 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:02.635678    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-677wl" event={"ID":"e739675e-0789-44a5-bae6-b67926f611ef","Type":"ContainerStarted","Data":"a7cf36ae45bd6887e8b7b977b7692f0cae0f3a13a785020431567db7ef111ab9"}
Aug 01 00:31:04.647171 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:04.647080    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-677wl" event={"ID":"e739675e-0789-44a5-bae6-b67926f611ef","Type":"ContainerStarted","Data":"272791c89235565082fa642cbb38ba87d147491f2c6082eb35d0829005582e44"}
Aug 01 00:31:04.647171 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:04.647137    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-677wl" event={"ID":"e739675e-0789-44a5-bae6-b67926f611ef","Type":"ContainerStarted","Data":"f07aa72016e07d5b2b6d409da76f2e28c7d05abd32583f4203db99dc24454d35"}
Aug 01 00:31:04.663233 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:04.663178    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-677wl" podStartSLOduration=130.418264036 podStartE2EDuration="2m12.663160249s" totalImagesPullingTime="2.244896213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:31:04.660771109 +0000 UTC m=+133.357940171" watchObservedRunningTime="2026-08-01 00:31:04.663160249 +0000 UTC m=+133.360329311"
Aug 01 00:31:08.636065 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.636000    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5565d8899f-6crxt" podUID="a6ad3d58-e40a-4c94-b268-8124e6cddab2" containerName="console" containerID="cri-o://44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e" gracePeriod=15
Aug 01 00:31:08.928720 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.928661    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:31:08.952243 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952215    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-service-ca\") pod \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") "
Aug 01 00:31:08.952434 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952277    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-oauth-config\") pod \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") "
Aug 01 00:31:08.952434 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952329    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-serving-cert\") pod \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") "
Aug 01 00:31:08.952434 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952360    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-oauth-serving-cert\") pod \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") "
Aug 01 00:31:08.952623 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952576    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8mfp\" (UniqueName: \"kubernetes.io/projected/a6ad3d58-e40a-4c94-b268-8124e6cddab2-kube-api-access-m8mfp\") pod \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") "
Aug 01 00:31:08.952623 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952593    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6ad3d58-e40a-4c94-b268-8124e6cddab2" (UID: "a6ad3d58-e40a-4c94-b268-8124e6cddab2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:31:08.952724 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952622    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-config\") pod \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") "
Aug 01 00:31:08.952724 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952649    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-trusted-ca-bundle\") pod \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\" (UID: \"a6ad3d58-e40a-4c94-b268-8124e6cddab2\") "
Aug 01 00:31:08.952832 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952762    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6ad3d58-e40a-4c94-b268-8124e6cddab2" (UID: "a6ad3d58-e40a-4c94-b268-8124e6cddab2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:31:08.953010 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.952983    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-oauth-serving-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:08.953080 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.953017    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:08.953080 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.953014    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-config" (OuterVolumeSpecName: "console-config") pod "a6ad3d58-e40a-4c94-b268-8124e6cddab2" (UID: "a6ad3d58-e40a-4c94-b268-8124e6cddab2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:31:08.953172 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.953147    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a6ad3d58-e40a-4c94-b268-8124e6cddab2" (UID: "a6ad3d58-e40a-4c94-b268-8124e6cddab2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:31:08.954756 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.954731    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6ad3d58-e40a-4c94-b268-8124e6cddab2" (UID: "a6ad3d58-e40a-4c94-b268-8124e6cddab2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:31:08.954881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.954772    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6ad3d58-e40a-4c94-b268-8124e6cddab2-kube-api-access-m8mfp" (OuterVolumeSpecName: "kube-api-access-m8mfp") pod "a6ad3d58-e40a-4c94-b268-8124e6cddab2" (UID: "a6ad3d58-e40a-4c94-b268-8124e6cddab2"). InnerVolumeSpecName "kube-api-access-m8mfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:31:08.954881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:08.954805    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6ad3d58-e40a-4c94-b268-8124e6cddab2" (UID: "a6ad3d58-e40a-4c94-b268-8124e6cddab2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:31:09.053667 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.053627    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-oauth-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:09.053667 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.053662    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-serving-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:09.053667 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.053672    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8mfp\" (UniqueName: \"kubernetes.io/projected/a6ad3d58-e40a-4c94-b268-8124e6cddab2-kube-api-access-m8mfp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:09.053892 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.053681    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-console-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:09.053892 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.053690    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad3d58-e40a-4c94-b268-8124e6cddab2-trusted-ca-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:31:09.669422 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.669386    2547 generic.go:356] "Generic (PLEG): container finished" podID="a6ad3d58-e40a-4c94-b268-8124e6cddab2" containerID="44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e" exitCode=0
Aug 01 00:31:09.669840 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.669431    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5565d8899f-6crxt"
Aug 01 00:31:09.669840 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.669466    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5565d8899f-6crxt" event={"ID":"a6ad3d58-e40a-4c94-b268-8124e6cddab2","Type":"ContainerDied","Data":"44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e"}
Aug 01 00:31:09.669840 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.669537    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5565d8899f-6crxt" event={"ID":"a6ad3d58-e40a-4c94-b268-8124e6cddab2","Type":"ContainerDied","Data":"496529b270fe592f568ac47881346481c94ae05ab93cc15aef2a23c283a2051e"}
Aug 01 00:31:09.669840 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.669558    2547 scope.go:117] "RemoveContainer" containerID="44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e"
Aug 01 00:31:09.686412 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.686387    2547 scope.go:117] "RemoveContainer" containerID="44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e"
Aug 01 00:31:09.686780 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:31:09.686757    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e\": container with ID starting with 44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e not found: ID does not exist" containerID="44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e"
Aug 01 00:31:09.686875 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.686790    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e"} err="failed to get container status \"44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e\": rpc error: code = NotFound desc = could not find container \"44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e\": container with ID starting with 44ac9f4c7c446062341f744c6aaf946ad9a4cda872c297136e19909231f9e99e not found: ID does not exist"
Aug 01 00:31:09.690577 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.690551    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5565d8899f-6crxt"]
Aug 01 00:31:09.694729 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.694703    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5565d8899f-6crxt"]
Aug 01 00:31:09.879801 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:31:09.879765    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6ad3d58-e40a-4c94-b268-8124e6cddab2" path="/var/lib/kubelet/pods/a6ad3d58-e40a-4c94-b268-8124e6cddab2/volumes"
Aug 01 00:32:01.058767 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.058727    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5989cdc876-fwwjl"]
Aug 01 00:32:01.059395 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.059233    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bcc9699-eaf6-4ad4-9807-61ea153aad46" containerName="console"
Aug 01 00:32:01.059395 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.059256    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bcc9699-eaf6-4ad4-9807-61ea153aad46" containerName="console"
Aug 01 00:32:01.059395 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.059270    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6ad3d58-e40a-4c94-b268-8124e6cddab2" containerName="console"
Aug 01 00:32:01.059395 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.059279    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6ad3d58-e40a-4c94-b268-8124e6cddab2" containerName="console"
Aug 01 00:32:01.059395 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.059382    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6ad3d58-e40a-4c94-b268-8124e6cddab2" containerName="console"
Aug 01 00:32:01.059395 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.059395    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bcc9699-eaf6-4ad4-9807-61ea153aad46" containerName="console"
Aug 01 00:32:01.063990 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.063952    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.073302 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.073273    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5989cdc876-fwwjl"]
Aug 01 00:32:01.110928 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.110882    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-serving-cert\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.110928 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.110932    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-service-ca\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.111158 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.111021    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-oauth-config\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.111158 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.111061    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-trusted-ca-bundle\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.111158 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.111092    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-oauth-serving-cert\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.111158 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.111118    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-config\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.111158 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.111159    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vlnd\" (UniqueName: \"kubernetes.io/projected/1b9c5865-9c38-4f6c-a53e-9991e517d861-kube-api-access-6vlnd\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.211621 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.211568    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vlnd\" (UniqueName: \"kubernetes.io/projected/1b9c5865-9c38-4f6c-a53e-9991e517d861-kube-api-access-6vlnd\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.211804 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.211634    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-serving-cert\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.211804 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.211672    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-service-ca\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.211804 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.211703    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-oauth-config\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.212041 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.211847    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-trusted-ca-bundle\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.212041 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.211915    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-oauth-serving-cert\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.212041 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.211958    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-config\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.212573 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.212547    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-service-ca\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.212687 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.212589    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-oauth-serving-cert\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.212687 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.212619    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-config\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.212798 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.212775    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-trusted-ca-bundle\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.214317 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.214296    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-serving-cert\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.214431 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.214328    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-oauth-config\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.221748 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.221719    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vlnd\" (UniqueName: \"kubernetes.io/projected/1b9c5865-9c38-4f6c-a53e-9991e517d861-kube-api-access-6vlnd\") pod \"console-5989cdc876-fwwjl\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") " pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.374503 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.374380    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:01.513729 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.513605    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5989cdc876-fwwjl"]
Aug 01 00:32:01.516470 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:32:01.516440    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9c5865_9c38_4f6c_a53e_9991e517d861.slice/crio-f4a5cc4d1645f40cc2c066700d10c5cdcf12bc0878021a3e96adfd0ebfbfe922 WatchSource:0}: Error finding container f4a5cc4d1645f40cc2c066700d10c5cdcf12bc0878021a3e96adfd0ebfbfe922: Status 404 returned error can't find the container with id f4a5cc4d1645f40cc2c066700d10c5cdcf12bc0878021a3e96adfd0ebfbfe922
Aug 01 00:32:01.887203 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.887165    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5989cdc876-fwwjl" event={"ID":"1b9c5865-9c38-4f6c-a53e-9991e517d861","Type":"ContainerStarted","Data":"4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f"}
Aug 01 00:32:01.887381 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.887217    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5989cdc876-fwwjl" event={"ID":"1b9c5865-9c38-4f6c-a53e-9991e517d861","Type":"ContainerStarted","Data":"f4a5cc4d1645f40cc2c066700d10c5cdcf12bc0878021a3e96adfd0ebfbfe922"}
Aug 01 00:32:01.904914 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:01.904459    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5989cdc876-fwwjl" podStartSLOduration=0.904437048 podStartE2EDuration="904.437048ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:32:01.904281755 +0000 UTC m=+190.601450821" watchObservedRunningTime="2026-08-01 00:32:01.904437048 +0000 UTC m=+190.601606111"
Aug 01 00:32:11.375426 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:11.375382    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:11.375876 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:11.375454    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:11.380592 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:11.380563    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:11.931834 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:11.931803    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:32:11.974261 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:11.974222    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c846bdd4-fzm6l"]
Aug 01 00:32:36.996270 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:36.996204    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78c846bdd4-fzm6l" podUID="46bd55dd-c42d-4414-9a35-612caefaa9f2" containerName="console" containerID="cri-o://ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be" gracePeriod=15
Aug 01 00:32:37.243850 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.243817    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:32:37.327881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.327782    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-serving-cert\") pod \"46bd55dd-c42d-4414-9a35-612caefaa9f2\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") "
Aug 01 00:32:37.327881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.327853    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-oauth-config\") pod \"46bd55dd-c42d-4414-9a35-612caefaa9f2\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") "
Aug 01 00:32:37.328106 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.327893    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-oauth-serving-cert\") pod \"46bd55dd-c42d-4414-9a35-612caefaa9f2\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") "
Aug 01 00:32:37.328106 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.327916    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-service-ca\") pod \"46bd55dd-c42d-4414-9a35-612caefaa9f2\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") "
Aug 01 00:32:37.328106 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.327943    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-config\") pod \"46bd55dd-c42d-4414-9a35-612caefaa9f2\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") "
Aug 01 00:32:37.328106 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.327968    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-trusted-ca-bundle\") pod \"46bd55dd-c42d-4414-9a35-612caefaa9f2\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") "
Aug 01 00:32:37.328106 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.327993    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-424bg\" (UniqueName: \"kubernetes.io/projected/46bd55dd-c42d-4414-9a35-612caefaa9f2-kube-api-access-424bg\") pod \"46bd55dd-c42d-4414-9a35-612caefaa9f2\" (UID: \"46bd55dd-c42d-4414-9a35-612caefaa9f2\") "
Aug 01 00:32:37.328391 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.328363    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "46bd55dd-c42d-4414-9a35-612caefaa9f2" (UID: "46bd55dd-c42d-4414-9a35-612caefaa9f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:32:37.328391 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.328376    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46bd55dd-c42d-4414-9a35-612caefaa9f2" (UID: "46bd55dd-c42d-4414-9a35-612caefaa9f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:32:37.328503 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.328393    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-config" (OuterVolumeSpecName: "console-config") pod "46bd55dd-c42d-4414-9a35-612caefaa9f2" (UID: "46bd55dd-c42d-4414-9a35-612caefaa9f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:32:37.328503 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.328442    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46bd55dd-c42d-4414-9a35-612caefaa9f2" (UID: "46bd55dd-c42d-4414-9a35-612caefaa9f2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:32:37.330123 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.330095    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46bd55dd-c42d-4414-9a35-612caefaa9f2" (UID: "46bd55dd-c42d-4414-9a35-612caefaa9f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:32:37.330123 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.330107    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46bd55dd-c42d-4414-9a35-612caefaa9f2" (UID: "46bd55dd-c42d-4414-9a35-612caefaa9f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:32:37.330290 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.330154    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46bd55dd-c42d-4414-9a35-612caefaa9f2-kube-api-access-424bg" (OuterVolumeSpecName: "kube-api-access-424bg") pod "46bd55dd-c42d-4414-9a35-612caefaa9f2" (UID: "46bd55dd-c42d-4414-9a35-612caefaa9f2"). InnerVolumeSpecName "kube-api-access-424bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:32:37.428776 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.428729    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-oauth-serving-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:32:37.428776 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.428767    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:32:37.428776 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.428778    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:32:37.428776 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.428787    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46bd55dd-c42d-4414-9a35-612caefaa9f2-trusted-ca-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:32:37.429054 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.428798    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-424bg\" (UniqueName: \"kubernetes.io/projected/46bd55dd-c42d-4414-9a35-612caefaa9f2-kube-api-access-424bg\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:32:37.429054 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.428812    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-serving-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:32:37.429054 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:37.428822    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46bd55dd-c42d-4414-9a35-612caefaa9f2-console-oauth-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:32:38.031526 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.031465    2547 generic.go:356] "Generic (PLEG): container finished" podID="46bd55dd-c42d-4414-9a35-612caefaa9f2" containerID="ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be" exitCode=0
Aug 01 00:32:38.031949 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.031532    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c846bdd4-fzm6l"
Aug 01 00:32:38.031949 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.031551    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c846bdd4-fzm6l" event={"ID":"46bd55dd-c42d-4414-9a35-612caefaa9f2","Type":"ContainerDied","Data":"ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be"}
Aug 01 00:32:38.031949 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.031609    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c846bdd4-fzm6l" event={"ID":"46bd55dd-c42d-4414-9a35-612caefaa9f2","Type":"ContainerDied","Data":"41a1c9bec1e38419d40996f037651582afb41c20a2a3fd8b92ce9dad55d8d3d7"}
Aug 01 00:32:38.031949 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.031631    2547 scope.go:117] "RemoveContainer" containerID="ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be"
Aug 01 00:32:38.040504 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.040463    2547 scope.go:117] "RemoveContainer" containerID="ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be"
Aug 01 00:32:38.040817 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:32:38.040796    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be\": container with ID starting with ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be not found: ID does not exist" containerID="ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be"
Aug 01 00:32:38.040917 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.040827    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be"} err="failed to get container status \"ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be\": rpc error: code = NotFound desc = could not find container \"ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be\": container with ID starting with ce7b3c1ec56244d5b5ad3288d54e82d8d749112e371e505b5490da00e249e9be not found: ID does not exist"
Aug 01 00:32:38.046330 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.046297    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c846bdd4-fzm6l"]
Aug 01 00:32:38.049849 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:38.049822    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78c846bdd4-fzm6l"]
Aug 01 00:32:39.879274 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:39.879233    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46bd55dd-c42d-4414-9a35-612caefaa9f2" path="/var/lib/kubelet/pods/46bd55dd-c42d-4414-9a35-612caefaa9f2/volumes"
Aug 01 00:32:57.002578 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.002543    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"]
Aug 01 00:32:57.003052 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.002989    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46bd55dd-c42d-4414-9a35-612caefaa9f2" containerName="console"
Aug 01 00:32:57.003052 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.003009    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="46bd55dd-c42d-4414-9a35-612caefaa9f2" containerName="console"
Aug 01 00:32:57.003166 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.003118    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="46bd55dd-c42d-4414-9a35-612caefaa9f2" containerName="console"
Aug 01 00:32:57.007437 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.007414    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"
Aug 01 00:32:57.009596 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.009569    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 01 00:32:57.009721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.009707    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pv8lp\""
Aug 01 00:32:57.010058 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.010036    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 01 00:32:57.020472 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.020441    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"]
Aug 01 00:32:57.079966 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.079928    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f29134-3bd1-4d17-8806-cd64059534b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bhztz\" (UID: \"f8f29134-3bd1-4d17-8806-cd64059534b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"
Aug 01 00:32:57.080150 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.079986    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvqzl\" (UniqueName: \"kubernetes.io/projected/f8f29134-3bd1-4d17-8806-cd64059534b3-kube-api-access-tvqzl\") pod \"cert-manager-operator-controller-manager-55c444bf86-bhztz\" (UID: \"f8f29134-3bd1-4d17-8806-cd64059534b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"
Aug 01 00:32:57.181322 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.181285    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvqzl\" (UniqueName: \"kubernetes.io/projected/f8f29134-3bd1-4d17-8806-cd64059534b3-kube-api-access-tvqzl\") pod \"cert-manager-operator-controller-manager-55c444bf86-bhztz\" (UID: \"f8f29134-3bd1-4d17-8806-cd64059534b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"
Aug 01 00:32:57.181550 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.181378    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f29134-3bd1-4d17-8806-cd64059534b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bhztz\" (UID: \"f8f29134-3bd1-4d17-8806-cd64059534b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"
Aug 01 00:32:57.181750 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.181731    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f29134-3bd1-4d17-8806-cd64059534b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bhztz\" (UID: \"f8f29134-3bd1-4d17-8806-cd64059534b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"
Aug 01 00:32:57.189024 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.188984    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvqzl\" (UniqueName: \"kubernetes.io/projected/f8f29134-3bd1-4d17-8806-cd64059534b3-kube-api-access-tvqzl\") pod \"cert-manager-operator-controller-manager-55c444bf86-bhztz\" (UID: \"f8f29134-3bd1-4d17-8806-cd64059534b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"
Aug 01 00:32:57.316846 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.316752    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"
Aug 01 00:32:57.456866 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:57.456841    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz"]
Aug 01 00:32:57.459865 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:32:57.459832    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f29134_3bd1_4d17_8806_cd64059534b3.slice/crio-309381ef73f029d1826e080eea480afada677f88ef6849999a956991b923e6bc WatchSource:0}: Error finding container 309381ef73f029d1826e080eea480afada677f88ef6849999a956991b923e6bc: Status 404 returned error can't find the container with id 309381ef73f029d1826e080eea480afada677f88ef6849999a956991b923e6bc
Aug 01 00:32:58.112796 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:32:58.112761    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz" event={"ID":"f8f29134-3bd1-4d17-8806-cd64059534b3","Type":"ContainerStarted","Data":"309381ef73f029d1826e080eea480afada677f88ef6849999a956991b923e6bc"}
Aug 01 00:33:01.130464 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:01.130418    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz" event={"ID":"f8f29134-3bd1-4d17-8806-cd64059534b3","Type":"ContainerStarted","Data":"9982150a5950724eb27ad636907f8d227547beb3a3d1092fc75af1f471a7f1f7"}
Aug 01 00:33:01.151227 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:01.151150    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bhztz" podStartSLOduration=2.4399826989999998 podStartE2EDuration="5.151126619s" totalImagesPullingTime="2.71114392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:33:01.150471999 +0000 UTC m=+249.847641060" watchObservedRunningTime="2026-08-01 00:33:01.151126619 +0000 UTC m=+249.848295683"
Aug 01 00:33:12.842441 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:12.842393    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nw8hn"]
Aug 01 00:33:12.845984 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:12.845957    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:12.848202 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:12.848181    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-q26q9\""
Aug 01 00:33:12.848871 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:12.848854    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 01 00:33:12.848917 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:12.848866    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 01 00:33:12.851713 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:12.851682    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nw8hn"]
Aug 01 00:33:12.929687 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:12.929634    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7d3b6b9-6206-4b22-b37a-9e869fc40056-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nw8hn\" (UID: \"e7d3b6b9-6206-4b22-b37a-9e869fc40056\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:12.929910 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:12.929711    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg9x7\" (UniqueName: \"kubernetes.io/projected/e7d3b6b9-6206-4b22-b37a-9e869fc40056-kube-api-access-sg9x7\") pod \"cert-manager-webhook-6486ffd997-nw8hn\" (UID: \"e7d3b6b9-6206-4b22-b37a-9e869fc40056\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:13.031117 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:13.031065    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7d3b6b9-6206-4b22-b37a-9e869fc40056-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nw8hn\" (UID: \"e7d3b6b9-6206-4b22-b37a-9e869fc40056\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:13.031333 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:13.031128    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg9x7\" (UniqueName: \"kubernetes.io/projected/e7d3b6b9-6206-4b22-b37a-9e869fc40056-kube-api-access-sg9x7\") pod \"cert-manager-webhook-6486ffd997-nw8hn\" (UID: \"e7d3b6b9-6206-4b22-b37a-9e869fc40056\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:13.039212 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:13.039169    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7d3b6b9-6206-4b22-b37a-9e869fc40056-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nw8hn\" (UID: \"e7d3b6b9-6206-4b22-b37a-9e869fc40056\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:13.039380 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:13.039363    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg9x7\" (UniqueName: \"kubernetes.io/projected/e7d3b6b9-6206-4b22-b37a-9e869fc40056-kube-api-access-sg9x7\") pod \"cert-manager-webhook-6486ffd997-nw8hn\" (UID: \"e7d3b6b9-6206-4b22-b37a-9e869fc40056\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:13.162291 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:13.162192    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:13.298974 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:13.298929    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nw8hn"]
Aug 01 00:33:13.302917 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:33:13.302890    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7d3b6b9_6206_4b22_b37a_9e869fc40056.slice/crio-b2dd5c3ef2b518524d4d39d658d2b5696c106846463793c0c355ea063aa719d3 WatchSource:0}: Error finding container b2dd5c3ef2b518524d4d39d658d2b5696c106846463793c0c355ea063aa719d3: Status 404 returned error can't find the container with id b2dd5c3ef2b518524d4d39d658d2b5696c106846463793c0c355ea063aa719d3
Aug 01 00:33:14.188452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:14.188347    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn" event={"ID":"e7d3b6b9-6206-4b22-b37a-9e869fc40056","Type":"ContainerStarted","Data":"b2dd5c3ef2b518524d4d39d658d2b5696c106846463793c0c355ea063aa719d3"}
Aug 01 00:33:16.199914 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.199870    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn" event={"ID":"e7d3b6b9-6206-4b22-b37a-9e869fc40056","Type":"ContainerStarted","Data":"900640f70a0865a13bfde2aa4c63d36db5ac72528dc2b085c5164e892e12318f"}
Aug 01 00:33:16.200326 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.199955    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:16.215667 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.215615    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn" podStartSLOduration=1.863998346 podStartE2EDuration="4.215598571s" totalImagesPullingTime="2.351600225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:33:16.214209659 +0000 UTC m=+264.911378744" watchObservedRunningTime="2026-08-01 00:33:16.215598571 +0000 UTC m=+264.912767632"
Aug 01 00:33:16.487775 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.487734    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"]
Aug 01 00:33:16.491065 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.491044    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"
Aug 01 00:33:16.493457 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.493426    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 01 00:33:16.493622 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.493461    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 01 00:33:16.493622 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.493474    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-t7ljn\""
Aug 01 00:33:16.499009 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.498969    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"]
Aug 01 00:33:16.563802 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.563760    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477085dd-2dcd-4a8e-bbfa-9f8f299b144b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g8q8f\" (UID: \"477085dd-2dcd-4a8e-bbfa-9f8f299b144b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"
Aug 01 00:33:16.563993 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.563820    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jklj\" (UniqueName: \"kubernetes.io/projected/477085dd-2dcd-4a8e-bbfa-9f8f299b144b-kube-api-access-8jklj\") pod \"openshift-lws-operator-fd8ccff4c-g8q8f\" (UID: \"477085dd-2dcd-4a8e-bbfa-9f8f299b144b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"
Aug 01 00:33:16.665131 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.665090    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jklj\" (UniqueName: \"kubernetes.io/projected/477085dd-2dcd-4a8e-bbfa-9f8f299b144b-kube-api-access-8jklj\") pod \"openshift-lws-operator-fd8ccff4c-g8q8f\" (UID: \"477085dd-2dcd-4a8e-bbfa-9f8f299b144b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"
Aug 01 00:33:16.665336 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.665186    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477085dd-2dcd-4a8e-bbfa-9f8f299b144b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g8q8f\" (UID: \"477085dd-2dcd-4a8e-bbfa-9f8f299b144b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"
Aug 01 00:33:16.665624 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.665599    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477085dd-2dcd-4a8e-bbfa-9f8f299b144b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g8q8f\" (UID: \"477085dd-2dcd-4a8e-bbfa-9f8f299b144b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"
Aug 01 00:33:16.672737 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.672709    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jklj\" (UniqueName: \"kubernetes.io/projected/477085dd-2dcd-4a8e-bbfa-9f8f299b144b-kube-api-access-8jklj\") pod \"openshift-lws-operator-fd8ccff4c-g8q8f\" (UID: \"477085dd-2dcd-4a8e-bbfa-9f8f299b144b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"
Aug 01 00:33:16.802086 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.801992    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"
Aug 01 00:33:16.944880 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:16.944849    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f"]
Aug 01 00:33:16.947587 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:33:16.947542    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod477085dd_2dcd_4a8e_bbfa_9f8f299b144b.slice/crio-13330b3a0c1b61a2b3d6eceb7ba70d8a30c43890bd2f1ca8a894749d8e572ccf WatchSource:0}: Error finding container 13330b3a0c1b61a2b3d6eceb7ba70d8a30c43890bd2f1ca8a894749d8e572ccf: Status 404 returned error can't find the container with id 13330b3a0c1b61a2b3d6eceb7ba70d8a30c43890bd2f1ca8a894749d8e572ccf
Aug 01 00:33:17.205388 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:17.205290    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f" event={"ID":"477085dd-2dcd-4a8e-bbfa-9f8f299b144b","Type":"ContainerStarted","Data":"13330b3a0c1b61a2b3d6eceb7ba70d8a30c43890bd2f1ca8a894749d8e572ccf"}
Aug 01 00:33:20.221783 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:20.221738    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f" event={"ID":"477085dd-2dcd-4a8e-bbfa-9f8f299b144b","Type":"ContainerStarted","Data":"9a5178124e62c0297e23e366f55e0f51bf4b9da77045797a15ee184892fc43d7"}
Aug 01 00:33:20.238136 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:20.238077    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8q8f" podStartSLOduration=1.4028326629999999 podStartE2EDuration="4.238060838s" totalImagesPullingTime="2.835228175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:33:20.236808954 +0000 UTC m=+268.933978018" watchObservedRunningTime="2026-08-01 00:33:20.238060838 +0000 UTC m=+268.935229899"
Aug 01 00:33:22.207732 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:22.207699    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nw8hn"
Aug 01 00:33:35.881870 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:35.881829    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"]
Aug 01 00:33:35.889230 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:35.889204    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:35.891820 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:35.891783    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 01 00:33:35.891820 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:35.891811    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 01 00:33:35.892032 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:35.891831    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 01 00:33:35.892032 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:35.891833    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8n8f8\""
Aug 01 00:33:35.892211 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:35.892195    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 01 00:33:35.909131 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:35.909092    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"]
Aug 01 00:33:36.044427 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.044380    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20b4a17b-3459-4d57-9721-196dfa0deb3c-tmp\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.044648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.044434    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20b4a17b-3459-4d57-9721-196dfa0deb3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.044648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.044510    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgsgl\" (UniqueName: \"kubernetes.io/projected/20b4a17b-3459-4d57-9721-196dfa0deb3c-kube-api-access-mgsgl\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.044648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.044577    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20b4a17b-3459-4d57-9721-196dfa0deb3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.044648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.044627    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20b4a17b-3459-4d57-9721-196dfa0deb3c-manifests\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.146178 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.146091    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20b4a17b-3459-4d57-9721-196dfa0deb3c-tmp\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.146178 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.146134    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20b4a17b-3459-4d57-9721-196dfa0deb3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.146178 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.146157    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgsgl\" (UniqueName: \"kubernetes.io/projected/20b4a17b-3459-4d57-9721-196dfa0deb3c-kube-api-access-mgsgl\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.146418 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.146187    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20b4a17b-3459-4d57-9721-196dfa0deb3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.146418 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.146316    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20b4a17b-3459-4d57-9721-196dfa0deb3c-manifests\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.146697 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.146676    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20b4a17b-3459-4d57-9721-196dfa0deb3c-manifests\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.148632 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.148608    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20b4a17b-3459-4d57-9721-196dfa0deb3c-tmp\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.148774 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.148757    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20b4a17b-3459-4d57-9721-196dfa0deb3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.148842 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.148822    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20b4a17b-3459-4d57-9721-196dfa0deb3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.165749 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.165708    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgsgl\" (UniqueName: \"kubernetes.io/projected/20b4a17b-3459-4d57-9721-196dfa0deb3c-kube-api-access-mgsgl\") pod \"opendatahub-operator-controller-manager-6c56689d88-96v6q\" (UID: \"20b4a17b-3459-4d57-9721-196dfa0deb3c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.200216 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.200173    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:36.359792 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:36.359760    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"]
Aug 01 00:33:36.362993 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:33:36.362957    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b4a17b_3459_4d57_9721_196dfa0deb3c.slice/crio-cc585d7439dc9dd8e135b76e9c8e9d09306b8b621c7fadbc5d7245b1be93fe06 WatchSource:0}: Error finding container cc585d7439dc9dd8e135b76e9c8e9d09306b8b621c7fadbc5d7245b1be93fe06: Status 404 returned error can't find the container with id cc585d7439dc9dd8e135b76e9c8e9d09306b8b621c7fadbc5d7245b1be93fe06
Aug 01 00:33:37.300323 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:37.300282    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q" event={"ID":"20b4a17b-3459-4d57-9721-196dfa0deb3c","Type":"ContainerStarted","Data":"cc585d7439dc9dd8e135b76e9c8e9d09306b8b621c7fadbc5d7245b1be93fe06"}
Aug 01 00:33:40.317183 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:40.317147    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q" event={"ID":"20b4a17b-3459-4d57-9721-196dfa0deb3c","Type":"ContainerStarted","Data":"42087832a44bc58a47dae3830ceb7a8d30f6736b1cb375cc257f1a0e7fc5bdb7"}
Aug 01 00:33:41.323492 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:41.323444    2547 generic.go:356] "Generic (PLEG): container finished" podID="20b4a17b-3459-4d57-9721-196dfa0deb3c" containerID="42087832a44bc58a47dae3830ceb7a8d30f6736b1cb375cc257f1a0e7fc5bdb7" exitCode=0
Aug 01 00:33:41.323914 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:41.323506    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q" event={"ID":"20b4a17b-3459-4d57-9721-196dfa0deb3c","Type":"ContainerDied","Data":"42087832a44bc58a47dae3830ceb7a8d30f6736b1cb375cc257f1a0e7fc5bdb7"}
Aug 01 00:33:42.329702 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:42.329669    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q" event={"ID":"20b4a17b-3459-4d57-9721-196dfa0deb3c","Type":"ContainerStarted","Data":"913a5457382af045b38ad48b609a68f17436d568e7a94285fe08032010a50cf6"}
Aug 01 00:33:42.330149 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:42.329764    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:42.350315 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:42.350262    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q" podStartSLOduration=3.039731777 podStartE2EDuration="7.350245092s" totalImagesPullingTime="3.26299199s" totalInitContainerRuntime="1.047521325s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:33:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:33:42.3482313 +0000 UTC m=+291.045400388" watchObservedRunningTime="2026-08-01 00:33:42.350245092 +0000 UTC m=+291.047414153"
Aug 01 00:33:51.737589 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:51.737558    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:33:51.747079 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:51.747046    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:33:51.749813 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:51.749782    2547 kubelet.go:1648] "Image garbage collection succeeded"
Aug 01 00:33:53.337201 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:53.337167    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c56689d88-96v6q"
Aug 01 00:33:55.385305 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.385269    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"]
Aug 01 00:33:55.389277 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.389248    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.392270 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.392239    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 01 00:33:55.392270 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.392256    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 01 00:33:55.392577 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.392430    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-29542\""
Aug 01 00:33:55.401806 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.401778    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"]
Aug 01 00:33:55.527239 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.527202    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5dmm\" (UniqueName: \"kubernetes.io/projected/ceae8985-d97e-498c-8dfc-0e78377e2701-kube-api-access-n5dmm\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.527432 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.527265    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceae8985-d97e-498c-8dfc-0e78377e2701-tls-certs\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.527432 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.527300    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ceae8985-d97e-498c-8dfc-0e78377e2701-tmp\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.608165 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.608123    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w7qdm"]
Aug 01 00:33:55.611461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.611443    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:33:55.613859 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.613833    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8sr7v\""
Aug 01 00:33:55.614041 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.613947    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 01 00:33:55.624326 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.624292    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w7qdm"]
Aug 01 00:33:55.628287 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.628247    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceae8985-d97e-498c-8dfc-0e78377e2701-tls-certs\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.628607 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.628577    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ceae8985-d97e-498c-8dfc-0e78377e2701-tmp\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.628748 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.628689    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5dmm\" (UniqueName: \"kubernetes.io/projected/ceae8985-d97e-498c-8dfc-0e78377e2701-kube-api-access-n5dmm\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.628748 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:33:55.628590    2547 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Aug 01 00:33:55.628951 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:33:55.628934    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceae8985-d97e-498c-8dfc-0e78377e2701-tls-certs podName:ceae8985-d97e-498c-8dfc-0e78377e2701 nodeName:}" failed. No retries permitted until 2026-08-01 00:33:56.12891004 +0000 UTC m=+304.826079086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ceae8985-d97e-498c-8dfc-0e78377e2701-tls-certs") pod "kube-auth-proxy-6db59d85d8-vzhv7" (UID: "ceae8985-d97e-498c-8dfc-0e78377e2701") : secret "kube-auth-proxy-tls" not found
Aug 01 00:33:55.630923 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.630898    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ceae8985-d97e-498c-8dfc-0e78377e2701-tmp\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.644210 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.644138    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5dmm\" (UniqueName: \"kubernetes.io/projected/ceae8985-d97e-498c-8dfc-0e78377e2701-kube-api-access-n5dmm\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:55.730038 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.729996    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb-cert\") pod \"odh-model-controller-7998c67dc4-w7qdm\" (UID: \"8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:33:55.730215 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.730048    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrtrt\" (UniqueName: \"kubernetes.io/projected/8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb-kube-api-access-xrtrt\") pod \"odh-model-controller-7998c67dc4-w7qdm\" (UID: \"8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:33:55.831432 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.831371    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb-cert\") pod \"odh-model-controller-7998c67dc4-w7qdm\" (UID: \"8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:33:55.831432 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.831441    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrtrt\" (UniqueName: \"kubernetes.io/projected/8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb-kube-api-access-xrtrt\") pod \"odh-model-controller-7998c67dc4-w7qdm\" (UID: \"8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:33:55.834073 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.834049    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb-cert\") pod \"odh-model-controller-7998c67dc4-w7qdm\" (UID: \"8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:33:55.842347 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.842311    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrtrt\" (UniqueName: \"kubernetes.io/projected/8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb-kube-api-access-xrtrt\") pod \"odh-model-controller-7998c67dc4-w7qdm\" (UID: \"8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb\") " pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:33:55.921987 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:55.921883    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:33:56.070809 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.070781    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w7qdm"]
Aug 01 00:33:56.076504 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:33:56.073649    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bddbbdb_9d58_4b4e_937a_1c5ea29cd4cb.slice/crio-a1a8de6e5c30505c4643a1dbc3a2d9aac18072bf004246ff3aca3cc5c04e4a0e WatchSource:0}: Error finding container a1a8de6e5c30505c4643a1dbc3a2d9aac18072bf004246ff3aca3cc5c04e4a0e: Status 404 returned error can't find the container with id a1a8de6e5c30505c4643a1dbc3a2d9aac18072bf004246ff3aca3cc5c04e4a0e
Aug 01 00:33:56.076504 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.075408    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 01 00:33:56.089390 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.089354    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mg8zz"]
Aug 01 00:33:56.093767 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.093747    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:33:56.096425 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.096398    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 01 00:33:56.104061 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.104029    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mg8zz"]
Aug 01 00:33:56.134685 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.134644    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceae8985-d97e-498c-8dfc-0e78377e2701-tls-certs\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:56.137108 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.137080    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ceae8985-d97e-498c-8dfc-0e78377e2701-tls-certs\") pod \"kube-auth-proxy-6db59d85d8-vzhv7\" (UID: \"ceae8985-d97e-498c-8dfc-0e78377e2701\") " pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:56.235305 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.235262    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2mv7\" (UniqueName: \"kubernetes.io/projected/75201471-272a-49d6-9dba-a68a7bec8941-kube-api-access-j2mv7\") pod \"model-serving-api-54d89bd5fc-mg8zz\" (UID: \"75201471-272a-49d6-9dba-a68a7bec8941\") " pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:33:56.235556 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.235318    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75201471-272a-49d6-9dba-a68a7bec8941-tls-certs\") pod \"model-serving-api-54d89bd5fc-mg8zz\" (UID: \"75201471-272a-49d6-9dba-a68a7bec8941\") " pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:33:56.302592 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.302551    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"
Aug 01 00:33:56.336876 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.336831    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2mv7\" (UniqueName: \"kubernetes.io/projected/75201471-272a-49d6-9dba-a68a7bec8941-kube-api-access-j2mv7\") pod \"model-serving-api-54d89bd5fc-mg8zz\" (UID: \"75201471-272a-49d6-9dba-a68a7bec8941\") " pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:33:56.337047 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.336896    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75201471-272a-49d6-9dba-a68a7bec8941-tls-certs\") pod \"model-serving-api-54d89bd5fc-mg8zz\" (UID: \"75201471-272a-49d6-9dba-a68a7bec8941\") " pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:33:56.339403 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.339379    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75201471-272a-49d6-9dba-a68a7bec8941-tls-certs\") pod \"model-serving-api-54d89bd5fc-mg8zz\" (UID: \"75201471-272a-49d6-9dba-a68a7bec8941\") " pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:33:56.349753 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.349713    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2mv7\" (UniqueName: \"kubernetes.io/projected/75201471-272a-49d6-9dba-a68a7bec8941-kube-api-access-j2mv7\") pod \"model-serving-api-54d89bd5fc-mg8zz\" (UID: \"75201471-272a-49d6-9dba-a68a7bec8941\") " pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:33:56.395329 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.395289    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm" event={"ID":"8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb","Type":"ContainerStarted","Data":"a1a8de6e5c30505c4643a1dbc3a2d9aac18072bf004246ff3aca3cc5c04e4a0e"}
Aug 01 00:33:56.406086 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.406044    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:33:56.453675 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.453597    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7"]
Aug 01 00:33:56.456162 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:33:56.456131    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceae8985_d97e_498c_8dfc_0e78377e2701.slice/crio-dcce1799fdb4c0882dacfe7b8307432c255a87a2dc07164d0cb4f71bf6a42c9d WatchSource:0}: Error finding container dcce1799fdb4c0882dacfe7b8307432c255a87a2dc07164d0cb4f71bf6a42c9d: Status 404 returned error can't find the container with id dcce1799fdb4c0882dacfe7b8307432c255a87a2dc07164d0cb4f71bf6a42c9d
Aug 01 00:33:56.562098 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.562071    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mg8zz"]
Aug 01 00:33:56.565322 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:33:56.565282    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75201471_272a_49d6_9dba_a68a7bec8941.slice/crio-daec74a5a744a98b55b5361b930a7e51e21289bc667b9e794e6b2c662d5391d1 WatchSource:0}: Error finding container daec74a5a744a98b55b5361b930a7e51e21289bc667b9e794e6b2c662d5391d1: Status 404 returned error can't find the container with id daec74a5a744a98b55b5361b930a7e51e21289bc667b9e794e6b2c662d5391d1
Aug 01 00:33:56.614273 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.614238    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"]
Aug 01 00:33:56.618745 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.618725    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.620859 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.620828    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 01 00:33:56.620985 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.620923    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 01 00:33:56.620985 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.620943    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 01 00:33:56.621073 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.621048    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g2w66\""
Aug 01 00:33:56.621172 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.621154    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 01 00:33:56.628024 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.628001    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"]
Aug 01 00:33:56.741434 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.741363    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.741648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.741459    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.741648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.741544    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1695adc4-6a58-40bf-8356-5f9d4bc8891b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.741648 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.741621    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.741789 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.741676    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.741789 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.741763    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.741897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.741804    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrxkn\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-kube-api-access-vrxkn\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.842784 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.842668    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.842784 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.842735    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.842784 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.842772    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1695adc4-6a58-40bf-8356-5f9d4bc8891b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.843070 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.842807    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.843070 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.842844    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.843070 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.842891    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.843070 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.842921    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrxkn\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-kube-api-access-vrxkn\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.843552 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.843515    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.846131 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.846103    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1695adc4-6a58-40bf-8356-5f9d4bc8891b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.846261 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.846133    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.847058 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.847030    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.847170 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.847095    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.851374 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.851343    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrxkn\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-kube-api-access-vrxkn\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.852334 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.852224    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-h4qkz\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:56.929114 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:56.929069    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:33:57.118285 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:57.117056    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"]
Aug 01 00:33:57.122410 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:33:57.122359    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1695adc4_6a58_40bf_8356_5f9d4bc8891b.slice/crio-8ffa112fb09b065154c7f30a4223c9f265c8f60a9976ab76f5f5e7b6ca83a9ca WatchSource:0}: Error finding container 8ffa112fb09b065154c7f30a4223c9f265c8f60a9976ab76f5f5e7b6ca83a9ca: Status 404 returned error can't find the container with id 8ffa112fb09b065154c7f30a4223c9f265c8f60a9976ab76f5f5e7b6ca83a9ca
Aug 01 00:33:57.404973 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:57.404834    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7" event={"ID":"ceae8985-d97e-498c-8dfc-0e78377e2701","Type":"ContainerStarted","Data":"dcce1799fdb4c0882dacfe7b8307432c255a87a2dc07164d0cb4f71bf6a42c9d"}
Aug 01 00:33:57.406997 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:57.406930    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz" event={"ID":"75201471-272a-49d6-9dba-a68a7bec8941","Type":"ContainerStarted","Data":"daec74a5a744a98b55b5361b930a7e51e21289bc667b9e794e6b2c662d5391d1"}
Aug 01 00:33:57.410351 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:33:57.410282    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz" event={"ID":"1695adc4-6a58-40bf-8356-5f9d4bc8891b","Type":"ContainerStarted","Data":"8ffa112fb09b065154c7f30a4223c9f265c8f60a9976ab76f5f5e7b6ca83a9ca"}
Aug 01 00:34:02.316156 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.316101    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:34:02.316554 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.316196    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:34:02.444154 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.444106    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7" event={"ID":"ceae8985-d97e-498c-8dfc-0e78377e2701","Type":"ContainerStarted","Data":"78c4a90a6b0bafbe8503cbdb678db67d0801ddb2b770af054f7fce302b9354bf"}
Aug 01 00:34:02.446225 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.446195    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm" event={"ID":"8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb","Type":"ContainerStarted","Data":"9cfb6f72d32aabf1f0f0ff458f9d21c2ab150301a86f45cce57e3954912c3fd2"}
Aug 01 00:34:02.446377 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.446279    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:34:02.447833 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.447800    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz" event={"ID":"75201471-272a-49d6-9dba-a68a7bec8941","Type":"ContainerStarted","Data":"51a39f46480da1927f4c2dc36d883039b1502878d5486c5917c403fe744d2f30"}
Aug 01 00:34:02.447971 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.447909    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:34:02.449661 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.449636    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz" event={"ID":"1695adc4-6a58-40bf-8356-5f9d4bc8891b","Type":"ContainerStarted","Data":"9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1"}
Aug 01 00:34:02.449785 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.449765    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:34:02.465128 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.465076    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6db59d85d8-vzhv7" podStartSLOduration=1.687257114 podStartE2EDuration="7.465059354s" totalImagesPullingTime="5.77780224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:34:02.463799039 +0000 UTC m=+311.160968117" watchObservedRunningTime="2026-08-01 00:34:02.465059354 +0000 UTC m=+311.162228415"
Aug 01 00:34:02.486466 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.486008    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz" podStartSLOduration=1.295179875 podStartE2EDuration="6.485986014s" totalImagesPullingTime="5.190806139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:34:02.485769291 +0000 UTC m=+311.182938358" watchObservedRunningTime="2026-08-01 00:34:02.485986014 +0000 UTC m=+311.183155060"
Aug 01 00:34:02.506707 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:02.506635    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm" podStartSLOduration=1.347166456 podStartE2EDuration="7.506612053s" totalImagesPullingTime="6.159445597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:34:02.504558545 +0000 UTC m=+311.201727608" watchObservedRunningTime="2026-08-01 00:34:02.506612053 +0000 UTC m=+311.203781116"
Aug 01 00:34:03.456340 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:03.456288    2547 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-h4qkz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 01 00:34:03.456749 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:03.456355    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz" podUID="1695adc4-6a58-40bf-8356-5f9d4bc8891b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 01 00:34:04.124107 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.124052    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz" podStartSLOduration=2.455646626 podStartE2EDuration="8.124032906s" totalImagesPullingTime="5.66838628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:34:02.528886148 +0000 UTC m=+311.226055212" watchObservedRunningTime="2026-08-01 00:34:04.124032906 +0000 UTC m=+312.821201968"
Aug 01 00:34:04.124283 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.124190    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"]
Aug 01 00:34:04.127883 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.127863    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.130249 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.130228    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n84tx\""
Aug 01 00:34:04.142580 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.142548    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"]
Aug 01 00:34:04.221601 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221553    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.221777 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221654    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnf65\" (UniqueName: \"kubernetes.io/projected/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-kube-api-access-mnf65\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.221777 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221700    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.221777 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221722    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.221889 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221789    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.221889 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221839    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.221889 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221862    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.221889 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221884    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.222023 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.221924    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.322533 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322472    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.322741 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322594    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnf65\" (UniqueName: \"kubernetes.io/projected/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-kube-api-access-mnf65\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.322741 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322638    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.322741 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322656    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.322741 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322701    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.322741 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322729    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.323024 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322751    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.323024 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322799    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.323024 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322840    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.323024 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.322970    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.323226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.323146    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.323284 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.323231    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.323335 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.323322    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.323537 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.323516    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.325401 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.325363    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.325663 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.325641    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.336069 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.336001    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnf65\" (UniqueName: \"kubernetes.io/projected/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-kube-api-access-mnf65\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.336585 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.336563    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cef13b1c-89e2-40cf-ae1f-d2bc88bab124-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq\" (UID: \"cef13b1c-89e2-40cf-ae1f-d2bc88bab124\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.438274 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.438179    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:04.588211 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:04.588176    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"]
Aug 01 00:34:04.591554 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:34:04.591522    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef13b1c_89e2_40cf_ae1f_d2bc88bab124.slice/crio-483fd669714aff74fa768537a2d1514702b005e9414cd3191f955a1829dec89c WatchSource:0}: Error finding container 483fd669714aff74fa768537a2d1514702b005e9414cd3191f955a1829dec89c: Status 404 returned error can't find the container with id 483fd669714aff74fa768537a2d1514702b005e9414cd3191f955a1829dec89c
Aug 01 00:34:05.469257 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.469204    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq" event={"ID":"cef13b1c-89e2-40cf-ae1f-d2bc88bab124","Type":"ContainerStarted","Data":"483fd669714aff74fa768537a2d1514702b005e9414cd3191f955a1829dec89c"}
Aug 01 00:34:05.719178 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.719146    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r2522"]
Aug 01 00:34:05.722873 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.722807    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:05.727306 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.727279    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4m7dv\""
Aug 01 00:34:05.727444 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.727281    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 01 00:34:05.741735 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.741645    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r2522"]
Aug 01 00:34:05.743887 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.743858    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"]
Aug 01 00:34:05.748410 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.748384    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:05.750985 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.750959    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4625c\""
Aug 01 00:34:05.751609 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.751582    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 01 00:34:05.755949 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.755921    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"]
Aug 01 00:34:05.839588 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.839417    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktczq\" (UniqueName: \"kubernetes.io/projected/9bcba17e-63e7-4dd8-b5e6-72c72275d59f-kube-api-access-ktczq\") pod \"kserve-controller-manager-d6f4b65b8-r2522\" (UID: \"9bcba17e-63e7-4dd8-b5e6-72c72275d59f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:05.839588 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.839525    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98133ebe-7180-4352-8a49-c26879bd13db-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4vnbh\" (UID: \"98133ebe-7180-4352-8a49-c26879bd13db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:05.839824 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.839597    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgsw\" (UniqueName: \"kubernetes.io/projected/98133ebe-7180-4352-8a49-c26879bd13db-kube-api-access-rzgsw\") pod \"llmisvc-controller-manager-777c6bd7d5-4vnbh\" (UID: \"98133ebe-7180-4352-8a49-c26879bd13db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:05.839824 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.839623    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bcba17e-63e7-4dd8-b5e6-72c72275d59f-cert\") pod \"kserve-controller-manager-d6f4b65b8-r2522\" (UID: \"9bcba17e-63e7-4dd8-b5e6-72c72275d59f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:05.940502 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.940439    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98133ebe-7180-4352-8a49-c26879bd13db-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4vnbh\" (UID: \"98133ebe-7180-4352-8a49-c26879bd13db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:05.940678 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.940548    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgsw\" (UniqueName: \"kubernetes.io/projected/98133ebe-7180-4352-8a49-c26879bd13db-kube-api-access-rzgsw\") pod \"llmisvc-controller-manager-777c6bd7d5-4vnbh\" (UID: \"98133ebe-7180-4352-8a49-c26879bd13db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:05.940678 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.940578    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bcba17e-63e7-4dd8-b5e6-72c72275d59f-cert\") pod \"kserve-controller-manager-d6f4b65b8-r2522\" (UID: \"9bcba17e-63e7-4dd8-b5e6-72c72275d59f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:05.940678 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.940664    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktczq\" (UniqueName: \"kubernetes.io/projected/9bcba17e-63e7-4dd8-b5e6-72c72275d59f-kube-api-access-ktczq\") pod \"kserve-controller-manager-d6f4b65b8-r2522\" (UID: \"9bcba17e-63e7-4dd8-b5e6-72c72275d59f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:05.944011 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.943948    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bcba17e-63e7-4dd8-b5e6-72c72275d59f-cert\") pod \"kserve-controller-manager-d6f4b65b8-r2522\" (UID: \"9bcba17e-63e7-4dd8-b5e6-72c72275d59f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:05.944163 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.944048    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98133ebe-7180-4352-8a49-c26879bd13db-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4vnbh\" (UID: \"98133ebe-7180-4352-8a49-c26879bd13db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:05.954157 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.953694    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktczq\" (UniqueName: \"kubernetes.io/projected/9bcba17e-63e7-4dd8-b5e6-72c72275d59f-kube-api-access-ktczq\") pod \"kserve-controller-manager-d6f4b65b8-r2522\" (UID: \"9bcba17e-63e7-4dd8-b5e6-72c72275d59f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:05.954157 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:05.954088    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgsw\" (UniqueName: \"kubernetes.io/projected/98133ebe-7180-4352-8a49-c26879bd13db-kube-api-access-rzgsw\") pod \"llmisvc-controller-manager-777c6bd7d5-4vnbh\" (UID: \"98133ebe-7180-4352-8a49-c26879bd13db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:06.036766 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:06.036667    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:06.065678 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:06.065159    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:06.222953 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:06.222915    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r2522"]
Aug 01 00:34:06.223377 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:34:06.223342    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcba17e_63e7_4dd8_b5e6_72c72275d59f.slice/crio-635b359017d52edd8f4bf656618029e9e87cdae4a0cb001f4ed008693a282456 WatchSource:0}: Error finding container 635b359017d52edd8f4bf656618029e9e87cdae4a0cb001f4ed008693a282456: Status 404 returned error can't find the container with id 635b359017d52edd8f4bf656618029e9e87cdae4a0cb001f4ed008693a282456
Aug 01 00:34:06.266541 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:06.266509    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"]
Aug 01 00:34:06.269160 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:34:06.269132    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod98133ebe_7180_4352_8a49_c26879bd13db.slice/crio-5939e6fcf7c8caf351a2052c62c93c8d9d6c7c415597b922f0b0dd1d86717dd4 WatchSource:0}: Error finding container 5939e6fcf7c8caf351a2052c62c93c8d9d6c7c415597b922f0b0dd1d86717dd4: Status 404 returned error can't find the container with id 5939e6fcf7c8caf351a2052c62c93c8d9d6c7c415597b922f0b0dd1d86717dd4
Aug 01 00:34:06.455370 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:06.455284    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:34:06.476531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:06.476050    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522" event={"ID":"9bcba17e-63e7-4dd8-b5e6-72c72275d59f","Type":"ContainerStarted","Data":"635b359017d52edd8f4bf656618029e9e87cdae4a0cb001f4ed008693a282456"}
Aug 01 00:34:06.477698 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:06.477662    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh" event={"ID":"98133ebe-7180-4352-8a49-c26879bd13db","Type":"ContainerStarted","Data":"5939e6fcf7c8caf351a2052c62c93c8d9d6c7c415597b922f0b0dd1d86717dd4"}
Aug 01 00:34:07.211361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.211323    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"]
Aug 01 00:34:07.211851 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.211569    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz" podUID="1695adc4-6a58-40bf-8356-5f9d4bc8891b" containerName="discovery" containerID="cri-o://9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1" gracePeriod=30
Aug 01 00:34:07.680745 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.680688    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:34:07.680883 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.680775    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:34:07.680883 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.680808    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:34:07.775497 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.775452    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:34:07.857934 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.857867    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-dns-cert\") pod \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") "
Aug 01 00:34:07.858187 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.857939    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-kubeconfig\") pod \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") "
Aug 01 00:34:07.858187 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.857975    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-token\") pod \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") "
Aug 01 00:34:07.858187 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.858045    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-cacerts\") pod \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") "
Aug 01 00:34:07.858187 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.858073    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrxkn\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-kube-api-access-vrxkn\") pod \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") "
Aug 01 00:34:07.858187 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.858183    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1695adc4-6a58-40bf-8356-5f9d4bc8891b-local-certs\") pod \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") "
Aug 01 00:34:07.858461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.858243    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-ca-configmap\") pod \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\" (UID: \"1695adc4-6a58-40bf-8356-5f9d4bc8891b\") "
Aug 01 00:34:07.859166 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.858913    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1695adc4-6a58-40bf-8356-5f9d4bc8891b" (UID: "1695adc4-6a58-40bf-8356-5f9d4bc8891b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:34:07.862750 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.862680    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1695adc4-6a58-40bf-8356-5f9d4bc8891b" (UID: "1695adc4-6a58-40bf-8356-5f9d4bc8891b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:34:07.863052 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.863014    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-token" (OuterVolumeSpecName: "istio-token") pod "1695adc4-6a58-40bf-8356-5f9d4bc8891b" (UID: "1695adc4-6a58-40bf-8356-5f9d4bc8891b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:34:07.863052 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.863025    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-kube-api-access-vrxkn" (OuterVolumeSpecName: "kube-api-access-vrxkn") pod "1695adc4-6a58-40bf-8356-5f9d4bc8891b" (UID: "1695adc4-6a58-40bf-8356-5f9d4bc8891b"). InnerVolumeSpecName "kube-api-access-vrxkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:34:07.863548 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.863507    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1695adc4-6a58-40bf-8356-5f9d4bc8891b-local-certs" (OuterVolumeSpecName: "local-certs") pod "1695adc4-6a58-40bf-8356-5f9d4bc8891b" (UID: "1695adc4-6a58-40bf-8356-5f9d4bc8891b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:34:07.864080 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.863781    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-cacerts" (OuterVolumeSpecName: "cacerts") pod "1695adc4-6a58-40bf-8356-5f9d4bc8891b" (UID: "1695adc4-6a58-40bf-8356-5f9d4bc8891b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:34:07.864627 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.864602    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1695adc4-6a58-40bf-8356-5f9d4bc8891b" (UID: "1695adc4-6a58-40bf-8356-5f9d4bc8891b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:34:07.960096 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.959958    2547 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-cacerts\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:34:07.960096 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.959998    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrxkn\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-kube-api-access-vrxkn\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:34:07.960096 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.960015    2547 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1695adc4-6a58-40bf-8356-5f9d4bc8891b-local-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:34:07.960096 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.960030    2547 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-ca-configmap\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:34:07.960096 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.960043    2547 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-csr-dns-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:34:07.960096 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.960056    2547 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-kubeconfig\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:34:07.960096 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:07.960068    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1695adc4-6a58-40bf-8356-5f9d4bc8891b-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:34:08.497723 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.497686    2547 generic.go:356] "Generic (PLEG): container finished" podID="1695adc4-6a58-40bf-8356-5f9d4bc8891b" containerID="9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1" exitCode=0
Aug 01 00:34:08.498196 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.497791    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"
Aug 01 00:34:08.498196 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.497839    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz" event={"ID":"1695adc4-6a58-40bf-8356-5f9d4bc8891b","Type":"ContainerDied","Data":"9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1"}
Aug 01 00:34:08.498196 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.497905    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz" event={"ID":"1695adc4-6a58-40bf-8356-5f9d4bc8891b","Type":"ContainerDied","Data":"8ffa112fb09b065154c7f30a4223c9f265c8f60a9976ab76f5f5e7b6ca83a9ca"}
Aug 01 00:34:08.498196 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.497937    2547 scope.go:117] "RemoveContainer" containerID="9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1"
Aug 01 00:34:08.503999 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.503962    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq" event={"ID":"cef13b1c-89e2-40cf-ae1f-d2bc88bab124","Type":"ContainerStarted","Data":"6555c6ec5f503376434b1850390edd416f655e32d6f42912418db31c73dd9269"}
Aug 01 00:34:08.516401 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.516359    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"]
Aug 01 00:34:08.520551 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.520519    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-h4qkz"]
Aug 01 00:34:08.539228 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.539163    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq" podStartSLOduration=1.452425768 podStartE2EDuration="4.539140225s" totalImagesPullingTime="3.086714457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:34:08.537520346 +0000 UTC m=+317.234689410" watchObservedRunningTime="2026-08-01 00:34:08.539140225 +0000 UTC m=+317.236309288"
Aug 01 00:34:08.615106 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.615073    2547 scope.go:117] "RemoveContainer" containerID="9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1"
Aug 01 00:34:08.615667 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:34:08.615634    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1\": container with ID starting with 9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1 not found: ID does not exist" containerID="9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1"
Aug 01 00:34:08.615767 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:08.615682    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1"} err="failed to get container status \"9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1\": rpc error: code = NotFound desc = could not find container \"9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1\": container with ID starting with 9470df8a5ec1351bb16c8e7b94e90532ac77e2a4e1bcd364fea552e92b5878c1 not found: ID does not exist"
Aug 01 00:34:09.438957 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:09.438909    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:09.445718 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:09.445682    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:09.512238 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:09.512162    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:09.513568 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:09.513544    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq"
Aug 01 00:34:09.882782 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:09.882746    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1695adc4-6a58-40bf-8356-5f9d4bc8891b" path="/var/lib/kubelet/pods/1695adc4-6a58-40bf-8356-5f9d4bc8891b/volumes"
Aug 01 00:34:10.518556 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:10.518511    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh" event={"ID":"98133ebe-7180-4352-8a49-c26879bd13db","Type":"ContainerStarted","Data":"3959a73ac8f1956d5b2a795470623c1695999def751f5438025c32f6c512949a"}
Aug 01 00:34:10.518968 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:10.518581    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:10.520246 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:10.520218    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522" event={"ID":"9bcba17e-63e7-4dd8-b5e6-72c72275d59f","Type":"ContainerStarted","Data":"0e26f97d4f73450032324efaf57609f37998ab61cf0d4262db58863b721bb2b2"}
Aug 01 00:34:10.534117 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:10.534064    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh" podStartSLOduration=1.515775925 podStartE2EDuration="5.534047474s" totalImagesPullingTime="4.018271549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:34:10.532619767 +0000 UTC m=+319.229788830" watchObservedRunningTime="2026-08-01 00:34:10.534047474 +0000 UTC m=+319.231216536"
Aug 01 00:34:10.547513 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:10.547383    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522" podStartSLOduration=2.2027835590000002 podStartE2EDuration="5.547367063s" totalImagesPullingTime="3.344583504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:34:10.546805388 +0000 UTC m=+319.243974452" watchObservedRunningTime="2026-08-01 00:34:10.547367063 +0000 UTC m=+319.244536164"
Aug 01 00:34:11.525280 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:11.525246    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:34:13.456674 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:13.456630    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-w7qdm"
Aug 01 00:34:13.460066 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:13.460039    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-mg8zz"
Aug 01 00:34:41.527809 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:41.527775    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4vnbh"
Aug 01 00:34:42.536823 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:34:42.536790    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r2522"
Aug 01 00:35:17.142337 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.142297    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"]
Aug 01 00:35:17.142804 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.142702    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1695adc4-6a58-40bf-8356-5f9d4bc8891b" containerName="discovery"
Aug 01 00:35:17.142804 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.142715    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1695adc4-6a58-40bf-8356-5f9d4bc8891b" containerName="discovery"
Aug 01 00:35:17.142804 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.142796    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1695adc4-6a58-40bf-8356-5f9d4bc8891b" containerName="discovery"
Aug 01 00:35:17.145835 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.145819    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"
Aug 01 00:35:17.148079 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.148047    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 01 00:35:17.148221 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.148083    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 01 00:35:17.148221 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.148138    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mr9vm\""
Aug 01 00:35:17.148221 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.148144    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 01 00:35:17.157507 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.157487    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"]
Aug 01 00:35:17.253341 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.253318    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhhwr\" (UniqueName: \"kubernetes.io/projected/3006f723-6ec2-4db8-abab-f9f49c02f47c-kube-api-access-fhhwr\") pod \"dns-operator-controller-manager-5985564776-96bk4\" (UID: \"3006f723-6ec2-4db8-abab-f9f49c02f47c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"
Aug 01 00:35:17.354712 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.354690    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhwr\" (UniqueName: \"kubernetes.io/projected/3006f723-6ec2-4db8-abab-f9f49c02f47c-kube-api-access-fhhwr\") pod \"dns-operator-controller-manager-5985564776-96bk4\" (UID: \"3006f723-6ec2-4db8-abab-f9f49c02f47c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"
Aug 01 00:35:17.363728 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.363710    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhhwr\" (UniqueName: \"kubernetes.io/projected/3006f723-6ec2-4db8-abab-f9f49c02f47c-kube-api-access-fhhwr\") pod \"dns-operator-controller-manager-5985564776-96bk4\" (UID: \"3006f723-6ec2-4db8-abab-f9f49c02f47c\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"
Aug 01 00:35:17.455257 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.455200    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"
Aug 01 00:35:17.591115 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.591091    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"]
Aug 01 00:35:17.593885 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:35:17.593855    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3006f723_6ec2_4db8_abab_f9f49c02f47c.slice/crio-cb050a608e5a7fe322c8606b4a281ae3d3025fd68e3ac4d81d3e3ae15b8579a6 WatchSource:0}: Error finding container cb050a608e5a7fe322c8606b4a281ae3d3025fd68e3ac4d81d3e3ae15b8579a6: Status 404 returned error can't find the container with id cb050a608e5a7fe322c8606b4a281ae3d3025fd68e3ac4d81d3e3ae15b8579a6
Aug 01 00:35:17.845867 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:17.845841    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4" event={"ID":"3006f723-6ec2-4db8-abab-f9f49c02f47c","Type":"ContainerStarted","Data":"cb050a608e5a7fe322c8606b4a281ae3d3025fd68e3ac4d81d3e3ae15b8579a6"}
Aug 01 00:35:19.345472 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.345425    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57669c5d78-t8dnt"]
Aug 01 00:35:19.349973 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.349941    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.360996 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.360912    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57669c5d78-t8dnt"]
Aug 01 00:35:19.374473 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.374440    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-config\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.374646 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.374616    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-serving-cert\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.374766 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.374660    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-service-ca\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.374766 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.374697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djhjt\" (UniqueName: \"kubernetes.io/projected/a19dc22e-204d-4607-af7f-3ac73a366d1e-kube-api-access-djhjt\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.374766 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.374738    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-oauth-config\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.374963 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.374771    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-trusted-ca-bundle\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.374963 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.374799    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-oauth-serving-cert\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.476226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.476196    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-oauth-config\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.476437 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.476241    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-trusted-ca-bundle\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.476437 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.476281    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-oauth-serving-cert\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.476437 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.476340    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-config\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.476645 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.476527    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-serving-cert\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.476645 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.476587    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-service-ca\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.476755 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.476630    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djhjt\" (UniqueName: \"kubernetes.io/projected/a19dc22e-204d-4607-af7f-3ac73a366d1e-kube-api-access-djhjt\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.477170 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.477148    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-config\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.477356 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.477311    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-service-ca\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.477444 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.477386    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-oauth-serving-cert\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.477531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.477463    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19dc22e-204d-4607-af7f-3ac73a366d1e-trusted-ca-bundle\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.479520 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.479474    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-serving-cert\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.479520 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.479513    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a19dc22e-204d-4607-af7f-3ac73a366d1e-console-oauth-config\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.485654 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.485626    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djhjt\" (UniqueName: \"kubernetes.io/projected/a19dc22e-204d-4607-af7f-3ac73a366d1e-kube-api-access-djhjt\") pod \"console-57669c5d78-t8dnt\" (UID: \"a19dc22e-204d-4607-af7f-3ac73a366d1e\") " pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:19.666441 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:19.666354    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:20.786616 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:20.786595    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57669c5d78-t8dnt"]
Aug 01 00:35:20.788217 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:35:20.788185    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19dc22e_204d_4607_af7f_3ac73a366d1e.slice/crio-d472ebd434dcb08549c685c368f1301d78ed6905a5a0adee5f5da4b1bb45a606 WatchSource:0}: Error finding container d472ebd434dcb08549c685c368f1301d78ed6905a5a0adee5f5da4b1bb45a606: Status 404 returned error can't find the container with id d472ebd434dcb08549c685c368f1301d78ed6905a5a0adee5f5da4b1bb45a606
Aug 01 00:35:20.864740 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:20.864703    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4" event={"ID":"3006f723-6ec2-4db8-abab-f9f49c02f47c","Type":"ContainerStarted","Data":"a249c8b403eb5a03f2f3aac73a3cd333887c03335c8bb48d95836401ae35be2b"}
Aug 01 00:35:20.865033 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:20.864962    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"
Aug 01 00:35:20.866407 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:20.866382    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57669c5d78-t8dnt" event={"ID":"a19dc22e-204d-4607-af7f-3ac73a366d1e","Type":"ContainerStarted","Data":"c556ad158579292dc811afda30802c641d559f9950fa06735296c91068885314"}
Aug 01 00:35:20.866522 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:20.866432    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57669c5d78-t8dnt" event={"ID":"a19dc22e-204d-4607-af7f-3ac73a366d1e","Type":"ContainerStarted","Data":"d472ebd434dcb08549c685c368f1301d78ed6905a5a0adee5f5da4b1bb45a606"}
Aug 01 00:35:20.961006 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:20.960905    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4" podStartSLOduration=0.831777808 podStartE2EDuration="3.960886199s" totalImagesPullingTime="3.129108391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:35:20.910567143 +0000 UTC m=+389.607736205" watchObservedRunningTime="2026-08-01 00:35:20.960886199 +0000 UTC m=+389.658055261"
Aug 01 00:35:20.961522 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:20.961471    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57669c5d78-t8dnt" podStartSLOduration=1.961460457 podStartE2EDuration="1.961460457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:35:20.959129603 +0000 UTC m=+389.656298667" watchObservedRunningTime="2026-08-01 00:35:20.961460457 +0000 UTC m=+389.658629594"
Aug 01 00:35:21.272098 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.272065    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-qx9k2"]
Aug 01 00:35:21.275639 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.275596    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2"
Aug 01 00:35:21.278377 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.278353    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rzr46\""
Aug 01 00:35:21.289385 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.289361    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-qx9k2"]
Aug 01 00:35:21.395001 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.394968    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-457q6\" (UniqueName: \"kubernetes.io/projected/9e1dc749-58ac-4ccf-b027-26583ea9e85b-kube-api-access-457q6\") pod \"authorino-operator-68d88948d8-qx9k2\" (UID: \"9e1dc749-58ac-4ccf-b027-26583ea9e85b\") " pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2"
Aug 01 00:35:21.496064 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.496030    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-457q6\" (UniqueName: \"kubernetes.io/projected/9e1dc749-58ac-4ccf-b027-26583ea9e85b-kube-api-access-457q6\") pod \"authorino-operator-68d88948d8-qx9k2\" (UID: \"9e1dc749-58ac-4ccf-b027-26583ea9e85b\") " pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2"
Aug 01 00:35:21.503510 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.503469    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-457q6\" (UniqueName: \"kubernetes.io/projected/9e1dc749-58ac-4ccf-b027-26583ea9e85b-kube-api-access-457q6\") pod \"authorino-operator-68d88948d8-qx9k2\" (UID: \"9e1dc749-58ac-4ccf-b027-26583ea9e85b\") " pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2"
Aug 01 00:35:21.585857 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.585783    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2"
Aug 01 00:35:21.715344 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.715317    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-qx9k2"]
Aug 01 00:35:21.717234 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:35:21.717210    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1dc749_58ac_4ccf_b027_26583ea9e85b.slice/crio-272b59ee1e023502e86e2073a4618a02266ff1724b93f605c3c8ef10a8403953 WatchSource:0}: Error finding container 272b59ee1e023502e86e2073a4618a02266ff1724b93f605c3c8ef10a8403953: Status 404 returned error can't find the container with id 272b59ee1e023502e86e2073a4618a02266ff1724b93f605c3c8ef10a8403953
Aug 01 00:35:21.872893 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:21.872799    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2" event={"ID":"9e1dc749-58ac-4ccf-b027-26583ea9e85b","Type":"ContainerStarted","Data":"272b59ee1e023502e86e2073a4618a02266ff1724b93f605c3c8ef10a8403953"}
Aug 01 00:35:23.884357 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:23.884263    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2" event={"ID":"9e1dc749-58ac-4ccf-b027-26583ea9e85b","Type":"ContainerStarted","Data":"61e82dbcfc4148088e50857a39ef286335ce863372a890934bc8f7af7ec01a6f"}
Aug 01 00:35:23.884357 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:23.884340    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2"
Aug 01 00:35:23.909799 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:23.909720    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2" podStartSLOduration=1.04785399 podStartE2EDuration="2.909706204s" totalImagesPullingTime="1.861852214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:35:23.908076793 +0000 UTC m=+392.605245856" watchObservedRunningTime="2026-08-01 00:35:23.909706204 +0000 UTC m=+392.606875266"
Aug 01 00:35:27.743992 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.743950    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"]
Aug 01 00:35:27.747710 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.747687    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:27.750832 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.750807    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dnhvv\""
Aug 01 00:35:27.760043 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.760011    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"]
Aug 01 00:35:27.859098 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.859052    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsfpg\" (UniqueName: \"kubernetes.io/projected/1d8098f2-d3b3-411a-8d16-d901134d315c-kube-api-access-tsfpg\") pod \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" (UID: \"1d8098f2-d3b3-411a-8d16-d901134d315c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:27.859275 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.859147    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d8098f2-d3b3-411a-8d16-d901134d315c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" (UID: \"1d8098f2-d3b3-411a-8d16-d901134d315c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:27.960132 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.960090    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsfpg\" (UniqueName: \"kubernetes.io/projected/1d8098f2-d3b3-411a-8d16-d901134d315c-kube-api-access-tsfpg\") pod \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" (UID: \"1d8098f2-d3b3-411a-8d16-d901134d315c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:27.960349 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.960307    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d8098f2-d3b3-411a-8d16-d901134d315c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" (UID: \"1d8098f2-d3b3-411a-8d16-d901134d315c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:27.960746 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.960722    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d8098f2-d3b3-411a-8d16-d901134d315c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" (UID: \"1d8098f2-d3b3-411a-8d16-d901134d315c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:27.972256 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:27.972220    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsfpg\" (UniqueName: \"kubernetes.io/projected/1d8098f2-d3b3-411a-8d16-d901134d315c-kube-api-access-tsfpg\") pod \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" (UID: \"1d8098f2-d3b3-411a-8d16-d901134d315c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:28.058693 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:28.058597    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:28.217126 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:28.217093    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"]
Aug 01 00:35:28.220027 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:35:28.219995    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8098f2_d3b3_411a_8d16_d901134d315c.slice/crio-cd9df13577a1fad7e484aa8514e8aa98042b1107f2cdbbc437ae313aa8d1746d WatchSource:0}: Error finding container cd9df13577a1fad7e484aa8514e8aa98042b1107f2cdbbc437ae313aa8d1746d: Status 404 returned error can't find the container with id cd9df13577a1fad7e484aa8514e8aa98042b1107f2cdbbc437ae313aa8d1746d
Aug 01 00:35:28.920705 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:28.920667    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl" event={"ID":"1d8098f2-d3b3-411a-8d16-d901134d315c","Type":"ContainerStarted","Data":"cd9df13577a1fad7e484aa8514e8aa98042b1107f2cdbbc437ae313aa8d1746d"}
Aug 01 00:35:29.666863 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:29.666823    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:29.667054 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:29.666893    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:29.671542 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:29.671504    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:29.930756 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:29.930667    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57669c5d78-t8dnt"
Aug 01 00:35:29.989935 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:29.989840    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5989cdc876-fwwjl"]
Aug 01 00:35:31.375022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.374985    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"]
Aug 01 00:35:31.378762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.378730    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:31.381372 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.381344    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lm9t8\""
Aug 01 00:35:31.394445 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.394407    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"]
Aug 01 00:35:31.499758 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.499717    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z964\" (UniqueName: \"kubernetes.io/projected/e5665aeb-e06c-44a9-bd01-fc662f4de81a-kube-api-access-9z964\") pod \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" (UID: \"e5665aeb-e06c-44a9-bd01-fc662f4de81a\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:31.600590 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.600555    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z964\" (UniqueName: \"kubernetes.io/projected/e5665aeb-e06c-44a9-bd01-fc662f4de81a-kube-api-access-9z964\") pod \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" (UID: \"e5665aeb-e06c-44a9-bd01-fc662f4de81a\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:31.611666 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.611630    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z964\" (UniqueName: \"kubernetes.io/projected/e5665aeb-e06c-44a9-bd01-fc662f4de81a-kube-api-access-9z964\") pod \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" (UID: \"e5665aeb-e06c-44a9-bd01-fc662f4de81a\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:31.692987 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.692889    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:31.858288 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.858259    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"]
Aug 01 00:35:31.860590 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:35:31.860558    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5665aeb_e06c_44a9_bd01_fc662f4de81a.slice/crio-bf01a542db2f36c732ae28e745a467504faaa13af05ba3474a141490f7d55692 WatchSource:0}: Error finding container bf01a542db2f36c732ae28e745a467504faaa13af05ba3474a141490f7d55692: Status 404 returned error can't find the container with id bf01a542db2f36c732ae28e745a467504faaa13af05ba3474a141490f7d55692
Aug 01 00:35:31.882401 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.882363    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-96bk4"
Aug 01 00:35:31.938977 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:31.938933    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s" event={"ID":"e5665aeb-e06c-44a9-bd01-fc662f4de81a","Type":"ContainerStarted","Data":"bf01a542db2f36c732ae28e745a467504faaa13af05ba3474a141490f7d55692"}
Aug 01 00:35:33.951746 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:33.951704    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl" event={"ID":"1d8098f2-d3b3-411a-8d16-d901134d315c","Type":"ContainerStarted","Data":"bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044"}
Aug 01 00:35:33.952261 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:33.951779    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:33.969286 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:33.969221    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl" podStartSLOduration=1.827312929 podStartE2EDuration="6.969200933s" totalImagesPullingTime="5.141888004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:35:33.968337443 +0000 UTC m=+402.665506505" watchObservedRunningTime="2026-08-01 00:35:33.969200933 +0000 UTC m=+402.666369997"
Aug 01 00:35:34.892065 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:34.891983    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-qx9k2"
Aug 01 00:35:34.958798 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:34.958764    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s" event={"ID":"e5665aeb-e06c-44a9-bd01-fc662f4de81a","Type":"ContainerStarted","Data":"f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7"}
Aug 01 00:35:34.974174 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:34.974114    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s" podStartSLOduration=1.308016924 podStartE2EDuration="3.974096055s" totalImagesPullingTime="2.666079131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:35:34.972850924 +0000 UTC m=+403.670020079" watchObservedRunningTime="2026-08-01 00:35:34.974096055 +0000 UTC m=+403.671265116"
Aug 01 00:35:35.964466 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:35.964434    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:44.961423 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:44.961383    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.533600 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.533562    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"]
Aug 01 00:35:46.534059 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.533742    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" containerName="manager" containerID="cri-o://bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044" gracePeriod=2
Aug 01 00:35:46.536497 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.536450    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.538093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.538066    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"]
Aug 01 00:35:46.560360 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.560327    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"]
Aug 01 00:35:46.560891 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.560690    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" containerName="manager" containerID="cri-o://f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7" gracePeriod=2
Aug 01 00:35:46.562650 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.562590    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:46.563019 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.562978    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.565377 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.565351    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"]
Aug 01 00:35:46.565516 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.565412    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:46.569541 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.569459    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:46.571199 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.571169    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.572310 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.572284    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"]
Aug 01 00:35:46.572955 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.572930    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" containerName="manager"
Aug 01 00:35:46.573052 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.572959    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" containerName="manager"
Aug 01 00:35:46.573052 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.573009    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" containerName="manager"
Aug 01 00:35:46.573052 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.573018    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" containerName="manager"
Aug 01 00:35:46.573202 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.573111    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" containerName="manager"
Aug 01 00:35:46.573202 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.573127    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" containerName="manager"
Aug 01 00:35:46.576765 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.576743    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:46.578703 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.578669    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:46.585548 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.585515    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"]
Aug 01 00:35:46.589826 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.589798    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"
Aug 01 00:35:46.590627 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.590598    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"]
Aug 01 00:35:46.600243 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.600208    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"]
Aug 01 00:35:46.603529 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.603472    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.605428 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.605384    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:46.623287 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.623237    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.750342 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.750296    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdfa53a7-6ecb-474d-8228-791e215a4533-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fvfq7\" (UID: \"cdfa53a7-6ecb-474d-8228-791e215a4533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:46.750575 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.750360    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kgtv\" (UniqueName: \"kubernetes.io/projected/83eb1d46-55b2-47ff-bb1d-17224ba7c47c-kube-api-access-8kgtv\") pod \"limitador-operator-controller-manager-6c549b6d85-lbqdq\" (UID: \"83eb1d46-55b2-47ff-bb1d-17224ba7c47c\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"
Aug 01 00:35:46.750575 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.750414    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnppr\" (UniqueName: \"kubernetes.io/projected/cdfa53a7-6ecb-474d-8228-791e215a4533-kube-api-access-xnppr\") pod \"kuadrant-operator-controller-manager-58fc56757c-fvfq7\" (UID: \"cdfa53a7-6ecb-474d-8228-791e215a4533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:46.831226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.831195    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.833221 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.833122    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.834745 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.834710    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:46.843357 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.843327    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:46.845248 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.845221    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:46.846914 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:46.846891    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:46.851350 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.851326    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdfa53a7-6ecb-474d-8228-791e215a4533-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fvfq7\" (UID: \"cdfa53a7-6ecb-474d-8228-791e215a4533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:46.851460 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.851444    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kgtv\" (UniqueName: \"kubernetes.io/projected/83eb1d46-55b2-47ff-bb1d-17224ba7c47c-kube-api-access-8kgtv\") pod \"limitador-operator-controller-manager-6c549b6d85-lbqdq\" (UID: \"83eb1d46-55b2-47ff-bb1d-17224ba7c47c\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"
Aug 01 00:35:46.851535 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.851463    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnppr\" (UniqueName: \"kubernetes.io/projected/cdfa53a7-6ecb-474d-8228-791e215a4533-kube-api-access-xnppr\") pod \"kuadrant-operator-controller-manager-58fc56757c-fvfq7\" (UID: \"cdfa53a7-6ecb-474d-8228-791e215a4533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:46.851759 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.851738    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdfa53a7-6ecb-474d-8228-791e215a4533-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fvfq7\" (UID: \"cdfa53a7-6ecb-474d-8228-791e215a4533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:46.861858 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.861826    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kgtv\" (UniqueName: \"kubernetes.io/projected/83eb1d46-55b2-47ff-bb1d-17224ba7c47c-kube-api-access-8kgtv\") pod \"limitador-operator-controller-manager-6c549b6d85-lbqdq\" (UID: \"83eb1d46-55b2-47ff-bb1d-17224ba7c47c\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"
Aug 01 00:35:46.862196 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.862176    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnppr\" (UniqueName: \"kubernetes.io/projected/cdfa53a7-6ecb-474d-8228-791e215a4533-kube-api-access-xnppr\") pod \"kuadrant-operator-controller-manager-58fc56757c-fvfq7\" (UID: \"cdfa53a7-6ecb-474d-8228-791e215a4533\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:46.952568 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.952528    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z964\" (UniqueName: \"kubernetes.io/projected/e5665aeb-e06c-44a9-bd01-fc662f4de81a-kube-api-access-9z964\") pod \"e5665aeb-e06c-44a9-bd01-fc662f4de81a\" (UID: \"e5665aeb-e06c-44a9-bd01-fc662f4de81a\") "
Aug 01 00:35:46.952743 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.952602    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsfpg\" (UniqueName: \"kubernetes.io/projected/1d8098f2-d3b3-411a-8d16-d901134d315c-kube-api-access-tsfpg\") pod \"1d8098f2-d3b3-411a-8d16-d901134d315c\" (UID: \"1d8098f2-d3b3-411a-8d16-d901134d315c\") "
Aug 01 00:35:46.952743 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.952629    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d8098f2-d3b3-411a-8d16-d901134d315c-extensions-socket-volume\") pod \"1d8098f2-d3b3-411a-8d16-d901134d315c\" (UID: \"1d8098f2-d3b3-411a-8d16-d901134d315c\") "
Aug 01 00:35:46.953207 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.953173    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8098f2-d3b3-411a-8d16-d901134d315c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1d8098f2-d3b3-411a-8d16-d901134d315c" (UID: "1d8098f2-d3b3-411a-8d16-d901134d315c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:35:46.954951 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.954923    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5665aeb-e06c-44a9-bd01-fc662f4de81a-kube-api-access-9z964" (OuterVolumeSpecName: "kube-api-access-9z964") pod "e5665aeb-e06c-44a9-bd01-fc662f4de81a" (UID: "e5665aeb-e06c-44a9-bd01-fc662f4de81a"). InnerVolumeSpecName "kube-api-access-9z964". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:35:46.955058 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.954968    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d8098f2-d3b3-411a-8d16-d901134d315c-kube-api-access-tsfpg" (OuterVolumeSpecName: "kube-api-access-tsfpg") pod "1d8098f2-d3b3-411a-8d16-d901134d315c" (UID: "1d8098f2-d3b3-411a-8d16-d901134d315c"). InnerVolumeSpecName "kube-api-access-tsfpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:35:46.977968 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.977920    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:46.985773 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:46.985743    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"
Aug 01 00:35:47.026261 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.026223    2547 generic.go:356] "Generic (PLEG): container finished" podID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" containerID="f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7" exitCode=0
Aug 01 00:35:47.026458 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.026271    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:47.026458 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.026323    2547 scope.go:117] "RemoveContainer" containerID="f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7"
Aug 01 00:35:47.029428 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.028017    2547 generic.go:356] "Generic (PLEG): container finished" podID="1d8098f2-d3b3-411a-8d16-d901134d315c" containerID="bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044" exitCode=0
Aug 01 00:35:47.029428 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.028183    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:47.029759 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.029678    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:47.031646 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.031614    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:47.034531 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.033715    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:47.035418 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.035381    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:47.044092 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.042135    2547 scope.go:117] "RemoveContainer" containerID="f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7"
Aug 01 00:35:47.044092 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.042850    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7\": container with ID starting with f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7 not found: ID does not exist" containerID="f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7"
Aug 01 00:35:47.044092 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.042893    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7"} err="failed to get container status \"f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7\": rpc error: code = NotFound desc = could not find container \"f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7\": container with ID starting with f44c18fec36f2ed458ca506830a1f951621ca22a0a76057c44427f886a312db7 not found: ID does not exist"
Aug 01 00:35:47.044092 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.042919    2547 scope.go:117] "RemoveContainer" containerID="bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044"
Aug 01 00:35:47.057209 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.056322    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z964\" (UniqueName: \"kubernetes.io/projected/e5665aeb-e06c-44a9-bd01-fc662f4de81a-kube-api-access-9z964\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:47.057209 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.056353    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsfpg\" (UniqueName: \"kubernetes.io/projected/1d8098f2-d3b3-411a-8d16-d901134d315c-kube-api-access-tsfpg\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:47.057209 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.056367    2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d8098f2-d3b3-411a-8d16-d901134d315c-extensions-socket-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:47.057456 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.057382    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:47.061780 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.061645    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:47.066839 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.066796    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-82hdl\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-82hdl"
Aug 01 00:35:47.068536 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.068454    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ttr6s\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ttr6s"
Aug 01 00:35:47.072716 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.072688    2547 scope.go:117] "RemoveContainer" containerID="bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044"
Aug 01 00:35:47.073112 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:47.073090    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044\": container with ID starting with bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044 not found: ID does not exist" containerID="bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044"
Aug 01 00:35:47.073172 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.073122    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044"} err="failed to get container status \"bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044\": rpc error: code = NotFound desc = could not find container \"bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044\": container with ID starting with bc47d4364bd2a5e4f8f83e2e4a330d646125d1a1b5f3d9c8f722aa467e83c044 not found: ID does not exist"
Aug 01 00:35:47.149130 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.149102    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"]
Aug 01 00:35:47.151802 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:35:47.151774    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdfa53a7_6ecb_474d_8228_791e215a4533.slice/crio-d9772b33f3a6e70a17dfc75a3e98142ffb85a787a080a42fdd1cbab2703f912d WatchSource:0}: Error finding container d9772b33f3a6e70a17dfc75a3e98142ffb85a787a080a42fdd1cbab2703f912d: Status 404 returned error can't find the container with id d9772b33f3a6e70a17dfc75a3e98142ffb85a787a080a42fdd1cbab2703f912d
Aug 01 00:35:47.166380 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.166345    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"]
Aug 01 00:35:47.170679 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:35:47.170649    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83eb1d46_55b2_47ff_bb1d_17224ba7c47c.slice/crio-47b73181a2dd009387e42fb2a6a5dd28031595bfb7b7d85eed1447b5639e94ca WatchSource:0}: Error finding container 47b73181a2dd009387e42fb2a6a5dd28031595bfb7b7d85eed1447b5639e94ca: Status 404 returned error can't find the container with id 47b73181a2dd009387e42fb2a6a5dd28031595bfb7b7d85eed1447b5639e94ca
Aug 01 00:35:47.880317 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.880227    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d8098f2-d3b3-411a-8d16-d901134d315c" path="/var/lib/kubelet/pods/1d8098f2-d3b3-411a-8d16-d901134d315c/volumes"
Aug 01 00:35:47.880721 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:47.880613    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5665aeb-e06c-44a9-bd01-fc662f4de81a" path="/var/lib/kubelet/pods/e5665aeb-e06c-44a9-bd01-fc662f4de81a/volumes"
Aug 01 00:35:48.035716 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:48.035679    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq" event={"ID":"83eb1d46-55b2-47ff-bb1d-17224ba7c47c","Type":"ContainerStarted","Data":"26533fa2c2c0d4186ce7c4d555e9a49beea76899c83aecb210e2bf2ebe2876a6"}
Aug 01 00:35:48.035911 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:48.035738    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq" event={"ID":"83eb1d46-55b2-47ff-bb1d-17224ba7c47c","Type":"ContainerStarted","Data":"47b73181a2dd009387e42fb2a6a5dd28031595bfb7b7d85eed1447b5639e94ca"}
Aug 01 00:35:48.035911 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:48.035798    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"
Aug 01 00:35:48.037505 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:48.037463    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7" event={"ID":"cdfa53a7-6ecb-474d-8228-791e215a4533","Type":"ContainerStarted","Data":"f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d"}
Aug 01 00:35:48.037650 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:48.037530    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7" event={"ID":"cdfa53a7-6ecb-474d-8228-791e215a4533","Type":"ContainerStarted","Data":"d9772b33f3a6e70a17dfc75a3e98142ffb85a787a080a42fdd1cbab2703f912d"}
Aug 01 00:35:48.037741 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:48.037720    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:35:48.051925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:48.051863    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq" podStartSLOduration=2.051844874 podStartE2EDuration="2.051844874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:35:48.050275451 +0000 UTC m=+416.747444515" watchObservedRunningTime="2026-08-01 00:35:48.051844874 +0000 UTC m=+416.749013936"
Aug 01 00:35:48.070100 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:48.070047    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7" podStartSLOduration=2.070027088 podStartE2EDuration="2.070027088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:35:48.068076067 +0000 UTC m=+416.765245140" watchObservedRunningTime="2026-08-01 00:35:48.070027088 +0000 UTC m=+416.767196221"
Aug 01 00:35:55.019871 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.019820    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5989cdc876-fwwjl" podUID="1b9c5865-9c38-4f6c-a53e-9991e517d861" containerName="console" containerID="cri-o://4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f" gracePeriod=15
Aug 01 00:35:55.286044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.285965    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:35:55.325783 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.325742    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-service-ca\") pod \"1b9c5865-9c38-4f6c-a53e-9991e517d861\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") "
Aug 01 00:35:55.325783 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.325778    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-trusted-ca-bundle\") pod \"1b9c5865-9c38-4f6c-a53e-9991e517d861\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") "
Aug 01 00:35:55.325996 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.325815    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vlnd\" (UniqueName: \"kubernetes.io/projected/1b9c5865-9c38-4f6c-a53e-9991e517d861-kube-api-access-6vlnd\") pod \"1b9c5865-9c38-4f6c-a53e-9991e517d861\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") "
Aug 01 00:35:55.325996 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.325847    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-serving-cert\") pod \"1b9c5865-9c38-4f6c-a53e-9991e517d861\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") "
Aug 01 00:35:55.325996 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.325929    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-config\") pod \"1b9c5865-9c38-4f6c-a53e-9991e517d861\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") "
Aug 01 00:35:55.326152 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.326002    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-oauth-config\") pod \"1b9c5865-9c38-4f6c-a53e-9991e517d861\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") "
Aug 01 00:35:55.326152 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.326029    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-oauth-serving-cert\") pod \"1b9c5865-9c38-4f6c-a53e-9991e517d861\" (UID: \"1b9c5865-9c38-4f6c-a53e-9991e517d861\") "
Aug 01 00:35:55.326569 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.326267    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-service-ca" (OuterVolumeSpecName: "service-ca") pod "1b9c5865-9c38-4f6c-a53e-9991e517d861" (UID: "1b9c5865-9c38-4f6c-a53e-9991e517d861"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:35:55.326569 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.326415    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1b9c5865-9c38-4f6c-a53e-9991e517d861" (UID: "1b9c5865-9c38-4f6c-a53e-9991e517d861"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:35:55.326569 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.326537    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-config" (OuterVolumeSpecName: "console-config") pod "1b9c5865-9c38-4f6c-a53e-9991e517d861" (UID: "1b9c5865-9c38-4f6c-a53e-9991e517d861"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:35:55.326771 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.326647    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1b9c5865-9c38-4f6c-a53e-9991e517d861" (UID: "1b9c5865-9c38-4f6c-a53e-9991e517d861"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:35:55.328150 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.328121    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9c5865-9c38-4f6c-a53e-9991e517d861-kube-api-access-6vlnd" (OuterVolumeSpecName: "kube-api-access-6vlnd") pod "1b9c5865-9c38-4f6c-a53e-9991e517d861" (UID: "1b9c5865-9c38-4f6c-a53e-9991e517d861"). InnerVolumeSpecName "kube-api-access-6vlnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:35:55.328262 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.328170    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1b9c5865-9c38-4f6c-a53e-9991e517d861" (UID: "1b9c5865-9c38-4f6c-a53e-9991e517d861"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:35:55.328590 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.328569    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1b9c5865-9c38-4f6c-a53e-9991e517d861" (UID: "1b9c5865-9c38-4f6c-a53e-9991e517d861"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:35:55.427598 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.427550    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:55.427598 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.427589    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-oauth-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:55.427598 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.427600    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-oauth-serving-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:55.427598 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.427609    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:55.427906 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.427618    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9c5865-9c38-4f6c-a53e-9991e517d861-trusted-ca-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:55.427906 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.427626    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vlnd\" (UniqueName: \"kubernetes.io/projected/1b9c5865-9c38-4f6c-a53e-9991e517d861-kube-api-access-6vlnd\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:55.427906 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:55.427634    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9c5865-9c38-4f6c-a53e-9991e517d861-console-serving-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:35:56.081348 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.081311    2547 generic.go:356] "Generic (PLEG): container finished" podID="1b9c5865-9c38-4f6c-a53e-9991e517d861" containerID="4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f" exitCode=0
Aug 01 00:35:56.081881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.081372    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5989cdc876-fwwjl"
Aug 01 00:35:56.081881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.081397    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5989cdc876-fwwjl" event={"ID":"1b9c5865-9c38-4f6c-a53e-9991e517d861","Type":"ContainerDied","Data":"4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f"}
Aug 01 00:35:56.081881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.081448    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5989cdc876-fwwjl" event={"ID":"1b9c5865-9c38-4f6c-a53e-9991e517d861","Type":"ContainerDied","Data":"f4a5cc4d1645f40cc2c066700d10c5cdcf12bc0878021a3e96adfd0ebfbfe922"}
Aug 01 00:35:56.081881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.081470    2547 scope.go:117] "RemoveContainer" containerID="4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f"
Aug 01 00:35:56.090552 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.090527    2547 scope.go:117] "RemoveContainer" containerID="4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f"
Aug 01 00:35:56.090879 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:35:56.090859    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f\": container with ID starting with 4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f not found: ID does not exist" containerID="4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f"
Aug 01 00:35:56.090926 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.090891    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f"} err="failed to get container status \"4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f\": rpc error: code = NotFound desc = could not find container \"4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f\": container with ID starting with 4eeab5b6cca02263fb5ce8bbc3fb38e2da155f312b8c6bb17beac4ef700c937f not found: ID does not exist"
Aug 01 00:35:56.096820 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.096790    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5989cdc876-fwwjl"]
Aug 01 00:35:56.108664 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:56.108629    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5989cdc876-fwwjl"]
Aug 01 00:35:57.880833 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:57.880792    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9c5865-9c38-4f6c-a53e-9991e517d861" path="/var/lib/kubelet/pods/1b9c5865-9c38-4f6c-a53e-9991e517d861/volumes"
Aug 01 00:35:59.046565 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:59.046534    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lbqdq"
Aug 01 00:35:59.046981 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:35:59.046607    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:36:14.706584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:14.706501    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"]
Aug 01 00:36:14.707040 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:14.706788    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7" podUID="cdfa53a7-6ecb-474d-8228-791e215a4533" containerName="manager" containerID="cri-o://f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d" gracePeriod=10
Aug 01 00:36:14.995770 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:14.995741    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:36:15.099212 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.099169    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdfa53a7-6ecb-474d-8228-791e215a4533-extensions-socket-volume\") pod \"cdfa53a7-6ecb-474d-8228-791e215a4533\" (UID: \"cdfa53a7-6ecb-474d-8228-791e215a4533\") "
Aug 01 00:36:15.099212 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.099221    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnppr\" (UniqueName: \"kubernetes.io/projected/cdfa53a7-6ecb-474d-8228-791e215a4533-kube-api-access-xnppr\") pod \"cdfa53a7-6ecb-474d-8228-791e215a4533\" (UID: \"cdfa53a7-6ecb-474d-8228-791e215a4533\") "
Aug 01 00:36:15.099587 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.099551    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdfa53a7-6ecb-474d-8228-791e215a4533-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cdfa53a7-6ecb-474d-8228-791e215a4533" (UID: "cdfa53a7-6ecb-474d-8228-791e215a4533"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:36:15.101377 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.101348    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdfa53a7-6ecb-474d-8228-791e215a4533-kube-api-access-xnppr" (OuterVolumeSpecName: "kube-api-access-xnppr") pod "cdfa53a7-6ecb-474d-8228-791e215a4533" (UID: "cdfa53a7-6ecb-474d-8228-791e215a4533"). InnerVolumeSpecName "kube-api-access-xnppr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:36:15.192230 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.192189    2547 generic.go:356] "Generic (PLEG): container finished" podID="cdfa53a7-6ecb-474d-8228-791e215a4533" containerID="f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d" exitCode=0
Aug 01 00:36:15.192389 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.192249    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"
Aug 01 00:36:15.192389 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.192280    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7" event={"ID":"cdfa53a7-6ecb-474d-8228-791e215a4533","Type":"ContainerDied","Data":"f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d"}
Aug 01 00:36:15.192389 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.192369    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7" event={"ID":"cdfa53a7-6ecb-474d-8228-791e215a4533","Type":"ContainerDied","Data":"d9772b33f3a6e70a17dfc75a3e98142ffb85a787a080a42fdd1cbab2703f912d"}
Aug 01 00:36:15.192588 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.192393    2547 scope.go:117] "RemoveContainer" containerID="f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d"
Aug 01 00:36:15.200286 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.200257    2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdfa53a7-6ecb-474d-8228-791e215a4533-extensions-socket-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:36:15.200421 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.200289    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnppr\" (UniqueName: \"kubernetes.io/projected/cdfa53a7-6ecb-474d-8228-791e215a4533-kube-api-access-xnppr\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:36:15.201902 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.201886    2547 scope.go:117] "RemoveContainer" containerID="f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d"
Aug 01 00:36:15.202196 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:36:15.202176    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d\": container with ID starting with f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d not found: ID does not exist" containerID="f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d"
Aug 01 00:36:15.202252 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.202206    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d"} err="failed to get container status \"f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d\": rpc error: code = NotFound desc = could not find container \"f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d\": container with ID starting with f62b7d7e43e39b2f480b32d84644aed3e6d2d10fe69df83e5e93371ddb14031d not found: ID does not exist"
Aug 01 00:36:15.217294 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.217259    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"]
Aug 01 00:36:15.222091 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.222053    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fvfq7"]
Aug 01 00:36:15.881156 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:15.881117    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdfa53a7-6ecb-474d-8228-791e215a4533" path="/var/lib/kubelet/pods/cdfa53a7-6ecb-474d-8228-791e215a4533/volumes"
Aug 01 00:36:30.955552 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.955512    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"]
Aug 01 00:36:30.956099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.956003    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9c5865-9c38-4f6c-a53e-9991e517d861" containerName="console"
Aug 01 00:36:30.956099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.956019    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9c5865-9c38-4f6c-a53e-9991e517d861" containerName="console"
Aug 01 00:36:30.956099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.956034    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfa53a7-6ecb-474d-8228-791e215a4533" containerName="manager"
Aug 01 00:36:30.956099 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.956040    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfa53a7-6ecb-474d-8228-791e215a4533" containerName="manager"
Aug 01 00:36:30.956230 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.956171    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9c5865-9c38-4f6c-a53e-9991e517d861" containerName="console"
Aug 01 00:36:30.956230 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.956181    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfa53a7-6ecb-474d-8228-791e215a4533" containerName="manager"
Aug 01 00:36:30.960973 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.960915    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:30.963278 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.963248    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q6xd6\""
Aug 01 00:36:30.970633 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:30.970605    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"]
Aug 01 00:36:31.050737 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.050687    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.050737 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.050736    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.051177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.050807    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8bad48f-e139-4854-a20c-dc666e8cef05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.051177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.050874    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.051177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.050923    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkkdp\" (UniqueName: \"kubernetes.io/projected/f8bad48f-e139-4854-a20c-dc666e8cef05-kube-api-access-dkkdp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.051177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.050950    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.051177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.050965    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.051177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.051057    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.051177 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.051112    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152222 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152175    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152439 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152233    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkkdp\" (UniqueName: \"kubernetes.io/projected/f8bad48f-e139-4854-a20c-dc666e8cef05-kube-api-access-dkkdp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152439 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152270    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152439 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152294    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152439 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152342    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152439 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152377    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152808 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152455    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152808 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152523    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152808 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152571    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8bad48f-e139-4854-a20c-dc666e8cef05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152808 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152754    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.152808 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152786    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.153061 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152844    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.153061 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.152977    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.153236 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.153219    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8bad48f-e139-4854-a20c-dc666e8cef05-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.154861 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.154842    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.155171 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.155149    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.160519 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.160472    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8bad48f-e139-4854-a20c-dc666e8cef05-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.160519 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.160497    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkkdp\" (UniqueName: \"kubernetes.io/projected/f8bad48f-e139-4854-a20c-dc666e8cef05-kube-api-access-dkkdp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-75b9q\" (UID: \"f8bad48f-e139-4854-a20c-dc666e8cef05\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.273008 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.272954    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:31.420998 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.420967    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"]
Aug 01 00:36:31.422974 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:36:31.422930    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bad48f_e139_4854_a20c_dc666e8cef05.slice/crio-ba128417a1debe95394404edfc483bd172657b40c64d2232681938124f0fe1c2 WatchSource:0}: Error finding container ba128417a1debe95394404edfc483bd172657b40c64d2232681938124f0fe1c2: Status 404 returned error can't find the container with id ba128417a1debe95394404edfc483bd172657b40c64d2232681938124f0fe1c2
Aug 01 00:36:31.425174 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.425124    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:36:31.425271 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.425231    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:36:31.425314 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:31.425272    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:36:32.288051 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:32.288005    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" event={"ID":"f8bad48f-e139-4854-a20c-dc666e8cef05","Type":"ContainerStarted","Data":"91a376eb81a33abb86b7c47fec0f0c43ee64c13008fa84119c10100a4511fc24"}
Aug 01 00:36:32.288417 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:32.288079    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" event={"ID":"f8bad48f-e139-4854-a20c-dc666e8cef05","Type":"ContainerStarted","Data":"ba128417a1debe95394404edfc483bd172657b40c64d2232681938124f0fe1c2"}
Aug 01 00:36:32.308045 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:32.307988    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" podStartSLOduration=2.3079691430000002 podStartE2EDuration="2.307969143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:36:32.306619468 +0000 UTC m=+461.003788531" watchObservedRunningTime="2026-08-01 00:36:32.307969143 +0000 UTC m=+461.005138209"
Aug 01 00:36:33.237781 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.237746    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"]
Aug 01 00:36:33.241703 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.241679    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:33.243927 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.243908    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zrp4w\""
Aug 01 00:36:33.244018 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.243908    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 01 00:36:33.249032 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.248996    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"]
Aug 01 00:36:33.273691 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.273651    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:33.279051 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.279020    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:33.295837 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.295803    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:33.297226 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.297195    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:36:33.343082 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.343039    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"]
Aug 01 00:36:33.375232 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.375196    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwls\" (UniqueName: \"kubernetes.io/projected/45dc1061-4b00-47ef-849d-6db882e6efef-kube-api-access-ppwls\") pod \"limitador-limitador-859c4d96d6-zkhzp\" (UID: \"45dc1061-4b00-47ef-849d-6db882e6efef\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:33.375422 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.375264    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45dc1061-4b00-47ef-849d-6db882e6efef-config-file\") pod \"limitador-limitador-859c4d96d6-zkhzp\" (UID: \"45dc1061-4b00-47ef-849d-6db882e6efef\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:33.476513 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.476435    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwls\" (UniqueName: \"kubernetes.io/projected/45dc1061-4b00-47ef-849d-6db882e6efef-kube-api-access-ppwls\") pod \"limitador-limitador-859c4d96d6-zkhzp\" (UID: \"45dc1061-4b00-47ef-849d-6db882e6efef\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:33.476732 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.476557    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45dc1061-4b00-47ef-849d-6db882e6efef-config-file\") pod \"limitador-limitador-859c4d96d6-zkhzp\" (UID: \"45dc1061-4b00-47ef-849d-6db882e6efef\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:33.477267 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.477245    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45dc1061-4b00-47ef-849d-6db882e6efef-config-file\") pod \"limitador-limitador-859c4d96d6-zkhzp\" (UID: \"45dc1061-4b00-47ef-849d-6db882e6efef\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:33.484378 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.484345    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwls\" (UniqueName: \"kubernetes.io/projected/45dc1061-4b00-47ef-849d-6db882e6efef-kube-api-access-ppwls\") pod \"limitador-limitador-859c4d96d6-zkhzp\" (UID: \"45dc1061-4b00-47ef-849d-6db882e6efef\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:33.555151 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.555041    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:33.701065 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:33.701035    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"]
Aug 01 00:36:33.703238 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:36:33.703204    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45dc1061_4b00_47ef_849d_6db882e6efef.slice/crio-ca23ec8ddeca0d0c4a33fba9579be8d51f6d7fab2ef7ce4f379bcd4ffc727f79 WatchSource:0}: Error finding container ca23ec8ddeca0d0c4a33fba9579be8d51f6d7fab2ef7ce4f379bcd4ffc727f79: Status 404 returned error can't find the container with id ca23ec8ddeca0d0c4a33fba9579be8d51f6d7fab2ef7ce4f379bcd4ffc727f79
Aug 01 00:36:34.045993 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.045950    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-hp4r4"]
Aug 01 00:36:34.050689 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.050667    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-hp4r4"
Aug 01 00:36:34.053116 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.053092    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vpbxr\""
Aug 01 00:36:34.056956 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.056924    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-hp4r4"]
Aug 01 00:36:34.184106 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.184066    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfbk2\" (UniqueName: \"kubernetes.io/projected/e7e34572-9e2d-45b0-a05e-19edc564975b-kube-api-access-wfbk2\") pod \"authorino-b54df94b4-hp4r4\" (UID: \"e7e34572-9e2d-45b0-a05e-19edc564975b\") " pod="kuadrant-system/authorino-b54df94b4-hp4r4"
Aug 01 00:36:34.285139 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.285103    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfbk2\" (UniqueName: \"kubernetes.io/projected/e7e34572-9e2d-45b0-a05e-19edc564975b-kube-api-access-wfbk2\") pod \"authorino-b54df94b4-hp4r4\" (UID: \"e7e34572-9e2d-45b0-a05e-19edc564975b\") " pod="kuadrant-system/authorino-b54df94b4-hp4r4"
Aug 01 00:36:34.292939 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.292899    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfbk2\" (UniqueName: \"kubernetes.io/projected/e7e34572-9e2d-45b0-a05e-19edc564975b-kube-api-access-wfbk2\") pod \"authorino-b54df94b4-hp4r4\" (UID: \"e7e34572-9e2d-45b0-a05e-19edc564975b\") " pod="kuadrant-system/authorino-b54df94b4-hp4r4"
Aug 01 00:36:34.303252 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.303176    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp" event={"ID":"45dc1061-4b00-47ef-849d-6db882e6efef","Type":"ContainerStarted","Data":"ca23ec8ddeca0d0c4a33fba9579be8d51f6d7fab2ef7ce4f379bcd4ffc727f79"}
Aug 01 00:36:34.362456 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.362417    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-hp4r4"
Aug 01 00:36:34.503925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:34.503895    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-hp4r4"]
Aug 01 00:36:34.506262 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:36:34.506231    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7e34572_9e2d_45b0_a05e_19edc564975b.slice/crio-c1117c7ff68ac3ccfa4f6940c9f463cb070307920a6e943e60d9288afbb54d8c WatchSource:0}: Error finding container c1117c7ff68ac3ccfa4f6940c9f463cb070307920a6e943e60d9288afbb54d8c: Status 404 returned error can't find the container with id c1117c7ff68ac3ccfa4f6940c9f463cb070307920a6e943e60d9288afbb54d8c
Aug 01 00:36:35.309839 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:35.309801    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-hp4r4" event={"ID":"e7e34572-9e2d-45b0-a05e-19edc564975b","Type":"ContainerStarted","Data":"c1117c7ff68ac3ccfa4f6940c9f463cb070307920a6e943e60d9288afbb54d8c"}
Aug 01 00:36:36.317223 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:36.317185    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp" event={"ID":"45dc1061-4b00-47ef-849d-6db882e6efef","Type":"ContainerStarted","Data":"c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9"}
Aug 01 00:36:36.317709 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:36.317372    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:36.334531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:36.334446    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp" podStartSLOduration=1.71767762 podStartE2EDuration="3.334425209s" totalImagesPullingTime="1.616747589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:36:36.331708868 +0000 UTC m=+465.028877931" watchObservedRunningTime="2026-08-01 00:36:36.334425209 +0000 UTC m=+465.031594271"
Aug 01 00:36:37.323617 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:37.323506    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-hp4r4" event={"ID":"e7e34572-9e2d-45b0-a05e-19edc564975b","Type":"ContainerStarted","Data":"9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4"}
Aug 01 00:36:37.337722 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:37.337663    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-hp4r4" podStartSLOduration=0.86927753 podStartE2EDuration="3.337642536s" totalImagesPullingTime="2.468365006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:36:37.336224483 +0000 UTC m=+466.033393546" watchObservedRunningTime="2026-08-01 00:36:37.337642536 +0000 UTC m=+466.034811597"
Aug 01 00:36:39.124077 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:39.124026    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-hp4r4"]
Aug 01 00:36:39.334662 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:39.334616    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-hp4r4" podUID="e7e34572-9e2d-45b0-a05e-19edc564975b" containerName="authorino" containerID="cri-o://9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4" gracePeriod=30
Aug 01 00:36:39.593452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:39.593424    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-hp4r4"
Aug 01 00:36:39.640320 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:39.640283    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfbk2\" (UniqueName: \"kubernetes.io/projected/e7e34572-9e2d-45b0-a05e-19edc564975b-kube-api-access-wfbk2\") pod \"e7e34572-9e2d-45b0-a05e-19edc564975b\" (UID: \"e7e34572-9e2d-45b0-a05e-19edc564975b\") "
Aug 01 00:36:39.642430 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:39.642404    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e34572-9e2d-45b0-a05e-19edc564975b-kube-api-access-wfbk2" (OuterVolumeSpecName: "kube-api-access-wfbk2") pod "e7e34572-9e2d-45b0-a05e-19edc564975b" (UID: "e7e34572-9e2d-45b0-a05e-19edc564975b"). InnerVolumeSpecName "kube-api-access-wfbk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:36:39.741081 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:39.741039    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfbk2\" (UniqueName: \"kubernetes.io/projected/e7e34572-9e2d-45b0-a05e-19edc564975b-kube-api-access-wfbk2\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:36:40.340558 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.340517    2547 generic.go:356] "Generic (PLEG): container finished" podID="e7e34572-9e2d-45b0-a05e-19edc564975b" containerID="9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4" exitCode=0
Aug 01 00:36:40.340558 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.340571    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-hp4r4" event={"ID":"e7e34572-9e2d-45b0-a05e-19edc564975b","Type":"ContainerDied","Data":"9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4"}
Aug 01 00:36:40.341055 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.340576    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-hp4r4"
Aug 01 00:36:40.341055 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.340608    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-hp4r4" event={"ID":"e7e34572-9e2d-45b0-a05e-19edc564975b","Type":"ContainerDied","Data":"c1117c7ff68ac3ccfa4f6940c9f463cb070307920a6e943e60d9288afbb54d8c"}
Aug 01 00:36:40.341055 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.340627    2547 scope.go:117] "RemoveContainer" containerID="9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4"
Aug 01 00:36:40.349620 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.349595    2547 scope.go:117] "RemoveContainer" containerID="9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4"
Aug 01 00:36:40.349956 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:36:40.349932    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4\": container with ID starting with 9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4 not found: ID does not exist" containerID="9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4"
Aug 01 00:36:40.350045 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.349965    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4"} err="failed to get container status \"9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4\": rpc error: code = NotFound desc = could not find container \"9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4\": container with ID starting with 9ffc6fb54527ad217bb79aafe05c2a6e6a0fc1eba76e66ebde31eb88f4f853e4 not found: ID does not exist"
Aug 01 00:36:40.357056 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.357024    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-hp4r4"]
Aug 01 00:36:40.360791 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:40.360766    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-hp4r4"]
Aug 01 00:36:41.880008 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:41.879975    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e34572-9e2d-45b0-a05e-19edc564975b" path="/var/lib/kubelet/pods/e7e34572-9e2d-45b0-a05e-19edc564975b/volumes"
Aug 01 00:36:47.325104 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:47.325054    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:50.119438 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.119402    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"]
Aug 01 00:36:50.119886 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.119739    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp" podUID="45dc1061-4b00-47ef-849d-6db882e6efef" containerName="limitador" containerID="cri-o://c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9" gracePeriod=30
Aug 01 00:36:50.678909 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.678838    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:50.727085 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.727039    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45dc1061-4b00-47ef-849d-6db882e6efef-config-file\") pod \"45dc1061-4b00-47ef-849d-6db882e6efef\" (UID: \"45dc1061-4b00-47ef-849d-6db882e6efef\") "
Aug 01 00:36:50.727286 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.727150    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppwls\" (UniqueName: \"kubernetes.io/projected/45dc1061-4b00-47ef-849d-6db882e6efef-kube-api-access-ppwls\") pod \"45dc1061-4b00-47ef-849d-6db882e6efef\" (UID: \"45dc1061-4b00-47ef-849d-6db882e6efef\") "
Aug 01 00:36:50.727471 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.727445    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45dc1061-4b00-47ef-849d-6db882e6efef-config-file" (OuterVolumeSpecName: "config-file") pod "45dc1061-4b00-47ef-849d-6db882e6efef" (UID: "45dc1061-4b00-47ef-849d-6db882e6efef"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:36:50.729270 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.729247    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45dc1061-4b00-47ef-849d-6db882e6efef-kube-api-access-ppwls" (OuterVolumeSpecName: "kube-api-access-ppwls") pod "45dc1061-4b00-47ef-849d-6db882e6efef" (UID: "45dc1061-4b00-47ef-849d-6db882e6efef"). InnerVolumeSpecName "kube-api-access-ppwls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:36:50.827945 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.827898    2547 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45dc1061-4b00-47ef-849d-6db882e6efef-config-file\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:36:50.827945 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:50.827932    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppwls\" (UniqueName: \"kubernetes.io/projected/45dc1061-4b00-47ef-849d-6db882e6efef-kube-api-access-ppwls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:36:51.400955 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.400921    2547 generic.go:356] "Generic (PLEG): container finished" podID="45dc1061-4b00-47ef-849d-6db882e6efef" containerID="c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9" exitCode=0
Aug 01 00:36:51.401460 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.400970    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"
Aug 01 00:36:51.401460 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.401010    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp" event={"ID":"45dc1061-4b00-47ef-849d-6db882e6efef","Type":"ContainerDied","Data":"c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9"}
Aug 01 00:36:51.401460 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.401075    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-zkhzp" event={"ID":"45dc1061-4b00-47ef-849d-6db882e6efef","Type":"ContainerDied","Data":"ca23ec8ddeca0d0c4a33fba9579be8d51f6d7fab2ef7ce4f379bcd4ffc727f79"}
Aug 01 00:36:51.401460 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.401111    2547 scope.go:117] "RemoveContainer" containerID="c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9"
Aug 01 00:36:51.410808 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.410785    2547 scope.go:117] "RemoveContainer" containerID="c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9"
Aug 01 00:36:51.411104 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:36:51.411085    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9\": container with ID starting with c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9 not found: ID does not exist" containerID="c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9"
Aug 01 00:36:51.411149 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.411114    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9"} err="failed to get container status \"c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9\": rpc error: code = NotFound desc = could not find container \"c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9\": container with ID starting with c1dd263a36283482936c21785eb45c547e33db25c85d7b1632bc8338808816b9 not found: ID does not exist"
Aug 01 00:36:51.424022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.423987    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"]
Aug 01 00:36:51.427584 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.427554    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-zkhzp"]
Aug 01 00:36:51.881756 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:51.881722    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45dc1061-4b00-47ef-849d-6db882e6efef" path="/var/lib/kubelet/pods/45dc1061-4b00-47ef-849d-6db882e6efef/volumes"
Aug 01 00:36:54.894257 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.894222    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"]
Aug 01 00:36:54.894637 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.894624    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e34572-9e2d-45b0-a05e-19edc564975b" containerName="authorino"
Aug 01 00:36:54.894674 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.894639    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e34572-9e2d-45b0-a05e-19edc564975b" containerName="authorino"
Aug 01 00:36:54.894674 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.894653    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45dc1061-4b00-47ef-849d-6db882e6efef" containerName="limitador"
Aug 01 00:36:54.894674 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.894658    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="45dc1061-4b00-47ef-849d-6db882e6efef" containerName="limitador"
Aug 01 00:36:54.894781 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.894726    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e34572-9e2d-45b0-a05e-19edc564975b" containerName="authorino"
Aug 01 00:36:54.894781 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.894737    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="45dc1061-4b00-47ef-849d-6db882e6efef" containerName="limitador"
Aug 01 00:36:54.899111 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.899092    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:36:54.901353 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.901327    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 01 00:36:54.901516 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.901383    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 01 00:36:54.901516 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.901456    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wv7wx\""
Aug 01 00:36:54.901516 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.901464    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 01 00:36:54.904884 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.904857    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"]
Aug 01 00:36:54.965302 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.965247    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z89hs\" (UniqueName: \"kubernetes.io/projected/9fb61fff-e021-43e7-a063-4f2703eebba3-kube-api-access-z89hs\") pod \"postgres-69fb4594cf-6t9nf\" (UID: \"9fb61fff-e021-43e7-a063-4f2703eebba3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:36:54.965561 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:54.965368    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9fb61fff-e021-43e7-a063-4f2703eebba3-data\") pod \"postgres-69fb4594cf-6t9nf\" (UID: \"9fb61fff-e021-43e7-a063-4f2703eebba3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:36:55.066809 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:55.066761    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z89hs\" (UniqueName: \"kubernetes.io/projected/9fb61fff-e021-43e7-a063-4f2703eebba3-kube-api-access-z89hs\") pod \"postgres-69fb4594cf-6t9nf\" (UID: \"9fb61fff-e021-43e7-a063-4f2703eebba3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:36:55.066996 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:55.066839    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9fb61fff-e021-43e7-a063-4f2703eebba3-data\") pod \"postgres-69fb4594cf-6t9nf\" (UID: \"9fb61fff-e021-43e7-a063-4f2703eebba3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:36:55.067206 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:55.067187    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9fb61fff-e021-43e7-a063-4f2703eebba3-data\") pod \"postgres-69fb4594cf-6t9nf\" (UID: \"9fb61fff-e021-43e7-a063-4f2703eebba3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:36:55.075558 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:55.075530    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z89hs\" (UniqueName: \"kubernetes.io/projected/9fb61fff-e021-43e7-a063-4f2703eebba3-kube-api-access-z89hs\") pod \"postgres-69fb4594cf-6t9nf\" (UID: \"9fb61fff-e021-43e7-a063-4f2703eebba3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:36:55.211867 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:55.211766    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:36:55.353122 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:55.353096    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"]
Aug 01 00:36:55.355290 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:36:55.355257    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb61fff_e021_43e7_a063_4f2703eebba3.slice/crio-7b3ad87e7c261de533c2cc4f1521cceb17fa33e6d986601308ba73e2eb9cfe4a WatchSource:0}: Error finding container 7b3ad87e7c261de533c2cc4f1521cceb17fa33e6d986601308ba73e2eb9cfe4a: Status 404 returned error can't find the container with id 7b3ad87e7c261de533c2cc4f1521cceb17fa33e6d986601308ba73e2eb9cfe4a
Aug 01 00:36:55.424555 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:36:55.424514    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf" event={"ID":"9fb61fff-e021-43e7-a063-4f2703eebba3","Type":"ContainerStarted","Data":"7b3ad87e7c261de533c2cc4f1521cceb17fa33e6d986601308ba73e2eb9cfe4a"}
Aug 01 00:37:02.473242 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:02.473199    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf" event={"ID":"9fb61fff-e021-43e7-a063-4f2703eebba3","Type":"ContainerStarted","Data":"14bf2cdbda3ad4560cad59ca2666a6e67a5b371cb6c8c5f8e8659b19170523a0"}
Aug 01 00:37:02.473754 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:02.473341    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:37:02.487801 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:02.487668    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf" podStartSLOduration=1.649517897 podStartE2EDuration="8.487644725s" totalImagesPullingTime="6.838126828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:37:02.486937782 +0000 UTC m=+491.184106844" watchObservedRunningTime="2026-08-01 00:37:02.487644725 +0000 UTC m=+491.184813787"
Aug 01 00:37:08.508461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:08.508428    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6t9nf"
Aug 01 00:37:09.286489 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.286452    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7864fb5f8d-vdqnm"]
Aug 01 00:37:09.293218 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.293187    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:37:09.295823 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.295777    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vpbxr\""
Aug 01 00:37:09.295979 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.295792    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 01 00:37:09.298096 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.298066    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7864fb5f8d-vdqnm"]
Aug 01 00:37:09.404844 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.404807    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dw47\" (UniqueName: \"kubernetes.io/projected/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-kube-api-access-7dw47\") pod \"authorino-7864fb5f8d-vdqnm\" (UID: \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\") " pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:37:09.405076 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.404967    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-tls-cert\") pod \"authorino-7864fb5f8d-vdqnm\" (UID: \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\") " pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:37:09.507768 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.507724    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-tls-cert\") pod \"authorino-7864fb5f8d-vdqnm\" (UID: \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\") " pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:37:09.507983 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.507826    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw47\" (UniqueName: \"kubernetes.io/projected/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-kube-api-access-7dw47\") pod \"authorino-7864fb5f8d-vdqnm\" (UID: \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\") " pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:37:09.511659 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.511587    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-tls-cert\") pod \"authorino-7864fb5f8d-vdqnm\" (UID: \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\") " pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:37:09.516547 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.516516    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dw47\" (UniqueName: \"kubernetes.io/projected/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-kube-api-access-7dw47\") pod \"authorino-7864fb5f8d-vdqnm\" (UID: \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\") " pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:37:09.604239 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.604143    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:37:09.749592 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:09.749563    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7864fb5f8d-vdqnm"]
Aug 01 00:37:09.751914 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:37:09.751877    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8d29ad9_79ff_4c3e_bfb0_ff97a7c50f1a.slice/crio-382924ae33de474211c29aaa10bf720d5f8e30a7da526263a53d33025b433897 WatchSource:0}: Error finding container 382924ae33de474211c29aaa10bf720d5f8e30a7da526263a53d33025b433897: Status 404 returned error can't find the container with id 382924ae33de474211c29aaa10bf720d5f8e30a7da526263a53d33025b433897
Aug 01 00:37:10.523642 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:10.523606    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm" event={"ID":"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a","Type":"ContainerStarted","Data":"90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d"}
Aug 01 00:37:10.524011 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:10.523652    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm" event={"ID":"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a","Type":"ContainerStarted","Data":"382924ae33de474211c29aaa10bf720d5f8e30a7da526263a53d33025b433897"}
Aug 01 00:37:10.537843 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:10.537784    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm" podStartSLOduration=0.955537824 podStartE2EDuration="1.53776636s" totalImagesPullingTime="582.228536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:37:10.536618528 +0000 UTC m=+499.233787590" watchObservedRunningTime="2026-08-01 00:37:10.53776636 +0000 UTC m=+499.234935421"
Aug 01 00:37:14.958749 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:14.958711    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6565ccc9d6-clk2r"]
Aug 01 00:37:14.962602 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:14.962571    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:14.966508 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:14.966469    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 01 00:37:14.966693 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:14.966470    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 01 00:37:14.966693 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:14.966640    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dgftb\""
Aug 01 00:37:14.974508 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:14.974457    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6565ccc9d6-clk2r"]
Aug 01 00:37:15.063397 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.063357    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qqlg\" (UniqueName: \"kubernetes.io/projected/d51608b8-8f84-49b5-85f6-032f4b7bb633-kube-api-access-5qqlg\") pod \"maas-controller-6565ccc9d6-clk2r\" (UID: \"d51608b8-8f84-49b5-85f6-032f4b7bb633\") " pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:15.063629 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.063440    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51608b8-8f84-49b5-85f6-032f4b7bb633-webhook-cert\") pod \"maas-controller-6565ccc9d6-clk2r\" (UID: \"d51608b8-8f84-49b5-85f6-032f4b7bb633\") " pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:15.164136 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.164095    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qqlg\" (UniqueName: \"kubernetes.io/projected/d51608b8-8f84-49b5-85f6-032f4b7bb633-kube-api-access-5qqlg\") pod \"maas-controller-6565ccc9d6-clk2r\" (UID: \"d51608b8-8f84-49b5-85f6-032f4b7bb633\") " pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:15.164321 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.164174    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51608b8-8f84-49b5-85f6-032f4b7bb633-webhook-cert\") pod \"maas-controller-6565ccc9d6-clk2r\" (UID: \"d51608b8-8f84-49b5-85f6-032f4b7bb633\") " pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:15.166740 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.166714    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51608b8-8f84-49b5-85f6-032f4b7bb633-webhook-cert\") pod \"maas-controller-6565ccc9d6-clk2r\" (UID: \"d51608b8-8f84-49b5-85f6-032f4b7bb633\") " pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:15.171911 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.171880    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qqlg\" (UniqueName: \"kubernetes.io/projected/d51608b8-8f84-49b5-85f6-032f4b7bb633-kube-api-access-5qqlg\") pod \"maas-controller-6565ccc9d6-clk2r\" (UID: \"d51608b8-8f84-49b5-85f6-032f4b7bb633\") " pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:15.275887 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.275845    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:15.421429 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.421397    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6565ccc9d6-clk2r"]
Aug 01 00:37:15.423460 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:37:15.423429    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51608b8_8f84_49b5_85f6_032f4b7bb633.slice/crio-5510adb9a346b6a269f7b1df51a9f8432520c81aa94f3e1e4ad17bb7625893b1 WatchSource:0}: Error finding container 5510adb9a346b6a269f7b1df51a9f8432520c81aa94f3e1e4ad17bb7625893b1: Status 404 returned error can't find the container with id 5510adb9a346b6a269f7b1df51a9f8432520c81aa94f3e1e4ad17bb7625893b1
Aug 01 00:37:15.550423 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:15.550330    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6565ccc9d6-clk2r" event={"ID":"d51608b8-8f84-49b5-85f6-032f4b7bb633","Type":"ContainerStarted","Data":"5510adb9a346b6a269f7b1df51a9f8432520c81aa94f3e1e4ad17bb7625893b1"}
Aug 01 00:37:17.563227 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:17.563189    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6565ccc9d6-clk2r" event={"ID":"d51608b8-8f84-49b5-85f6-032f4b7bb633","Type":"ContainerStarted","Data":"74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca"}
Aug 01 00:37:17.563716 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:17.563312    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:17.583207 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:17.583148    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6565ccc9d6-clk2r" podStartSLOduration=2.115379934 podStartE2EDuration="3.583128448s" totalImagesPullingTime="1.467748514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:37:17.581556519 +0000 UTC m=+506.278725581" watchObservedRunningTime="2026-08-01 00:37:17.583128448 +0000 UTC m=+506.280297509"
Aug 01 00:37:28.025491 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.025436    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6565ccc9d6-clk2r"]
Aug 01 00:37:28.025975 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.025740    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6565ccc9d6-clk2r" podUID="d51608b8-8f84-49b5-85f6-032f4b7bb633" containerName="manager" containerID="cri-o://74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca" gracePeriod=30
Aug 01 00:37:28.027522 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.027472    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:28.296875 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.296846    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:28.396242 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.396197    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qqlg\" (UniqueName: \"kubernetes.io/projected/d51608b8-8f84-49b5-85f6-032f4b7bb633-kube-api-access-5qqlg\") pod \"d51608b8-8f84-49b5-85f6-032f4b7bb633\" (UID: \"d51608b8-8f84-49b5-85f6-032f4b7bb633\") "
Aug 01 00:37:28.396458 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.396321    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51608b8-8f84-49b5-85f6-032f4b7bb633-webhook-cert\") pod \"d51608b8-8f84-49b5-85f6-032f4b7bb633\" (UID: \"d51608b8-8f84-49b5-85f6-032f4b7bb633\") "
Aug 01 00:37:28.399782 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.399737    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51608b8-8f84-49b5-85f6-032f4b7bb633-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d51608b8-8f84-49b5-85f6-032f4b7bb633" (UID: "d51608b8-8f84-49b5-85f6-032f4b7bb633"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:37:28.399947 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.399810    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51608b8-8f84-49b5-85f6-032f4b7bb633-kube-api-access-5qqlg" (OuterVolumeSpecName: "kube-api-access-5qqlg") pod "d51608b8-8f84-49b5-85f6-032f4b7bb633" (UID: "d51608b8-8f84-49b5-85f6-032f4b7bb633"). InnerVolumeSpecName "kube-api-access-5qqlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:37:28.497922 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.497879    2547 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d51608b8-8f84-49b5-85f6-032f4b7bb633-webhook-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:37:28.497922 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.497919    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qqlg\" (UniqueName: \"kubernetes.io/projected/d51608b8-8f84-49b5-85f6-032f4b7bb633-kube-api-access-5qqlg\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:37:28.621055 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.620959    2547 generic.go:356] "Generic (PLEG): container finished" podID="d51608b8-8f84-49b5-85f6-032f4b7bb633" containerID="74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca" exitCode=0
Aug 01 00:37:28.621055 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.621016    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6565ccc9d6-clk2r"
Aug 01 00:37:28.621055 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.621041    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6565ccc9d6-clk2r" event={"ID":"d51608b8-8f84-49b5-85f6-032f4b7bb633","Type":"ContainerDied","Data":"74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca"}
Aug 01 00:37:28.621293 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.621125    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6565ccc9d6-clk2r" event={"ID":"d51608b8-8f84-49b5-85f6-032f4b7bb633","Type":"ContainerDied","Data":"5510adb9a346b6a269f7b1df51a9f8432520c81aa94f3e1e4ad17bb7625893b1"}
Aug 01 00:37:28.621293 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.621148    2547 scope.go:117] "RemoveContainer" containerID="74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca"
Aug 01 00:37:28.630724 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.630704    2547 scope.go:117] "RemoveContainer" containerID="74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca"
Aug 01 00:37:28.631034 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:37:28.631012    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca\": container with ID starting with 74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca not found: ID does not exist" containerID="74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca"
Aug 01 00:37:28.631083 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.631044    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca"} err="failed to get container status \"74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca\": rpc error: code = NotFound desc = could not find container \"74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca\": container with ID starting with 74598efd284f52e12c1389e2767b84f63d5e1011c87d6cbd7dbe21f4ac84c5ca not found: ID does not exist"
Aug 01 00:37:28.641347 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.641315    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6565ccc9d6-clk2r"]
Aug 01 00:37:28.645270 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:28.645238    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6565ccc9d6-clk2r"]
Aug 01 00:37:29.881498 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:29.881454    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51608b8-8f84-49b5-85f6-032f4b7bb633" path="/var/lib/kubelet/pods/d51608b8-8f84-49b5-85f6-032f4b7bb633/volumes"
Aug 01 00:37:50.245369 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.245279    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"]
Aug 01 00:37:50.245856 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.245704    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51608b8-8f84-49b5-85f6-032f4b7bb633" containerName="manager"
Aug 01 00:37:50.245856 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.245715    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51608b8-8f84-49b5-85f6-032f4b7bb633" containerName="manager"
Aug 01 00:37:50.245856 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.245792    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d51608b8-8f84-49b5-85f6-032f4b7bb633" containerName="manager"
Aug 01 00:37:50.252012 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.251988    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.254202 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.254177    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 01 00:37:50.254349 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.254258    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gf2hx\""
Aug 01 00:37:50.260231 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.260201    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"]
Aug 01 00:37:50.280598 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.280552    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-openshift-service-ca\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.280800 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.280643    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-maas-api-tls\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.280800 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.280718    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2cq\" (UniqueName: \"kubernetes.io/projected/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-kube-api-access-lz2cq\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.381905 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.381859    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2cq\" (UniqueName: \"kubernetes.io/projected/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-kube-api-access-lz2cq\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.382093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.381948    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-openshift-service-ca\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.382093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.381978    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-maas-api-tls\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.382200 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:37:50.382176    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Aug 01 00:37:50.382267 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:37:50.382255    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-maas-api-tls podName:ff3dfdcb-08d5-478c-80ab-b6b25224d7ba nodeName:}" failed. No retries permitted until 2026-08-01 00:37:50.882233571 +0000 UTC m=+539.579402630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-maas-api-tls") pod "maas-api-78cdcdf5c7-m9psf" (UID: "ff3dfdcb-08d5-478c-80ab-b6b25224d7ba") : secret "maas-api-serving-cert" not found
Aug 01 00:37:50.382774 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.382756    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-openshift-service-ca\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.396500 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.396446    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2cq\" (UniqueName: \"kubernetes.io/projected/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-kube-api-access-lz2cq\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.791587 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.791543    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-cd9b2"]
Aug 01 00:37:50.796621 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.796592    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:50.798767 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.798741    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 01 00:37:50.798890 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.798796    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ldchh\""
Aug 01 00:37:50.806035 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.806007    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-cd9b2"]
Aug 01 00:37:50.887717 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.887683    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-maas-api-tls\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.887910 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.887739    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-596pf\" (UniqueName: \"kubernetes.io/projected/c6f1a116-ec4e-49c7-8e92-eec6259c8b20-kube-api-access-596pf\") pod \"payload-processing-5cc6cd444b-cd9b2\" (UID: \"c6f1a116-ec4e-49c7-8e92-eec6259c8b20\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:50.887910 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.887828    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6f1a116-ec4e-49c7-8e92-eec6259c8b20-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-cd9b2\" (UID: \"c6f1a116-ec4e-49c7-8e92-eec6259c8b20\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:50.890268 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.890235    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff3dfdcb-08d5-478c-80ab-b6b25224d7ba-maas-api-tls\") pod \"maas-api-78cdcdf5c7-m9psf\" (UID: \"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba\") " pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:50.988493 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.988434    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6f1a116-ec4e-49c7-8e92-eec6259c8b20-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-cd9b2\" (UID: \"c6f1a116-ec4e-49c7-8e92-eec6259c8b20\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:50.988685 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.988603    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-596pf\" (UniqueName: \"kubernetes.io/projected/c6f1a116-ec4e-49c7-8e92-eec6259c8b20-kube-api-access-596pf\") pod \"payload-processing-5cc6cd444b-cd9b2\" (UID: \"c6f1a116-ec4e-49c7-8e92-eec6259c8b20\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:50.989181 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.989159    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6f1a116-ec4e-49c7-8e92-eec6259c8b20-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-cd9b2\" (UID: \"c6f1a116-ec4e-49c7-8e92-eec6259c8b20\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:50.996590 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:50.996559    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-596pf\" (UniqueName: \"kubernetes.io/projected/c6f1a116-ec4e-49c7-8e92-eec6259c8b20-kube-api-access-596pf\") pod \"payload-processing-5cc6cd444b-cd9b2\" (UID: \"c6f1a116-ec4e-49c7-8e92-eec6259c8b20\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:51.110548 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:51.110412    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:51.165850 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:51.165815    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:51.263783 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:51.263744    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-cd9b2"]
Aug 01 00:37:51.265988 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:37:51.265956    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f1a116_ec4e_49c7_8e92_eec6259c8b20.slice/crio-5642dfdade982d9a6e44c2fc12bd4c9b6b9b953bd62674dd41bfbbabbecf1fb7 WatchSource:0}: Error finding container 5642dfdade982d9a6e44c2fc12bd4c9b6b9b953bd62674dd41bfbbabbecf1fb7: Status 404 returned error can't find the container with id 5642dfdade982d9a6e44c2fc12bd4c9b6b9b953bd62674dd41bfbbabbecf1fb7
Aug 01 00:37:51.322022 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:51.321993    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"]
Aug 01 00:37:51.324420 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:37:51.324385    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3dfdcb_08d5_478c_80ab_b6b25224d7ba.slice/crio-24df7a0c45bfca59985dffb171c00f24c8be4cd135985b2c03a31f980d3abdcc WatchSource:0}: Error finding container 24df7a0c45bfca59985dffb171c00f24c8be4cd135985b2c03a31f980d3abdcc: Status 404 returned error can't find the container with id 24df7a0c45bfca59985dffb171c00f24c8be4cd135985b2c03a31f980d3abdcc
Aug 01 00:37:51.746501 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:51.746438    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf" event={"ID":"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba","Type":"ContainerStarted","Data":"24df7a0c45bfca59985dffb171c00f24c8be4cd135985b2c03a31f980d3abdcc"}
Aug 01 00:37:51.748066 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:51.748035    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2" event={"ID":"c6f1a116-ec4e-49c7-8e92-eec6259c8b20","Type":"ContainerStarted","Data":"5642dfdade982d9a6e44c2fc12bd4c9b6b9b953bd62674dd41bfbbabbecf1fb7"}
Aug 01 00:37:53.765536 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:53.765468    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf" event={"ID":"ff3dfdcb-08d5-478c-80ab-b6b25224d7ba","Type":"ContainerStarted","Data":"828bc94040572511841e29c458db183aa922604b1e9b23a0d36a3049cf1da9df"}
Aug 01 00:37:53.766015 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:53.765676    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:37:53.767135 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:53.767102    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2" event={"ID":"c6f1a116-ec4e-49c7-8e92-eec6259c8b20","Type":"ContainerStarted","Data":"cd3a68619abc829a724ca25fcd46daf6b80bab22d0e4d8b128f94f46cf07df4f"}
Aug 01 00:37:53.767257 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:53.767175    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:37:53.782061 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:53.782000    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf" podStartSLOduration=1.561270567 podStartE2EDuration="3.781981716s" totalImagesPullingTime="2.220711149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:37:53.779361203 +0000 UTC m=+542.476530265" watchObservedRunningTime="2026-08-01 00:37:53.781981716 +0000 UTC m=+542.479150830"
Aug 01 00:37:53.795951 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:53.795818    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2" podStartSLOduration=1.510481157 podStartE2EDuration="3.795793225s" totalImagesPullingTime="2.285312068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:37:53.793974375 +0000 UTC m=+542.491143435" watchObservedRunningTime="2026-08-01 00:37:53.795793225 +0000 UTC m=+542.492962288"
Aug 01 00:37:59.779980 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:37:59.779949    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-78cdcdf5c7-m9psf"
Aug 01 00:38:00.812446 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:00.812403    2547 generic.go:356] "Generic (PLEG): container finished" podID="f8bad48f-e139-4854-a20c-dc666e8cef05" containerID="91a376eb81a33abb86b7c47fec0f0c43ee64c13008fa84119c10100a4511fc24" exitCode=0
Aug 01 00:38:00.812922 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:00.812508    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" event={"ID":"f8bad48f-e139-4854-a20c-dc666e8cef05","Type":"ContainerDied","Data":"91a376eb81a33abb86b7c47fec0f0c43ee64c13008fa84119c10100a4511fc24"}
Aug 01 00:38:00.812968 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:00.812956    2547 scope.go:117] "RemoveContainer" containerID="91a376eb81a33abb86b7c47fec0f0c43ee64c13008fa84119c10100a4511fc24"
Aug 01 00:38:00.814180 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:00.814138    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:38:00.814355 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:00.814261    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:38:00.814355 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:00.814315    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:38:01.821566 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:01.821527    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" event={"ID":"f8bad48f-e139-4854-a20c-dc666e8cef05","Type":"ContainerStarted","Data":"cb1507959ac807dc76f8687be9b50964fc81565072519730ce5f96caea1ff190"}
Aug 01 00:38:02.273255 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:02.273213    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:38:02.274637 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:02.274603    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-75b9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 01 00:38:02.274786 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:02.274668    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" podUID="f8bad48f-e139-4854-a20c-dc666e8cef05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 01 00:38:03.275380 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:03.275338    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-75b9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 01 00:38:03.275912 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:03.275398    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" podUID="f8bad48f-e139-4854-a20c-dc666e8cef05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 01 00:38:03.295990 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:03.295916    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:38:04.273868 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:04.273832    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-75b9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 01 00:38:04.274063 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:04.273889    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" podUID="f8bad48f-e139-4854-a20c-dc666e8cef05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 01 00:38:04.776941 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:04.776905    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-cd9b2"
Aug 01 00:38:05.273396 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:05.273357    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-75b9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 01 00:38:05.273601 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:05.273417    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" podUID="f8bad48f-e139-4854-a20c-dc666e8cef05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 01 00:38:06.274126 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:06.274077    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-75b9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 01 00:38:06.274542 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:06.274154    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q" podUID="f8bad48f-e139-4854-a20c-dc666e8cef05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 01 00:38:07.278004 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:07.277964    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:38:07.279023 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:07.279004    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-75b9q"
Aug 01 00:38:24.939388 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:24.939348    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"]
Aug 01 00:38:24.945279 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:24.945250    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:24.947659 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:24.947632    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 01 00:38:24.948245 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:24.948224    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 01 00:38:24.948245 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:24.948231    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 01 00:38:24.948435 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:24.948264    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fzrd7\""
Aug 01 00:38:24.954979 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:24.954951    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"]
Aug 01 00:38:25.032897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.032850    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d412798a-a12f-4302-8428-13e7b9a3a741-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.033093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.032904    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shncn\" (UniqueName: \"kubernetes.io/projected/d412798a-a12f-4302-8428-13e7b9a3a741-kube-api-access-shncn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.033093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.032986    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.033093 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.033072    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.033227 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.033140    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.033227 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.033155    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.134664 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.134617    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.134664 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.134661    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.134948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.134691    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d412798a-a12f-4302-8428-13e7b9a3a741-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.134948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.134717    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shncn\" (UniqueName: \"kubernetes.io/projected/d412798a-a12f-4302-8428-13e7b9a3a741-kube-api-access-shncn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.134948 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.134893    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.135111 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.135007    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.135169 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.135125    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.135169 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.135138    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.135253 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.135231    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.137058 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.137034    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d412798a-a12f-4302-8428-13e7b9a3a741-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.137376 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.137357    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d412798a-a12f-4302-8428-13e7b9a3a741-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.142831 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.142804    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shncn\" (UniqueName: \"kubernetes.io/projected/d412798a-a12f-4302-8428-13e7b9a3a741-kube-api-access-shncn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mxbb5\" (UID: \"d412798a-a12f-4302-8428-13e7b9a3a741\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.258429 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.258390    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:25.401877 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.401845    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"]
Aug 01 00:38:25.404223 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:38:25.404191    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd412798a_a12f_4302_8428_13e7b9a3a741.slice/crio-5f81a04a5f80cdcac19f6b7a81f6fbcc48d14ec3bbdf2fe1573f566d087fd7ad WatchSource:0}: Error finding container 5f81a04a5f80cdcac19f6b7a81f6fbcc48d14ec3bbdf2fe1573f566d087fd7ad: Status 404 returned error can't find the container with id 5f81a04a5f80cdcac19f6b7a81f6fbcc48d14ec3bbdf2fe1573f566d087fd7ad
Aug 01 00:38:25.958282 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:25.958234    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5" event={"ID":"d412798a-a12f-4302-8428-13e7b9a3a741","Type":"ContainerStarted","Data":"5f81a04a5f80cdcac19f6b7a81f6fbcc48d14ec3bbdf2fe1573f566d087fd7ad"}
Aug 01 00:38:26.965530 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:26.965473    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5" event={"ID":"d412798a-a12f-4302-8428-13e7b9a3a741","Type":"ContainerStarted","Data":"e75e89c11f6d91a81ff92a7491a9617c86792c6a87934096b9c92bce6d8898b3"}
Aug 01 00:38:26.982160 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:26.982101    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5" podStartSLOduration=1.9074489730000002 podStartE2EDuration="2.982078835s" totalImagesPullingTime="1.074629862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:38:26.981100738 +0000 UTC m=+575.678269800" watchObservedRunningTime="2026-08-01 00:38:26.982078835 +0000 UTC m=+575.679247898"
Aug 01 00:38:35.258697 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:35.258648    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:35.259200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:35.258728    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:35.271658 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:35.271617    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:36.026424 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:36.026385    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mxbb5"
Aug 01 00:38:42.839954 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.839903    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"]
Aug 01 00:38:42.844474 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.844451    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:42.846825 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.846793    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 01 00:38:42.853794 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.853767    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"]
Aug 01 00:38:42.908114 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.908073    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:42.908114 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.908115    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ac2dff-9616-49bf-9cfd-db044b3645cb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:42.908346 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.908151    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:42.908346 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.908176    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4z4h\" (UniqueName: \"kubernetes.io/projected/88ac2dff-9616-49bf-9cfd-db044b3645cb-kube-api-access-j4z4h\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:42.908346 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.908207    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:42.908346 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:42.908266    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009058 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009013    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009058 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009061    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ac2dff-9616-49bf-9cfd-db044b3645cb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009336 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009104    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009336 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009132    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4z4h\" (UniqueName: \"kubernetes.io/projected/88ac2dff-9616-49bf-9cfd-db044b3645cb-kube-api-access-j4z4h\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009336 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009175    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009336 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009206    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009594 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009542    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009655 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009602    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.009707 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.009659    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.011588 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.011564    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ac2dff-9616-49bf-9cfd-db044b3645cb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.011826 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.011809    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ac2dff-9616-49bf-9cfd-db044b3645cb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.017464 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.017426    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4z4h\" (UniqueName: \"kubernetes.io/projected/88ac2dff-9616-49bf-9cfd-db044b3645cb-kube-api-access-j4z4h\") pod \"e2e-trlp-test-simulated-kserve-598466548d-99vrg\" (UID: \"88ac2dff-9616-49bf-9cfd-db044b3645cb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.157298 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.157198    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:43.304551 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:43.304521    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"]
Aug 01 00:38:43.306292 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:38:43.306260    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ac2dff_9616_49bf_9cfd_db044b3645cb.slice/crio-3e640db18e4189433c2a3c2ba5903d24163600f85bdcd54deace27cee7f212ef WatchSource:0}: Error finding container 3e640db18e4189433c2a3c2ba5903d24163600f85bdcd54deace27cee7f212ef: Status 404 returned error can't find the container with id 3e640db18e4189433c2a3c2ba5903d24163600f85bdcd54deace27cee7f212ef
Aug 01 00:38:44.062529 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:44.062460    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg" event={"ID":"88ac2dff-9616-49bf-9cfd-db044b3645cb","Type":"ContainerStarted","Data":"a6dbc16649d37b6631cf3321a78c56e0ef49424ca04c3f574d9443bf8395b5e8"}
Aug 01 00:38:44.063032 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:44.062560    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg" event={"ID":"88ac2dff-9616-49bf-9cfd-db044b3645cb","Type":"ContainerStarted","Data":"3e640db18e4189433c2a3c2ba5903d24163600f85bdcd54deace27cee7f212ef"}
Aug 01 00:38:44.082294 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:44.082232    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg" podStartSLOduration=1.903339018 podStartE2EDuration="2.082211498s" totalImagesPullingTime="178.87248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:38:44.080686603 +0000 UTC m=+592.777855666" watchObservedRunningTime="2026-08-01 00:38:44.082211498 +0000 UTC m=+592.779380559"
Aug 01 00:38:51.781212 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:51.781180    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:38:51.787239 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:51.787211    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:38:53.157528 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:53.157466    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:53.157983 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:53.157562    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:53.170233 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:53.170203    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:38:54.128316 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:38:54.128280    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-99vrg"
Aug 01 00:40:08.080993 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.080938    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7864fb5f8d-vdqnm"]
Aug 01 00:40:08.081658 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.081140    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm" podUID="d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a" containerName="authorino" containerID="cri-o://90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d" gracePeriod=30
Aug 01 00:40:08.341214 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.341137    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:40:08.465187 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.465149    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dw47\" (UniqueName: \"kubernetes.io/projected/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-kube-api-access-7dw47\") pod \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\" (UID: \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\") "
Aug 01 00:40:08.465363 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.465311    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-tls-cert\") pod \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\" (UID: \"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a\") "
Aug 01 00:40:08.467388 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.467352    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-kube-api-access-7dw47" (OuterVolumeSpecName: "kube-api-access-7dw47") pod "d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a" (UID: "d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a"). InnerVolumeSpecName "kube-api-access-7dw47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:40:08.479374 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.479343    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a" (UID: "d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:40:08.539072 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.539033    2547 generic.go:356] "Generic (PLEG): container finished" podID="d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a" containerID="90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d" exitCode=0
Aug 01 00:40:08.539265 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.539077    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm"
Aug 01 00:40:08.539265 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.539117    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm" event={"ID":"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a","Type":"ContainerDied","Data":"90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d"}
Aug 01 00:40:08.539265 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.539162    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7864fb5f8d-vdqnm" event={"ID":"d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a","Type":"ContainerDied","Data":"382924ae33de474211c29aaa10bf720d5f8e30a7da526263a53d33025b433897"}
Aug 01 00:40:08.539265 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.539183    2547 scope.go:117] "RemoveContainer" containerID="90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d"
Aug 01 00:40:08.548901 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.548881    2547 scope.go:117] "RemoveContainer" containerID="90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d"
Aug 01 00:40:08.549217 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:40:08.549197    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d\": container with ID starting with 90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d not found: ID does not exist" containerID="90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d"
Aug 01 00:40:08.549258 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.549226    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d"} err="failed to get container status \"90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d\": rpc error: code = NotFound desc = could not find container \"90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d\": container with ID starting with 90bed8592e83a552bee57fa4ed3d61b86f10b9f5d450736e07cb8e0055b9848d not found: ID does not exist"
Aug 01 00:40:08.566362 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.566327    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-tls-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:40:08.566362 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.566353    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dw47\" (UniqueName: \"kubernetes.io/projected/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a-kube-api-access-7dw47\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:40:08.567420 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.567391    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7864fb5f8d-vdqnm"]
Aug 01 00:40:08.571764 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:08.571733    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7864fb5f8d-vdqnm"]
Aug 01 00:40:09.880915 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:40:09.880879    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a" path="/var/lib/kubelet/pods/d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a/volumes"
Aug 01 00:43:51.817004 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:43:51.816972    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:43:51.819091 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:43:51.819065    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:48:51.850288 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:48:51.850180    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:48:51.854369 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:48:51.850393    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:53:51.883513 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:53:51.883368    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:53:51.887650 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:53:51.885139    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:58:09.079796 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.079764    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"]
Aug 01 00:58:09.080246 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.080211    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a" containerName="authorino"
Aug 01 00:58:09.080246 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.080225    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a" containerName="authorino"
Aug 01 00:58:09.080356 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.080295    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d29ad9-79ff-4c3e-bfb0-ff97a7c50f1a" containerName="authorino"
Aug 01 00:58:09.083453 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.083434    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.085603 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.085579    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-202229e0-openshift-default-dockercfg-rgxmp\""
Aug 01 00:58:09.109214 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.109191    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"]
Aug 01 00:58:09.208071 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208035    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-certs\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.208071 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208075    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-data\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.208318 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208090    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-token\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.208318 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208196    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-envoy\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.208318 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208263    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-podinfo\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.208318 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208298    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djbd\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-kube-api-access-7djbd\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.208511 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208329    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-socket\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.208511 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208352    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istiod-ca-cert\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.208511 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.208380    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-credential-socket\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.308982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.308949    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-certs\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.308982 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.308980    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-data\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.308998    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-token\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309026    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-envoy\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309133    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-podinfo\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309200 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309187    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djbd\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-kube-api-access-7djbd\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309218    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-socket\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309353    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-certs\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309382    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-data\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309399    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istiod-ca-cert\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309461 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309434    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-credential-socket\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309706 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309564    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-socket\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.309842 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.309819    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-credential-socket\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.310110 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.310093    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istiod-ca-cert\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.311281 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.311262    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-envoy\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.311528 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.311509    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-podinfo\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.316011 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.315992    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-token\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.316632 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.316615    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djbd\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-kube-api-access-7djbd\") pod \"e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") " pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.394295 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.394242    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:09.530708 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.530684    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"]
Aug 01 00:58:09.532841 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:58:09.532816    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0898d0ac_e12b_4800_9fbd_656bdc5d8298.slice/crio-5bbe8df1264d1e0071a6e174db90b4f7aaaec35561d9da92860f2a18b4fa83e0 WatchSource:0}: Error finding container 5bbe8df1264d1e0071a6e174db90b4f7aaaec35561d9da92860f2a18b4fa83e0: Status 404 returned error can't find the container with id 5bbe8df1264d1e0071a6e174db90b4f7aaaec35561d9da92860f2a18b4fa83e0
Aug 01 00:58:09.534947 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.534911    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:58:09.535044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.534976    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:58:09.535044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:09.535008    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:58:10.466653 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:10.466620    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" event={"ID":"0898d0ac-e12b-4800-9fbd-656bdc5d8298","Type":"ContainerStarted","Data":"84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207"}
Aug 01 00:58:10.467042 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:10.466668    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" event={"ID":"0898d0ac-e12b-4800-9fbd-656bdc5d8298","Type":"ContainerStarted","Data":"5bbe8df1264d1e0071a6e174db90b4f7aaaec35561d9da92860f2a18b4fa83e0"}
Aug 01 00:58:10.487861 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:10.487819    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podStartSLOduration=1.487805962 podStartE2EDuration="1.487805962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:58:10.485882302 +0000 UTC m=+1759.183051363" watchObservedRunningTime="2026-08-01 00:58:10.487805962 +0000 UTC m=+1759.184975030"
Aug 01 00:58:11.394470 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:11.394432    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:11.399166 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:11.399141    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:11.472278 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:11.472251    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:11.473143 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:11.473121    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:26.473535 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:26.473473    2547 patch_prober.go:28] interesting pod/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Aug 01 00:58:26.473952 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:26.473566    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Aug 01 00:58:26.561374 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:26.561346    2547 generic.go:356] "Generic (PLEG): container finished" podID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerID="84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207" exitCode=0
Aug 01 00:58:26.561537 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:26.561420    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" event={"ID":"0898d0ac-e12b-4800-9fbd-656bdc5d8298","Type":"ContainerDied","Data":"84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207"}
Aug 01 00:58:26.561804 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:26.561788    2547 scope.go:117] "RemoveContainer" containerID="84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207"
Aug 01 00:58:26.562746 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:26.562718    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:58:26.562843 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:26.562779    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:58:26.562843 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:26.562811    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 00:58:27.568202 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:27.568168    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" event={"ID":"0898d0ac-e12b-4800-9fbd-656bdc5d8298","Type":"ContainerStarted","Data":"93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55"}
Aug 01 00:58:28.395267 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:28.395238    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:28.395599 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:28.395575    2547 patch_prober.go:28] interesting pod/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Aug 01 00:58:28.395773 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:28.395749    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Aug 01 00:58:29.394865 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:29.394819    2547 patch_prober.go:28] interesting pod/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Aug 01 00:58:29.395295 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:29.394889    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Aug 01 00:58:30.394832 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:30.394793    2547 patch_prober.go:28] interesting pod/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Aug 01 00:58:30.395125 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:30.394857    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Aug 01 00:58:31.395068 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:31.395031    2547 patch_prober.go:28] interesting pod/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Aug 01 00:58:31.395351 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:31.395324    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Aug 01 00:58:32.395055 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:32.395014    2547 patch_prober.go:28] interesting pod/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Aug 01 00:58:32.395254 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:32.395075    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Aug 01 00:58:33.397995 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:33.397963    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:33.398459 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:33.398350    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:33.398869 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:33.398851    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:37.294593 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.294564    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"]
Aug 01 00:58:37.298249 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.298232    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"
Aug 01 00:58:37.300326 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.300308    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 00:58:37.303756 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.303739    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"]
Aug 01 00:58:37.364371 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.364336    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3442f25a-d21c-4567-be74-a251f867eeeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-202229e0-7dn2p\" (UID: \"3442f25a-d21c-4567-be74-a251f867eeeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"
Aug 01 00:58:37.465744 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.465705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3442f25a-d21c-4567-be74-a251f867eeeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-202229e0-7dn2p\" (UID: \"3442f25a-d21c-4567-be74-a251f867eeeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"
Aug 01 00:58:37.466334 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.466315    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3442f25a-d21c-4567-be74-a251f867eeeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-202229e0-7dn2p\" (UID: \"3442f25a-d21c-4567-be74-a251f867eeeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"
Aug 01 00:58:37.610267 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.610189    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"
Aug 01 00:58:37.742881 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.742855    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"]
Aug 01 00:58:37.745023 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:58:37.744994    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3442f25a_d21c_4567_be74_a251f867eeeb.slice/crio-4ef5c8c97fa78cd8d4d9c6891e961e29f7d5ae4048d5bf717f43193d03be6e72 WatchSource:0}: Error finding container 4ef5c8c97fa78cd8d4d9c6891e961e29f7d5ae4048d5bf717f43193d03be6e72: Status 404 returned error can't find the container with id 4ef5c8c97fa78cd8d4d9c6891e961e29f7d5ae4048d5bf717f43193d03be6e72
Aug 01 00:58:37.746856 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:37.746838    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 01 00:58:38.634392 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:38.634354    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p" event={"ID":"3442f25a-d21c-4567-be74-a251f867eeeb","Type":"ContainerStarted","Data":"4ef5c8c97fa78cd8d4d9c6891e961e29f7d5ae4048d5bf717f43193d03be6e72"}
Aug 01 00:58:40.648543 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:40.648512    2547 generic.go:356] "Generic (PLEG): container finished" podID="3442f25a-d21c-4567-be74-a251f867eeeb" containerID="9482196ac273a20e0385069cb6b424736cf45402aee3ab23f85f28b1d3186bbd" exitCode=0
Aug 01 00:58:40.648862 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:40.648577    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p" event={"ID":"3442f25a-d21c-4567-be74-a251f867eeeb","Type":"ContainerDied","Data":"9482196ac273a20e0385069cb6b424736cf45402aee3ab23f85f28b1d3186bbd"}
Aug 01 00:58:41.790926 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:41.790898    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"
Aug 01 00:58:41.906889 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:41.906809    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3442f25a-d21c-4567-be74-a251f867eeeb-maas-api-service-ca\") pod \"3442f25a-d21c-4567-be74-a251f867eeeb\" (UID: \"3442f25a-d21c-4567-be74-a251f867eeeb\") "
Aug 01 00:58:41.907132 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:41.907109    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3442f25a-d21c-4567-be74-a251f867eeeb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3442f25a-d21c-4567-be74-a251f867eeeb" (UID: "3442f25a-d21c-4567-be74-a251f867eeeb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:58:42.007790 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:42.007759    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3442f25a-d21c-4567-be74-a251f867eeeb-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:42.660714 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:42.660684    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"
Aug 01 00:58:42.660892 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:42.660720    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p" event={"ID":"3442f25a-d21c-4567-be74-a251f867eeeb","Type":"ContainerDied","Data":"4ef5c8c97fa78cd8d4d9c6891e961e29f7d5ae4048d5bf717f43193d03be6e72"}
Aug 01 00:58:42.660892 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:42.660762    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ef5c8c97fa78cd8d4d9c6891e961e29f7d5ae4048d5bf717f43193d03be6e72"
Aug 01 00:58:43.717122 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:43.717040    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"]
Aug 01 00:58:43.719795 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:43.719767    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-202229e0-7dn2p"]
Aug 01 00:58:43.838123 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:43.838089    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"]
Aug 01 00:58:43.838380 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:43.838344    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy" containerID="cri-o://93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55" gracePeriod=30
Aug 01 00:58:43.883802 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:43.883771    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3442f25a-d21c-4567-be74-a251f867eeeb" path="/var/lib/kubelet/pods/3442f25a-d21c-4567-be74-a251f867eeeb/volumes"
Aug 01 00:58:48.400662 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:48.400630    2547 patch_prober.go:28] interesting pod/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 01 00:58:48.401023 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:48.400688    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 01 00:58:49.101964 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.101941    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:49.178531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178437    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istiod-ca-cert\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.178531 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178524    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-credential-socket\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.178747 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178564    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7djbd\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-kube-api-access-7djbd\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.178747 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178614    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-envoy\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.178747 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178647    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-socket\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.178747 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178686    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-podinfo\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.178747 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178729    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-token\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.179014 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178813    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-certs\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.179014 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178841    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-data\") pod \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\" (UID: \"0898d0ac-e12b-4800-9fbd-656bdc5d8298\") "
Aug 01 00:58:49.179014 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178867    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:58:49.179014 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178933    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:58:49.179014 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.178855    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:58:49.179250 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.179140    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:58:49.179250 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.179151    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-data" (OuterVolumeSpecName: "istio-data") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:58:49.179250 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.179239    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.179361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.179256    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.179361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.179270    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.179361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.179282    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.179361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.179294    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.180762 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.180739    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-kube-api-access-7djbd" (OuterVolumeSpecName: "kube-api-access-7djbd") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "kube-api-access-7djbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:58:49.180869 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.180789    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-token" (OuterVolumeSpecName: "istio-token") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:58:49.181130 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.181102    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 01 00:58:49.181130 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.181108    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0898d0ac-e12b-4800-9fbd-656bdc5d8298" (UID: "0898d0ac-e12b-4800-9fbd-656bdc5d8298"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 00:58:49.280747 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.280713    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7djbd\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-kube-api-access-7djbd\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.280747 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.280745    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.280747 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.280757    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.280918 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.280765    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0898d0ac-e12b-4800-9fbd-656bdc5d8298-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:58:49.698664 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.698629    2547 generic.go:356] "Generic (PLEG): container finished" podID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerID="93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55" exitCode=0
Aug 01 00:58:49.699109 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.698673    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"
Aug 01 00:58:49.699109 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.698717    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" event={"ID":"0898d0ac-e12b-4800-9fbd-656bdc5d8298","Type":"ContainerDied","Data":"93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55"}
Aug 01 00:58:49.699109 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.698782    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x" event={"ID":"0898d0ac-e12b-4800-9fbd-656bdc5d8298","Type":"ContainerDied","Data":"5bbe8df1264d1e0071a6e174db90b4f7aaaec35561d9da92860f2a18b4fa83e0"}
Aug 01 00:58:49.699109 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.698818    2547 scope.go:117] "RemoveContainer" containerID="93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55"
Aug 01 00:58:49.708539 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.708520    2547 scope.go:117] "RemoveContainer" containerID="84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207"
Aug 01 00:58:49.716015 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.716000    2547 scope.go:117] "RemoveContainer" containerID="93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55"
Aug 01 00:58:49.716253 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:58:49.716237    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55\": container with ID starting with 93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55 not found: ID does not exist" containerID="93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55"
Aug 01 00:58:49.716290 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.716262    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55"} err="failed to get container status \"93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55\": rpc error: code = NotFound desc = could not find container \"93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55\": container with ID starting with 93d0fa1e31b2bf84faa9cd62a2d82dc55eab2cf6774a13baf4b8de1ec98aea55 not found: ID does not exist"
Aug 01 00:58:49.716290 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.716279    2547 scope.go:117] "RemoveContainer" containerID="84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207"
Aug 01 00:58:49.716519 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:58:49.716502    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207\": container with ID starting with 84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207 not found: ID does not exist" containerID="84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207"
Aug 01 00:58:49.716561 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.716527    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207"} err="failed to get container status \"84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207\": rpc error: code = NotFound desc = could not find container \"84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207\": container with ID starting with 84724596e6770b4dd93e136108e8e2fd40de7bc138c46b8d6b978633b05de207 not found: ID does not exist"
Aug 01 00:58:49.720867 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.720846    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"]
Aug 01 00:58:49.724425 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.724405    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-202229e0-openshift-default-687d4dc74d-f8v4x"]
Aug 01 00:58:49.880647 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:49.880615    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" path="/var/lib/kubelet/pods/0898d0ac-e12b-4800-9fbd-656bdc5d8298/volumes"
Aug 01 00:58:51.303702 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.303668    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"]
Aug 01 00:58:51.304161 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304135    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy"
Aug 01 00:58:51.304161 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304157    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy"
Aug 01 00:58:51.304341 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304171    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy"
Aug 01 00:58:51.304341 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304179    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy"
Aug 01 00:58:51.304341 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304215    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3442f25a-d21c-4567-be74-a251f867eeeb" containerName="revoke-keys"
Aug 01 00:58:51.304341 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304224    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3442f25a-d21c-4567-be74-a251f867eeeb" containerName="revoke-keys"
Aug 01 00:58:51.304341 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304328    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3442f25a-d21c-4567-be74-a251f867eeeb" containerName="revoke-keys"
Aug 01 00:58:51.304341 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304339    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy"
Aug 01 00:58:51.304657 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.304350    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0898d0ac-e12b-4800-9fbd-656bdc5d8298" containerName="istio-proxy"
Aug 01 00:58:51.307613 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.307594    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:51.309936 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.309914    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d5eeee24\""
Aug 01 00:58:51.310028 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.309917    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d5eeee24-dockercfg-jwmp9\""
Aug 01 00:58:51.316833 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.316806    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"]
Aug 01 00:58:51.400986 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.400954    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56rk7\" (UniqueName: \"kubernetes.io/projected/104ab2af-3606-4693-bb05-f3b08078f7e4-kube-api-access-56rk7\") pod \"payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv\" (UID: \"104ab2af-3606-4693-bb05-f3b08078f7e4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:51.401165 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.401050    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104ab2af-3606-4693-bb05-f3b08078f7e4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv\" (UID: \"104ab2af-3606-4693-bb05-f3b08078f7e4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:51.502223 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.502187    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56rk7\" (UniqueName: \"kubernetes.io/projected/104ab2af-3606-4693-bb05-f3b08078f7e4-kube-api-access-56rk7\") pod \"payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv\" (UID: \"104ab2af-3606-4693-bb05-f3b08078f7e4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:51.502412 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.502259    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104ab2af-3606-4693-bb05-f3b08078f7e4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv\" (UID: \"104ab2af-3606-4693-bb05-f3b08078f7e4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:51.502955 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.502934    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104ab2af-3606-4693-bb05-f3b08078f7e4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv\" (UID: \"104ab2af-3606-4693-bb05-f3b08078f7e4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:51.512690 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.512664    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56rk7\" (UniqueName: \"kubernetes.io/projected/104ab2af-3606-4693-bb05-f3b08078f7e4-kube-api-access-56rk7\") pod \"payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv\" (UID: \"104ab2af-3606-4693-bb05-f3b08078f7e4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:51.619122 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.619048    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:51.751814 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.751780    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"]
Aug 01 00:58:51.753529 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:58:51.753503    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104ab2af_3606_4693_bb05_f3b08078f7e4.slice/crio-ca93c95b01e5c45614604251d455260d27a71a390d59f536b55820dcf643767e WatchSource:0}: Error finding container ca93c95b01e5c45614604251d455260d27a71a390d59f536b55820dcf643767e: Status 404 returned error can't find the container with id ca93c95b01e5c45614604251d455260d27a71a390d59f536b55820dcf643767e
Aug 01 00:58:51.920767 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.920691    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:58:51.925682 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:51.925661    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 00:58:52.719169 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:52.719132    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv" event={"ID":"104ab2af-3606-4693-bb05-f3b08078f7e4","Type":"ContainerStarted","Data":"71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8"}
Aug 01 00:58:52.719599 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:52.719192    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv" event={"ID":"104ab2af-3606-4693-bb05-f3b08078f7e4","Type":"ContainerStarted","Data":"ca93c95b01e5c45614604251d455260d27a71a390d59f536b55820dcf643767e"}
Aug 01 00:58:52.719599 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:52.719337    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:58:52.735280 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:58:52.735238    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv" podStartSLOduration=1.735225096 podStartE2EDuration="1.735225096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:58:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:58:52.733366748 +0000 UTC m=+1801.430535808" watchObservedRunningTime="2026-08-01 00:58:52.735225096 +0000 UTC m=+1801.432394203"
Aug 01 00:59:03.727291 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:03.727260    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:59:15.370225 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.370192    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"]
Aug 01 00:59:15.378947 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.378920    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"
Aug 01 00:59:15.380395 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.380368    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"]
Aug 01 00:59:15.381333 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.381311    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 00:59:15.403361 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.403335    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3986f4-f418-4f0c-a54f-c16dc0b9d845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67\" (UID: \"ba3986f4-f418-4f0c-a54f-c16dc0b9d845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"
Aug 01 00:59:15.504268 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.504244    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3986f4-f418-4f0c-a54f-c16dc0b9d845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67\" (UID: \"ba3986f4-f418-4f0c-a54f-c16dc0b9d845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"
Aug 01 00:59:15.504873 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.504849    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3986f4-f418-4f0c-a54f-c16dc0b9d845-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67\" (UID: \"ba3986f4-f418-4f0c-a54f-c16dc0b9d845\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"
Aug 01 00:59:15.691385 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.691303    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"
Aug 01 00:59:15.823657 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.823631    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"]
Aug 01 00:59:15.826382 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:59:15.826356    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3986f4_f418_4f0c_a54f_c16dc0b9d845.slice/crio-8415c5fdf0df7a10b23fa221801fce9c3e8af93d10d6573fcd91c2361698d80d WatchSource:0}: Error finding container 8415c5fdf0df7a10b23fa221801fce9c3e8af93d10d6573fcd91c2361698d80d: Status 404 returned error can't find the container with id 8415c5fdf0df7a10b23fa221801fce9c3e8af93d10d6573fcd91c2361698d80d
Aug 01 00:59:15.838626 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:15.838597    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67" event={"ID":"ba3986f4-f418-4f0c-a54f-c16dc0b9d845","Type":"ContainerStarted","Data":"8415c5fdf0df7a10b23fa221801fce9c3e8af93d10d6573fcd91c2361698d80d"}
Aug 01 00:59:16.845080 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:16.845039    2547 generic.go:356] "Generic (PLEG): container finished" podID="ba3986f4-f418-4f0c-a54f-c16dc0b9d845" containerID="8e3f8447797886ba3e3794e2adf347952b87308c04e3f78f3ec3b7ff0d2a0632" exitCode=0
Aug 01 00:59:16.845432 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:16.845122    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67" event={"ID":"ba3986f4-f418-4f0c-a54f-c16dc0b9d845","Type":"ContainerDied","Data":"8e3f8447797886ba3e3794e2adf347952b87308c04e3f78f3ec3b7ff0d2a0632"}
Aug 01 00:59:17.981958 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:17.981934    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"
Aug 01 00:59:18.027723 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:18.027697    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3986f4-f418-4f0c-a54f-c16dc0b9d845-maas-api-service-ca\") pod \"ba3986f4-f418-4f0c-a54f-c16dc0b9d845\" (UID: \"ba3986f4-f418-4f0c-a54f-c16dc0b9d845\") "
Aug 01 00:59:18.028026 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:18.028005    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba3986f4-f418-4f0c-a54f-c16dc0b9d845-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba3986f4-f418-4f0c-a54f-c16dc0b9d845" (UID: "ba3986f4-f418-4f0c-a54f-c16dc0b9d845"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:59:18.128580 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:18.128500    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3986f4-f418-4f0c-a54f-c16dc0b9d845-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:18.856918 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:18.856883    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67" event={"ID":"ba3986f4-f418-4f0c-a54f-c16dc0b9d845","Type":"ContainerDied","Data":"8415c5fdf0df7a10b23fa221801fce9c3e8af93d10d6573fcd91c2361698d80d"}
Aug 01 00:59:18.856918 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:18.856900    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"
Aug 01 00:59:18.857133 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:18.856935    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8415c5fdf0df7a10b23fa221801fce9c3e8af93d10d6573fcd91c2361698d80d"
Aug 01 00:59:21.104986 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.104949    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"]
Aug 01 00:59:21.105453 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.105284    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv" podUID="104ab2af-3606-4693-bb05-f3b08078f7e4" containerName="payload-processing" containerID="cri-o://71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8" gracePeriod=30
Aug 01 00:59:21.237587 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.237554    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"]
Aug 01 00:59:21.240034 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.240000    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d5eeee24-bnb67"]
Aug 01 00:59:21.369544 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.369469    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:59:21.460625 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.460590    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56rk7\" (UniqueName: \"kubernetes.io/projected/104ab2af-3606-4693-bb05-f3b08078f7e4-kube-api-access-56rk7\") pod \"104ab2af-3606-4693-bb05-f3b08078f7e4\" (UID: \"104ab2af-3606-4693-bb05-f3b08078f7e4\") "
Aug 01 00:59:21.460792 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.460746    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104ab2af-3606-4693-bb05-f3b08078f7e4-plugins-config-volume\") pod \"104ab2af-3606-4693-bb05-f3b08078f7e4\" (UID: \"104ab2af-3606-4693-bb05-f3b08078f7e4\") "
Aug 01 00:59:21.461116 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.461079    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/104ab2af-3606-4693-bb05-f3b08078f7e4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "104ab2af-3606-4693-bb05-f3b08078f7e4" (UID: "104ab2af-3606-4693-bb05-f3b08078f7e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:59:21.462731 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.462707    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/104ab2af-3606-4693-bb05-f3b08078f7e4-kube-api-access-56rk7" (OuterVolumeSpecName: "kube-api-access-56rk7") pod "104ab2af-3606-4693-bb05-f3b08078f7e4" (UID: "104ab2af-3606-4693-bb05-f3b08078f7e4"). InnerVolumeSpecName "kube-api-access-56rk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:59:21.561925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.561900    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/104ab2af-3606-4693-bb05-f3b08078f7e4-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:21.561925 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.561924    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56rk7\" (UniqueName: \"kubernetes.io/projected/104ab2af-3606-4693-bb05-f3b08078f7e4-kube-api-access-56rk7\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:21.876170 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.876139    2547 generic.go:356] "Generic (PLEG): container finished" podID="104ab2af-3606-4693-bb05-f3b08078f7e4" containerID="71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8" exitCode=0
Aug 01 00:59:21.876357 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.876347    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"
Aug 01 00:59:21.880953 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.880926    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba3986f4-f418-4f0c-a54f-c16dc0b9d845" path="/var/lib/kubelet/pods/ba3986f4-f418-4f0c-a54f-c16dc0b9d845/volumes"
Aug 01 00:59:21.881297 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.881280    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv" event={"ID":"104ab2af-3606-4693-bb05-f3b08078f7e4","Type":"ContainerDied","Data":"71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8"}
Aug 01 00:59:21.881357 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.881317    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv" event={"ID":"104ab2af-3606-4693-bb05-f3b08078f7e4","Type":"ContainerDied","Data":"ca93c95b01e5c45614604251d455260d27a71a390d59f536b55820dcf643767e"}
Aug 01 00:59:21.881357 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.881342    2547 scope.go:117] "RemoveContainer" containerID="71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8"
Aug 01 00:59:21.891782 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.891764    2547 scope.go:117] "RemoveContainer" containerID="71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8"
Aug 01 00:59:21.892022 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:59:21.892006    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8\": container with ID starting with 71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8 not found: ID does not exist" containerID="71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8"
Aug 01 00:59:21.892076 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.892030    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8"} err="failed to get container status \"71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8\": rpc error: code = NotFound desc = could not find container \"71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8\": container with ID starting with 71f0f9d497d98d10ca9ea7c53d46fde74f2171b720029fb0dad351ef1e707bc8 not found: ID does not exist"
Aug 01 00:59:21.902230 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.902208    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"]
Aug 01 00:59:21.905785 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:21.905763    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d5eeee24-69f678cd77-sh8nv"]
Aug 01 00:59:23.881241 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:23.881206    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="104ab2af-3606-4693-bb05-f3b08078f7e4" path="/var/lib/kubelet/pods/104ab2af-3606-4693-bb05-f3b08078f7e4/volumes"
Aug 01 00:59:25.774165 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.774135    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"]
Aug 01 00:59:25.774744 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.774719    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="104ab2af-3606-4693-bb05-f3b08078f7e4" containerName="payload-processing"
Aug 01 00:59:25.774744 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.774744    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="104ab2af-3606-4693-bb05-f3b08078f7e4" containerName="payload-processing"
Aug 01 00:59:25.774897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.774790    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3986f4-f418-4f0c-a54f-c16dc0b9d845" containerName="revoke-keys"
Aug 01 00:59:25.774897 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.774800    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3986f4-f418-4f0c-a54f-c16dc0b9d845" containerName="revoke-keys"
Aug 01 00:59:25.774961 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.774902    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba3986f4-f418-4f0c-a54f-c16dc0b9d845" containerName="revoke-keys"
Aug 01 00:59:25.774961 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.774917    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="104ab2af-3606-4693-bb05-f3b08078f7e4" containerName="payload-processing"
Aug 01 00:59:25.777964 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.777944    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:25.780349 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.780331    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-99a0aaf4-serving-cert\""
Aug 01 00:59:25.788869 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.788850    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"]
Aug 01 00:59:25.902387 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.902353    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19602049-ff60-4804-bf63-6137ef55971a-openshift-service-ca\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:25.902605 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.902403    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19602049-ff60-4804-bf63-6137ef55971a-maas-api-tls\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:25.902605 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:25.902465    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjggd\" (UniqueName: \"kubernetes.io/projected/19602049-ff60-4804-bf63-6137ef55971a-kube-api-access-wjggd\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.003080 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.003052    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19602049-ff60-4804-bf63-6137ef55971a-openshift-service-ca\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.003252 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.003113    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19602049-ff60-4804-bf63-6137ef55971a-maas-api-tls\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.003252 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.003150    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjggd\" (UniqueName: \"kubernetes.io/projected/19602049-ff60-4804-bf63-6137ef55971a-kube-api-access-wjggd\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.003694 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.003674    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19602049-ff60-4804-bf63-6137ef55971a-openshift-service-ca\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.005462 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.005434    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19602049-ff60-4804-bf63-6137ef55971a-maas-api-tls\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.010756 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.010736    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjggd\" (UniqueName: \"kubernetes.io/projected/19602049-ff60-4804-bf63-6137ef55971a-kube-api-access-wjggd\") pod \"maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.088766 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.088687    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.230227 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.230192    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"]
Aug 01 00:59:26.230980 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:59:26.230955    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19602049_ff60_4804_bf63_6137ef55971a.slice/crio-773a24627d60f2e839be4a2851ed10bc246634de1bf55fc3d5734217937022a9 WatchSource:0}: Error finding container 773a24627d60f2e839be4a2851ed10bc246634de1bf55fc3d5734217937022a9: Status 404 returned error can't find the container with id 773a24627d60f2e839be4a2851ed10bc246634de1bf55fc3d5734217937022a9
Aug 01 00:59:26.382729 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.382652    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"]
Aug 01 00:59:26.387508 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.387472    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:26.390220 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.390199    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-99a0aaf4\""
Aug 01 00:59:26.399008 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.398983    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"]
Aug 01 00:59:26.508989 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.508948    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p\" (UID: \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:26.509169 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.509055    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdlm8\" (UniqueName: \"kubernetes.io/projected/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-kube-api-access-bdlm8\") pod \"payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p\" (UID: \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:26.610485 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.610447    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlm8\" (UniqueName: \"kubernetes.io/projected/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-kube-api-access-bdlm8\") pod \"payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p\" (UID: \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:26.610595 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.610549    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p\" (UID: \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:26.611123 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.611104    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p\" (UID: \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:26.618088 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.618058    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdlm8\" (UniqueName: \"kubernetes.io/projected/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-kube-api-access-bdlm8\") pod \"payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p\" (UID: \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:26.699225 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.699149    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:26.905210 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.905163    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5" event={"ID":"19602049-ff60-4804-bf63-6137ef55971a","Type":"ContainerStarted","Data":"97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834"}
Aug 01 00:59:26.905628 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.905321    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:26.905628 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.905363    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5" event={"ID":"19602049-ff60-4804-bf63-6137ef55971a","Type":"ContainerStarted","Data":"773a24627d60f2e839be4a2851ed10bc246634de1bf55fc3d5734217937022a9"}
Aug 01 00:59:26.921766 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:26.921722    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5" podStartSLOduration=1.5774138359999998 podStartE2EDuration="1.921709304s" totalImagesPullingTime="344.295468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:59:26.919082017 +0000 UTC m=+1835.616251073" watchObservedRunningTime="2026-08-01 00:59:26.921709304 +0000 UTC m=+1835.618878365"
Aug 01 00:59:27.035452 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:27.035422    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"]
Aug 01 00:59:27.038637 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:59:27.038609    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ca6a0a_806c_4ad8_a51d_7d8bc96af3f4.slice/crio-1fc4a953a9f1cd020d6fe67c4ef37846337bdf7e483c4b699fe4bf1cf773510c WatchSource:0}: Error finding container 1fc4a953a9f1cd020d6fe67c4ef37846337bdf7e483c4b699fe4bf1cf773510c: Status 404 returned error can't find the container with id 1fc4a953a9f1cd020d6fe67c4ef37846337bdf7e483c4b699fe4bf1cf773510c
Aug 01 00:59:27.911815 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:27.911780    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p" event={"ID":"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4","Type":"ContainerStarted","Data":"fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173"}
Aug 01 00:59:27.912157 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:27.911936    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:27.912157 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:27.911963    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p" event={"ID":"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4","Type":"ContainerStarted","Data":"1fc4a953a9f1cd020d6fe67c4ef37846337bdf7e483c4b699fe4bf1cf773510c"}
Aug 01 00:59:27.926084 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:27.926036    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p" podStartSLOduration=1.9260211040000002 podStartE2EDuration="1.926021104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:59:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:59:27.924504953 +0000 UTC m=+1836.621674015" watchObservedRunningTime="2026-08-01 00:59:27.926021104 +0000 UTC m=+1836.623190215"
Aug 01 00:59:32.916672 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:32.916641    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:38.919626 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:38.919597    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:50.267322 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.267291    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"]
Aug 01 00:59:50.271803 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.271788    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"
Aug 01 00:59:50.273796 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.273781    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 00:59:50.277301 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.277277    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"]
Aug 01 00:59:50.420813 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.420789    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cbb3d-3e29-4c73-b987-6f94722cd88c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv\" (UID: \"ba0cbb3d-3e29-4c73-b987-6f94722cd88c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"
Aug 01 00:59:50.522236 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.522168    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cbb3d-3e29-4c73-b987-6f94722cd88c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv\" (UID: \"ba0cbb3d-3e29-4c73-b987-6f94722cd88c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"
Aug 01 00:59:50.522735 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.522717    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cbb3d-3e29-4c73-b987-6f94722cd88c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv\" (UID: \"ba0cbb3d-3e29-4c73-b987-6f94722cd88c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"
Aug 01 00:59:50.583149 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.583129    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"
Aug 01 00:59:50.711406 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:50.711381    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"]
Aug 01 00:59:50.713495 ip-10-0-131-26 kubenswrapper[2547]: W0801 00:59:50.713441    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0cbb3d_3e29_4c73_b987_6f94722cd88c.slice/crio-2ca366a96205c8962197099a2024dce0abac18697179c0018b7edd75159ca3b3 WatchSource:0}: Error finding container 2ca366a96205c8962197099a2024dce0abac18697179c0018b7edd75159ca3b3: Status 404 returned error can't find the container with id 2ca366a96205c8962197099a2024dce0abac18697179c0018b7edd75159ca3b3
Aug 01 00:59:51.032580 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:51.032553    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv" event={"ID":"ba0cbb3d-3e29-4c73-b987-6f94722cd88c","Type":"ContainerStarted","Data":"95d174c7d9e66cad29092fd5dd4197061c8b320a777c7a0518c947e190e21ce8"}
Aug 01 00:59:51.032704 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:51.032604    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv" event={"ID":"ba0cbb3d-3e29-4c73-b987-6f94722cd88c","Type":"ContainerStarted","Data":"2ca366a96205c8962197099a2024dce0abac18697179c0018b7edd75159ca3b3"}
Aug 01 00:59:51.048579 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:51.048536    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv" podStartSLOduration=1.048522551 podStartE2EDuration="1.048522551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 00:59:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 00:59:51.04676663 +0000 UTC m=+1859.743935691" watchObservedRunningTime="2026-08-01 00:59:51.048522551 +0000 UTC m=+1859.745691625"
Aug 01 00:59:52.038277 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:52.038245    2547 generic.go:356] "Generic (PLEG): container finished" podID="ba0cbb3d-3e29-4c73-b987-6f94722cd88c" containerID="95d174c7d9e66cad29092fd5dd4197061c8b320a777c7a0518c947e190e21ce8" exitCode=0
Aug 01 00:59:52.038577 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:52.038324    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv" event={"ID":"ba0cbb3d-3e29-4c73-b987-6f94722cd88c","Type":"ContainerDied","Data":"95d174c7d9e66cad29092fd5dd4197061c8b320a777c7a0518c947e190e21ce8"}
Aug 01 00:59:53.182041 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:53.182018    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"
Aug 01 00:59:53.247866 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:53.247840    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cbb3d-3e29-4c73-b987-6f94722cd88c-maas-api-service-ca\") pod \"ba0cbb3d-3e29-4c73-b987-6f94722cd88c\" (UID: \"ba0cbb3d-3e29-4c73-b987-6f94722cd88c\") "
Aug 01 00:59:53.248211 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:53.248192    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba0cbb3d-3e29-4c73-b987-6f94722cd88c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba0cbb3d-3e29-4c73-b987-6f94722cd88c" (UID: "ba0cbb3d-3e29-4c73-b987-6f94722cd88c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:59:53.349375 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:53.349317    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cbb3d-3e29-4c73-b987-6f94722cd88c-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:54.050406 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:54.050375    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv" event={"ID":"ba0cbb3d-3e29-4c73-b987-6f94722cd88c","Type":"ContainerDied","Data":"2ca366a96205c8962197099a2024dce0abac18697179c0018b7edd75159ca3b3"}
Aug 01 00:59:54.050406 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:54.050406    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"
Aug 01 00:59:54.050615 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:54.050420    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ca366a96205c8962197099a2024dce0abac18697179c0018b7edd75159ca3b3"
Aug 01 00:59:56.138459 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.138424    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"]
Aug 01 00:59:56.138944 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.138630    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5" podUID="19602049-ff60-4804-bf63-6137ef55971a" containerName="maas-api" containerID="cri-o://97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834" gracePeriod=30
Aug 01 00:59:56.202943 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.202899    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"]
Aug 01 00:59:56.203410 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.203171    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p" podUID="73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4" containerName="payload-pre-processing" containerID="cri-o://fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173" gracePeriod=30
Aug 01 00:59:56.336088 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.336050    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"]
Aug 01 00:59:56.338105 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.338084    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99a0aaf4-9jjcv"]
Aug 01 00:59:56.454117 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.454094    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:56.476702 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.476674    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-plugins-config-volume\") pod \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\" (UID: \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\") "
Aug 01 00:59:56.476872 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.476844    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdlm8\" (UniqueName: \"kubernetes.io/projected/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-kube-api-access-bdlm8\") pod \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\" (UID: \"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4\") "
Aug 01 00:59:56.477137 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.477112    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4" (UID: "73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:59:56.479419 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.479397    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-kube-api-access-bdlm8" (OuterVolumeSpecName: "kube-api-access-bdlm8") pod "73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4" (UID: "73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4"). InnerVolumeSpecName "kube-api-access-bdlm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:59:56.487325 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.487307    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:56.577933 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.577904    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19602049-ff60-4804-bf63-6137ef55971a-openshift-service-ca\") pod \"19602049-ff60-4804-bf63-6137ef55971a\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") "
Aug 01 00:59:56.578044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.577949    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19602049-ff60-4804-bf63-6137ef55971a-maas-api-tls\") pod \"19602049-ff60-4804-bf63-6137ef55971a\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") "
Aug 01 00:59:56.578044 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.577973    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjggd\" (UniqueName: \"kubernetes.io/projected/19602049-ff60-4804-bf63-6137ef55971a-kube-api-access-wjggd\") pod \"19602049-ff60-4804-bf63-6137ef55971a\" (UID: \"19602049-ff60-4804-bf63-6137ef55971a\") "
Aug 01 00:59:56.578231 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.578214    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdlm8\" (UniqueName: \"kubernetes.io/projected/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-kube-api-access-bdlm8\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:56.578267 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.578238    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:56.578345 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.578311    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19602049-ff60-4804-bf63-6137ef55971a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "19602049-ff60-4804-bf63-6137ef55971a" (UID: "19602049-ff60-4804-bf63-6137ef55971a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 00:59:56.580031 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.580007    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19602049-ff60-4804-bf63-6137ef55971a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "19602049-ff60-4804-bf63-6137ef55971a" (UID: "19602049-ff60-4804-bf63-6137ef55971a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 00:59:56.580109 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.580070    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19602049-ff60-4804-bf63-6137ef55971a-kube-api-access-wjggd" (OuterVolumeSpecName: "kube-api-access-wjggd") pod "19602049-ff60-4804-bf63-6137ef55971a" (UID: "19602049-ff60-4804-bf63-6137ef55971a"). InnerVolumeSpecName "kube-api-access-wjggd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 00:59:56.679155 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.679086    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19602049-ff60-4804-bf63-6137ef55971a-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:56.679155 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.679110    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19602049-ff60-4804-bf63-6137ef55971a-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:56.679155 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:56.679119    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjggd\" (UniqueName: \"kubernetes.io/projected/19602049-ff60-4804-bf63-6137ef55971a-kube-api-access-wjggd\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 00:59:57.066972 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.066939    2547 generic.go:356] "Generic (PLEG): container finished" podID="19602049-ff60-4804-bf63-6137ef55971a" containerID="97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834" exitCode=0
Aug 01 00:59:57.067136 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.066981    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"
Aug 01 00:59:57.067136 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.067028    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5" event={"ID":"19602049-ff60-4804-bf63-6137ef55971a","Type":"ContainerDied","Data":"97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834"}
Aug 01 00:59:57.067136 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.067079    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5" event={"ID":"19602049-ff60-4804-bf63-6137ef55971a","Type":"ContainerDied","Data":"773a24627d60f2e839be4a2851ed10bc246634de1bf55fc3d5734217937022a9"}
Aug 01 00:59:57.067136 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.067102    2547 scope.go:117] "RemoveContainer" containerID="97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834"
Aug 01 00:59:57.068440 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.068422    2547 generic.go:356] "Generic (PLEG): container finished" podID="73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4" containerID="fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173" exitCode=0
Aug 01 00:59:57.068547 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.068466    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"
Aug 01 00:59:57.068609 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.068460    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p" event={"ID":"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4","Type":"ContainerDied","Data":"fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173"}
Aug 01 00:59:57.068609 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.068600    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p" event={"ID":"73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4","Type":"ContainerDied","Data":"1fc4a953a9f1cd020d6fe67c4ef37846337bdf7e483c4b699fe4bf1cf773510c"}
Aug 01 00:59:57.078153 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.078132    2547 scope.go:117] "RemoveContainer" containerID="97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834"
Aug 01 00:59:57.078458 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:59:57.078438    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834\": container with ID starting with 97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834 not found: ID does not exist" containerID="97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834"
Aug 01 00:59:57.078530 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.078467    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834"} err="failed to get container status \"97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834\": rpc error: code = NotFound desc = could not find container \"97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834\": container with ID starting with 97426c52c2dbee0bfbcbb64ce244544e8b82e359cc119ae3fa25af1c6ef57834 not found: ID does not exist"
Aug 01 00:59:57.078530 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.078499    2547 scope.go:117] "RemoveContainer" containerID="fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173"
Aug 01 00:59:57.086336 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.086306    2547 scope.go:117] "RemoveContainer" containerID="fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173"
Aug 01 00:59:57.086634 ip-10-0-131-26 kubenswrapper[2547]: E0801 00:59:57.086610    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173\": container with ID starting with fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173 not found: ID does not exist" containerID="fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173"
Aug 01 00:59:57.086755 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.086638    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173"} err="failed to get container status \"fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173\": rpc error: code = NotFound desc = could not find container \"fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173\": container with ID starting with fa6ae713786d2c9ffa7f961ca449d1fb19e6d2520c106b911eb185e97adab173 not found: ID does not exist"
Aug 01 00:59:57.088946 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.088928    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"]
Aug 01 00:59:57.094508 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.094475    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-99a0aaf4-965849cf7-8x4z5"]
Aug 01 00:59:57.102684 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.102662    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"]
Aug 01 00:59:57.109183 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.109164    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-99a0aaf4-5478fbd8d4-pvc5p"]
Aug 01 00:59:57.880164 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.880130    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19602049-ff60-4804-bf63-6137ef55971a" path="/var/lib/kubelet/pods/19602049-ff60-4804-bf63-6137ef55971a/volumes"
Aug 01 00:59:57.880545 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.880508    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4" path="/var/lib/kubelet/pods/73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4/volumes"
Aug 01 00:59:57.880802 ip-10-0-131-26 kubenswrapper[2547]: I0801 00:59:57.880790    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba0cbb3d-3e29-4c73-b987-6f94722cd88c" path="/var/lib/kubelet/pods/ba0cbb3d-3e29-4c73-b987-6f94722cd88c/volumes"
Aug 01 01:00:00.128223 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128191    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2"]
Aug 01 01:00:00.128626 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128612    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4" containerName="payload-pre-processing"
Aug 01 01:00:00.128670 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128627    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4" containerName="payload-pre-processing"
Aug 01 01:00:00.128670 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128645    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba0cbb3d-3e29-4c73-b987-6f94722cd88c" containerName="revoke-keys"
Aug 01 01:00:00.128670 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128650    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba0cbb3d-3e29-4c73-b987-6f94722cd88c" containerName="revoke-keys"
Aug 01 01:00:00.128670 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128659    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19602049-ff60-4804-bf63-6137ef55971a" containerName="maas-api"
Aug 01 01:00:00.128670 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128664    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="19602049-ff60-4804-bf63-6137ef55971a" containerName="maas-api"
Aug 01 01:00:00.128844 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128727    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ca6a0a-806c-4ad8-a51d-7d8bc96af3f4" containerName="payload-pre-processing"
Aug 01 01:00:00.128844 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128734    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba0cbb3d-3e29-4c73-b987-6f94722cd88c" containerName="revoke-keys"
Aug 01 01:00:00.128844 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.128747    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="19602049-ff60-4804-bf63-6137ef55971a" containerName="maas-api"
Aug 01 01:00:00.133194 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.133177    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2"
Aug 01 01:00:00.135764 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.135519    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:00:00.138026 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.138000    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2"]
Aug 01 01:00:00.144861 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.144843    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2"
Aug 01 01:00:00.282386 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:00.282361    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2"]
Aug 01 01:00:00.288938 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:00:00.288906    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38d099d_fd60_4a4c_9c2d_76d2244978c7.slice/crio-cb1f5386f8ff9f87d4481310eb235d065c3f106cb1ee1b95aebd62ca3227d28f WatchSource:0}: Error finding container cb1f5386f8ff9f87d4481310eb235d065c3f106cb1ee1b95aebd62ca3227d28f: Status 404 returned error can't find the container with id cb1f5386f8ff9f87d4481310eb235d065c3f106cb1ee1b95aebd62ca3227d28f
Aug 01 01:00:01.095073 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:01.095040    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2" event={"ID":"a38d099d-fd60-4a4c-9c2d-76d2244978c7","Type":"ContainerStarted","Data":"d36d0de1b14ce09fd21f6d95082aec165a30f01dae2ce50c7b8d6335172083ff"}
Aug 01 01:00:01.095249 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:01.095088    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2" event={"ID":"a38d099d-fd60-4a4c-9c2d-76d2244978c7","Type":"ContainerStarted","Data":"cb1f5386f8ff9f87d4481310eb235d065c3f106cb1ee1b95aebd62ca3227d28f"}
Aug 01 01:00:02.102155 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.102123    2547 generic.go:356] "Generic (PLEG): container finished" podID="a38d099d-fd60-4a4c-9c2d-76d2244978c7" containerID="d36d0de1b14ce09fd21f6d95082aec165a30f01dae2ce50c7b8d6335172083ff" exitCode=0
Aug 01 01:00:02.102569 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.102218    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2" event={"ID":"a38d099d-fd60-4a4c-9c2d-76d2244978c7","Type":"ContainerDied","Data":"d36d0de1b14ce09fd21f6d95082aec165a30f01dae2ce50c7b8d6335172083ff"}
Aug 01 01:00:02.596552 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.596519    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"]
Aug 01 01:00:02.600142 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.600125    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:02.602304 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.602281    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-c7aeac35\""
Aug 01 01:00:02.611268 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.611249    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"]
Aug 01 01:00:02.630981 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.630960    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"]
Aug 01 01:00:02.633320 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.633300    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86vmj\" (UniqueName: \"kubernetes.io/projected/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-kube-api-access-86vmj\") pod \"payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb\" (UID: \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:02.633410 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.633349    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb\" (UID: \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:02.634387 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.634368    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:02.636733 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.636715    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-c7aeac35-dockercfg-xxdln\""
Aug 01 01:00:02.648179 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.648156    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"]
Aug 01 01:00:02.734289 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.734254    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86vmj\" (UniqueName: \"kubernetes.io/projected/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-kube-api-access-86vmj\") pod \"payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb\" (UID: \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:02.734453 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.734320    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a2ecdc1-4742-4698-8e19-0150643530f9-plugins-config-volume\") pod \"payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j\" (UID: \"4a2ecdc1-4742-4698-8e19-0150643530f9\") " pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:02.734453 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.734362    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k424\" (UniqueName: \"kubernetes.io/projected/4a2ecdc1-4742-4698-8e19-0150643530f9-kube-api-access-6k424\") pod \"payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j\" (UID: \"4a2ecdc1-4742-4698-8e19-0150643530f9\") " pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:02.734453 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.734392    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb\" (UID: \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:02.735132 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.735108    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb\" (UID: \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:02.742683 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.742660    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86vmj\" (UniqueName: \"kubernetes.io/projected/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-kube-api-access-86vmj\") pod \"payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb\" (UID: \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:02.834890 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.834856    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a2ecdc1-4742-4698-8e19-0150643530f9-plugins-config-volume\") pod \"payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j\" (UID: \"4a2ecdc1-4742-4698-8e19-0150643530f9\") " pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:02.834999 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.834901    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k424\" (UniqueName: \"kubernetes.io/projected/4a2ecdc1-4742-4698-8e19-0150643530f9-kube-api-access-6k424\") pod \"payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j\" (UID: \"4a2ecdc1-4742-4698-8e19-0150643530f9\") " pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:02.835604 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.835586    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a2ecdc1-4742-4698-8e19-0150643530f9-plugins-config-volume\") pod \"payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j\" (UID: \"4a2ecdc1-4742-4698-8e19-0150643530f9\") " pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:02.851337 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.851273    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k424\" (UniqueName: \"kubernetes.io/projected/4a2ecdc1-4742-4698-8e19-0150643530f9-kube-api-access-6k424\") pod \"payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j\" (UID: \"4a2ecdc1-4742-4698-8e19-0150643530f9\") " pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:02.911936 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.911907    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:02.944447 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:02.944412    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:03.097984 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:03.097960    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"]
Aug 01 01:00:03.100466 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:00:03.100435    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2ecdc1_4742_4698_8e19_0150643530f9.slice/crio-9aeda411a5764c3a57d09ec1040d2cc57e43efdd4b8e4414cbf4298a4e0e5cf5 WatchSource:0}: Error finding container 9aeda411a5764c3a57d09ec1040d2cc57e43efdd4b8e4414cbf4298a4e0e5cf5: Status 404 returned error can't find the container with id 9aeda411a5764c3a57d09ec1040d2cc57e43efdd4b8e4414cbf4298a4e0e5cf5
Aug 01 01:00:03.108271 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:03.108249    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j" event={"ID":"4a2ecdc1-4742-4698-8e19-0150643530f9","Type":"ContainerStarted","Data":"9aeda411a5764c3a57d09ec1040d2cc57e43efdd4b8e4414cbf4298a4e0e5cf5"}
Aug 01 01:00:03.239128 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:03.239101    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2"
Aug 01 01:00:03.275770 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:03.275748    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"]
Aug 01 01:00:03.277490 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:00:03.277438    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ac5a4d_1403_4335_b0c9_1a39db560dfd.slice/crio-7c607c7298c9ac0303163514e503486806313a975df1fe3ba3920328c8877236 WatchSource:0}: Error finding container 7c607c7298c9ac0303163514e503486806313a975df1fe3ba3920328c8877236: Status 404 returned error can't find the container with id 7c607c7298c9ac0303163514e503486806313a975df1fe3ba3920328c8877236
Aug 01 01:00:04.116118 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.116026    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb" event={"ID":"e7ac5a4d-1403-4335-b0c9-1a39db560dfd","Type":"ContainerStarted","Data":"f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb"}
Aug 01 01:00:04.116118 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.116087    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb" event={"ID":"e7ac5a4d-1403-4335-b0c9-1a39db560dfd","Type":"ContainerStarted","Data":"7c607c7298c9ac0303163514e503486806313a975df1fe3ba3920328c8877236"}
Aug 01 01:00:04.116118 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.116117    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:04.118035 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.117691    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j" event={"ID":"4a2ecdc1-4742-4698-8e19-0150643530f9","Type":"ContainerStarted","Data":"5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478"}
Aug 01 01:00:04.118035 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.117759    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:04.119906 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.119875    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2"
Aug 01 01:00:04.119906 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.119893    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759100-g8md2" event={"ID":"a38d099d-fd60-4a4c-9c2d-76d2244978c7","Type":"ContainerDied","Data":"cb1f5386f8ff9f87d4481310eb235d065c3f106cb1ee1b95aebd62ca3227d28f"}
Aug 01 01:00:04.120068 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.119932    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb1f5386f8ff9f87d4481310eb235d065c3f106cb1ee1b95aebd62ca3227d28f"
Aug 01 01:00:04.131156 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.131117    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb" podStartSLOduration=2.131101905 podStartE2EDuration="2.131101905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:00:04.130912714 +0000 UTC m=+1872.828081801" watchObservedRunningTime="2026-08-01 01:00:04.131101905 +0000 UTC m=+1872.828270968"
Aug 01 01:00:04.153622 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:04.153579    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j" podStartSLOduration=2.153564723 podStartE2EDuration="2.153564723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:00:04.15251318 +0000 UTC m=+1872.849682239" watchObservedRunningTime="2026-08-01 01:00:04.153564723 +0000 UTC m=+1872.850733784"
Aug 01 01:00:15.126848 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:15.126758    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:15.127207 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:15.127183    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:25.596129 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.596096    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"]
Aug 01 01:00:25.596553 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.596539    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38d099d-fd60-4a4c-9c2d-76d2244978c7" containerName="cleanup"
Aug 01 01:00:25.596553 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.596554    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38d099d-fd60-4a4c-9c2d-76d2244978c7" containerName="cleanup"
Aug 01 01:00:25.596644 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.596635    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a38d099d-fd60-4a4c-9c2d-76d2244978c7" containerName="cleanup"
Aug 01 01:00:25.599670 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.599653    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"
Aug 01 01:00:25.601962 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.601932    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:00:25.607105 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.607078    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"]
Aug 01 01:00:25.755829 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.755796    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3054460e-0f35-44a4-8d46-82ae8067e9e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j\" (UID: \"3054460e-0f35-44a4-8d46-82ae8067e9e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"
Aug 01 01:00:25.856328 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.856256    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3054460e-0f35-44a4-8d46-82ae8067e9e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j\" (UID: \"3054460e-0f35-44a4-8d46-82ae8067e9e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"
Aug 01 01:00:25.856896 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.856875    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3054460e-0f35-44a4-8d46-82ae8067e9e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j\" (UID: \"3054460e-0f35-44a4-8d46-82ae8067e9e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"
Aug 01 01:00:25.912555 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:25.912527    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"
Aug 01 01:00:26.050603 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:26.050566    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"]
Aug 01 01:00:26.052156 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:00:26.052130    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3054460e_0f35_44a4_8d46_82ae8067e9e9.slice/crio-8c7a2c1f98e191703d987a1928bc2fec6b649a1f12de6eb3e2d6cecb4d29aea5 WatchSource:0}: Error finding container 8c7a2c1f98e191703d987a1928bc2fec6b649a1f12de6eb3e2d6cecb4d29aea5: Status 404 returned error can't find the container with id 8c7a2c1f98e191703d987a1928bc2fec6b649a1f12de6eb3e2d6cecb4d29aea5
Aug 01 01:00:26.242843 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:26.242810    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j" event={"ID":"3054460e-0f35-44a4-8d46-82ae8067e9e9","Type":"ContainerStarted","Data":"8c7a2c1f98e191703d987a1928bc2fec6b649a1f12de6eb3e2d6cecb4d29aea5"}
Aug 01 01:00:27.250199 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:27.250165    2547 generic.go:356] "Generic (PLEG): container finished" podID="3054460e-0f35-44a4-8d46-82ae8067e9e9" containerID="3bd72d0085675557c17df9f85c7634bcc7f8b6090499f6624269f5cf8e68368f" exitCode=0
Aug 01 01:00:27.250634 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:27.250254    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j" event={"ID":"3054460e-0f35-44a4-8d46-82ae8067e9e9","Type":"ContainerDied","Data":"3bd72d0085675557c17df9f85c7634bcc7f8b6090499f6624269f5cf8e68368f"}
Aug 01 01:00:28.393431 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:28.393409    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"
Aug 01 01:00:28.585260 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:28.585171    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3054460e-0f35-44a4-8d46-82ae8067e9e9-maas-api-service-ca\") pod \"3054460e-0f35-44a4-8d46-82ae8067e9e9\" (UID: \"3054460e-0f35-44a4-8d46-82ae8067e9e9\") "
Aug 01 01:00:28.585591 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:28.585564    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3054460e-0f35-44a4-8d46-82ae8067e9e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3054460e-0f35-44a4-8d46-82ae8067e9e9" (UID: "3054460e-0f35-44a4-8d46-82ae8067e9e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:00:28.686762 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:28.686737    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3054460e-0f35-44a4-8d46-82ae8067e9e9-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:00:29.262630 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:29.262603    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"
Aug 01 01:00:29.262775 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:29.262646    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j" event={"ID":"3054460e-0f35-44a4-8d46-82ae8067e9e9","Type":"ContainerDied","Data":"8c7a2c1f98e191703d987a1928bc2fec6b649a1f12de6eb3e2d6cecb4d29aea5"}
Aug 01 01:00:29.262775 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:29.262693    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c7a2c1f98e191703d987a1928bc2fec6b649a1f12de6eb3e2d6cecb4d29aea5"
Aug 01 01:00:32.372368 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.372330    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"]
Aug 01 01:00:32.372914 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.372611    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j" podUID="4a2ecdc1-4742-4698-8e19-0150643530f9" containerName="payload-processing" containerID="cri-o://5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478" gracePeriod=30
Aug 01 01:00:32.381165 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.381134    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"]
Aug 01 01:00:32.381366 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.381336    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb" podUID="e7ac5a4d-1403-4335-b0c9-1a39db560dfd" containerName="payload-pre-processing" containerID="cri-o://f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb" gracePeriod=30
Aug 01 01:00:32.529115 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.529074    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"]
Aug 01 01:00:32.535235 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.535201    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7aeac35-d8l2j"]
Aug 01 01:00:32.652575 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.652540    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:32.683054 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.683031    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:32.718864 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.718834    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86vmj\" (UniqueName: \"kubernetes.io/projected/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-kube-api-access-86vmj\") pod \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\" (UID: \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\") "
Aug 01 01:00:32.719032 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.718881    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k424\" (UniqueName: \"kubernetes.io/projected/4a2ecdc1-4742-4698-8e19-0150643530f9-kube-api-access-6k424\") pod \"4a2ecdc1-4742-4698-8e19-0150643530f9\" (UID: \"4a2ecdc1-4742-4698-8e19-0150643530f9\") "
Aug 01 01:00:32.719032 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.718914    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-plugins-config-volume\") pod \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\" (UID: \"e7ac5a4d-1403-4335-b0c9-1a39db560dfd\") "
Aug 01 01:00:32.719032 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.718975    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a2ecdc1-4742-4698-8e19-0150643530f9-plugins-config-volume\") pod \"4a2ecdc1-4742-4698-8e19-0150643530f9\" (UID: \"4a2ecdc1-4742-4698-8e19-0150643530f9\") "
Aug 01 01:00:32.719543 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.719359    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e7ac5a4d-1403-4335-b0c9-1a39db560dfd" (UID: "e7ac5a4d-1403-4335-b0c9-1a39db560dfd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:00:32.719543 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.719531    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a2ecdc1-4742-4698-8e19-0150643530f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4a2ecdc1-4742-4698-8e19-0150643530f9" (UID: "4a2ecdc1-4742-4698-8e19-0150643530f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:00:32.720965 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.720945    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a2ecdc1-4742-4698-8e19-0150643530f9-kube-api-access-6k424" (OuterVolumeSpecName: "kube-api-access-6k424") pod "4a2ecdc1-4742-4698-8e19-0150643530f9" (UID: "4a2ecdc1-4742-4698-8e19-0150643530f9"). InnerVolumeSpecName "kube-api-access-6k424". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:00:32.721396 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.721379    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-kube-api-access-86vmj" (OuterVolumeSpecName: "kube-api-access-86vmj") pod "e7ac5a4d-1403-4335-b0c9-1a39db560dfd" (UID: "e7ac5a4d-1403-4335-b0c9-1a39db560dfd"). InnerVolumeSpecName "kube-api-access-86vmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:00:32.820169 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.820124    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a2ecdc1-4742-4698-8e19-0150643530f9-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:00:32.820169 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.820161    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86vmj\" (UniqueName: \"kubernetes.io/projected/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-kube-api-access-86vmj\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:00:32.820169 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.820172    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k424\" (UniqueName: \"kubernetes.io/projected/4a2ecdc1-4742-4698-8e19-0150643530f9-kube-api-access-6k424\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:00:32.820407 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:32.820181    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7ac5a4d-1403-4335-b0c9-1a39db560dfd-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:00:33.287193 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.287158    2547 generic.go:356] "Generic (PLEG): container finished" podID="4a2ecdc1-4742-4698-8e19-0150643530f9" containerID="5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478" exitCode=0
Aug 01 01:00:33.287390 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.287206    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"
Aug 01 01:00:33.287390 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.287241    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j" event={"ID":"4a2ecdc1-4742-4698-8e19-0150643530f9","Type":"ContainerDied","Data":"5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478"}
Aug 01 01:00:33.287390 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.287294    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j" event={"ID":"4a2ecdc1-4742-4698-8e19-0150643530f9","Type":"ContainerDied","Data":"9aeda411a5764c3a57d09ec1040d2cc57e43efdd4b8e4414cbf4298a4e0e5cf5"}
Aug 01 01:00:33.287390 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.287317    2547 scope.go:117] "RemoveContainer" containerID="5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478"
Aug 01 01:00:33.288823 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.288795    2547 generic.go:356] "Generic (PLEG): container finished" podID="e7ac5a4d-1403-4335-b0c9-1a39db560dfd" containerID="f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb" exitCode=0
Aug 01 01:00:33.288963 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.288827    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"
Aug 01 01:00:33.288963 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.288848    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb" event={"ID":"e7ac5a4d-1403-4335-b0c9-1a39db560dfd","Type":"ContainerDied","Data":"f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb"}
Aug 01 01:00:33.288963 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.288888    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb" event={"ID":"e7ac5a4d-1403-4335-b0c9-1a39db560dfd","Type":"ContainerDied","Data":"7c607c7298c9ac0303163514e503486806313a975df1fe3ba3920328c8877236"}
Aug 01 01:00:33.298886 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.298859    2547 scope.go:117] "RemoveContainer" containerID="5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478"
Aug 01 01:00:33.299193 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:00:33.299162    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478\": container with ID starting with 5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478 not found: ID does not exist" containerID="5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478"
Aug 01 01:00:33.299285 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.299203    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478"} err="failed to get container status \"5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478\": rpc error: code = NotFound desc = could not find container \"5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478\": container with ID starting with 5dd8f69239733688e72af4e26dc4d565a5cae0ecbc369bc061ee39472543e478 not found: ID does not exist"
Aug 01 01:00:33.299285 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.299224    2547 scope.go:117] "RemoveContainer" containerID="f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb"
Aug 01 01:00:33.308137 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.308119    2547 scope.go:117] "RemoveContainer" containerID="f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb"
Aug 01 01:00:33.308373 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:00:33.308355    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb\": container with ID starting with f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb not found: ID does not exist" containerID="f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb"
Aug 01 01:00:33.308429 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.308380    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb"} err="failed to get container status \"f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb\": rpc error: code = NotFound desc = could not find container \"f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb\": container with ID starting with f76dc3b3f67ec0a4de12cd79ed7ba13497608a613ff6bc6b664567bdc1ff1dcb not found: ID does not exist"
Aug 01 01:00:33.319606 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.319585    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"]
Aug 01 01:00:33.321624 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.321604    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7aeac35-657b5cf476-6gmnb"]
Aug 01 01:00:33.330854 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.330833    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"]
Aug 01 01:00:33.337192 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.337169    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7aeac35-9569b4d4b-f2g7j"]
Aug 01 01:00:33.881202 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.881172    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3054460e-0f35-44a4-8d46-82ae8067e9e9" path="/var/lib/kubelet/pods/3054460e-0f35-44a4-8d46-82ae8067e9e9/volumes"
Aug 01 01:00:33.881580 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.881566    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a2ecdc1-4742-4698-8e19-0150643530f9" path="/var/lib/kubelet/pods/4a2ecdc1-4742-4698-8e19-0150643530f9/volumes"
Aug 01 01:00:33.881926 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:00:33.881912    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7ac5a4d-1403-4335-b0c9-1a39db560dfd" path="/var/lib/kubelet/pods/e7ac5a4d-1403-4335-b0c9-1a39db560dfd/volumes"
Aug 01 01:03:05.419107 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419070    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"]
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419474    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ac5a4d-1403-4335-b0c9-1a39db560dfd" containerName="payload-pre-processing"
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419503    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ac5a4d-1403-4335-b0c9-1a39db560dfd" containerName="payload-pre-processing"
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419522    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a2ecdc1-4742-4698-8e19-0150643530f9" containerName="payload-processing"
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419531    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a2ecdc1-4742-4698-8e19-0150643530f9" containerName="payload-processing"
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419552    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3054460e-0f35-44a4-8d46-82ae8067e9e9" containerName="revoke-keys"
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419558    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3054460e-0f35-44a4-8d46-82ae8067e9e9" containerName="revoke-keys"
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419622    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ac5a4d-1403-4335-b0c9-1a39db560dfd" containerName="payload-pre-processing"
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419632    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3054460e-0f35-44a4-8d46-82ae8067e9e9" containerName="revoke-keys"
Aug 01 01:03:05.419682 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.419641    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a2ecdc1-4742-4698-8e19-0150643530f9" containerName="payload-processing"
Aug 01 01:03:05.422792 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.422777    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"
Aug 01 01:03:05.425138 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.425116    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:03:05.429610 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.429582    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"]
Aug 01 01:03:05.566915 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.566878    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1588b91-a799-4c4d-8e2d-593aed2646d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8\" (UID: \"f1588b91-a799-4c4d-8e2d-593aed2646d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"
Aug 01 01:03:05.667776 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.667741    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1588b91-a799-4c4d-8e2d-593aed2646d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8\" (UID: \"f1588b91-a799-4c4d-8e2d-593aed2646d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"
Aug 01 01:03:05.668336 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.668318    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1588b91-a799-4c4d-8e2d-593aed2646d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8\" (UID: \"f1588b91-a799-4c4d-8e2d-593aed2646d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"
Aug 01 01:03:05.735030 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.735005    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"
Aug 01 01:03:05.870618 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:05.870590    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"]
Aug 01 01:03:05.872494 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:03:05.872454    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1588b91_a799_4c4d_8e2d_593aed2646d9.slice/crio-17a7ce6bcc206225bffbfab3cb0d8ff4293399ec39c8cde1f30961ba41c37767 WatchSource:0}: Error finding container 17a7ce6bcc206225bffbfab3cb0d8ff4293399ec39c8cde1f30961ba41c37767: Status 404 returned error can't find the container with id 17a7ce6bcc206225bffbfab3cb0d8ff4293399ec39c8cde1f30961ba41c37767
Aug 01 01:03:06.130823 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:06.130795    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8" event={"ID":"f1588b91-a799-4c4d-8e2d-593aed2646d9","Type":"ContainerStarted","Data":"151239f116160fdf2c6791082b77c375d9dc26aa982f6322741a7ef95037a34b"}
Aug 01 01:03:06.130960 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:06.130848    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8" event={"ID":"f1588b91-a799-4c4d-8e2d-593aed2646d9","Type":"ContainerStarted","Data":"17a7ce6bcc206225bffbfab3cb0d8ff4293399ec39c8cde1f30961ba41c37767"}
Aug 01 01:03:06.146855 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:06.146805    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8" podStartSLOduration=1.146789423 podStartE2EDuration="1.146789423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:03:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:03:06.146445745 +0000 UTC m=+2054.843614808" watchObservedRunningTime="2026-08-01 01:03:06.146789423 +0000 UTC m=+2054.843958484"
Aug 01 01:03:07.137748 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:07.137707    2547 generic.go:356] "Generic (PLEG): container finished" podID="f1588b91-a799-4c4d-8e2d-593aed2646d9" containerID="151239f116160fdf2c6791082b77c375d9dc26aa982f6322741a7ef95037a34b" exitCode=0
Aug 01 01:03:07.138127 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:07.137799    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8" event={"ID":"f1588b91-a799-4c4d-8e2d-593aed2646d9","Type":"ContainerDied","Data":"151239f116160fdf2c6791082b77c375d9dc26aa982f6322741a7ef95037a34b"}
Aug 01 01:03:08.284721 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:08.284697    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"
Aug 01 01:03:08.393795 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:08.393761    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1588b91-a799-4c4d-8e2d-593aed2646d9-maas-api-service-ca\") pod \"f1588b91-a799-4c4d-8e2d-593aed2646d9\" (UID: \"f1588b91-a799-4c4d-8e2d-593aed2646d9\") "
Aug 01 01:03:08.394109 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:08.394086    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1588b91-a799-4c4d-8e2d-593aed2646d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1588b91-a799-4c4d-8e2d-593aed2646d9" (UID: "f1588b91-a799-4c4d-8e2d-593aed2646d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:03:08.495104 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:08.495071    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1588b91-a799-4c4d-8e2d-593aed2646d9-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:03:09.151576 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:09.151544    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8" event={"ID":"f1588b91-a799-4c4d-8e2d-593aed2646d9","Type":"ContainerDied","Data":"17a7ce6bcc206225bffbfab3cb0d8ff4293399ec39c8cde1f30961ba41c37767"}
Aug 01 01:03:09.151576 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:09.151569    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"
Aug 01 01:03:09.151780 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:09.151593    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17a7ce6bcc206225bffbfab3cb0d8ff4293399ec39c8cde1f30961ba41c37767"
Aug 01 01:03:16.269092 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:16.269013    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"]
Aug 01 01:03:16.274336 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:16.274312    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b7da259d-5ntw8"]
Aug 01 01:03:17.880558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:17.880526    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1588b91-a799-4c4d-8e2d-593aed2646d9" path="/var/lib/kubelet/pods/f1588b91-a799-4c4d-8e2d-593aed2646d9/volumes"
Aug 01 01:03:51.958277 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:51.958245    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:03:51.961653 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:03:51.961632    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:04:52.076254 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:04:52.076223    2547 scope.go:117] "RemoveContainer" containerID="9482196ac273a20e0385069cb6b424736cf45402aee3ab23f85f28b1d3186bbd"
Aug 01 01:05:52.097009 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:05:52.096975    2547 scope.go:117] "RemoveContainer" containerID="8e3f8447797886ba3e3794e2adf347952b87308c04e3f78f3ec3b7ff0d2a0632"
Aug 01 01:05:52.105522 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:05:52.105498    2547 scope.go:117] "RemoveContainer" containerID="95d174c7d9e66cad29092fd5dd4197061c8b320a777c7a0518c947e190e21ce8"
Aug 01 01:06:46.221124 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.221080    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"]
Aug 01 01:06:46.221760 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.221739    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1588b91-a799-4c4d-8e2d-593aed2646d9" containerName="revoke-keys"
Aug 01 01:06:46.221760 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.221762    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1588b91-a799-4c4d-8e2d-593aed2646d9" containerName="revoke-keys"
Aug 01 01:06:46.221899 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.221877    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1588b91-a799-4c4d-8e2d-593aed2646d9" containerName="revoke-keys"
Aug 01 01:06:46.225054 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.225034    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"
Aug 01 01:06:46.227170 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.227149    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:06:46.230358 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.230334    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"]
Aug 01 01:06:46.301961 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.301926    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff28501-2989-4295-971b-67989d5b1a67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm\" (UID: \"3ff28501-2989-4295-971b-67989d5b1a67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"
Aug 01 01:06:46.402468 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.402431    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff28501-2989-4295-971b-67989d5b1a67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm\" (UID: \"3ff28501-2989-4295-971b-67989d5b1a67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"
Aug 01 01:06:46.403079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.403057    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff28501-2989-4295-971b-67989d5b1a67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm\" (UID: \"3ff28501-2989-4295-971b-67989d5b1a67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"
Aug 01 01:06:46.537079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.536976    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"
Aug 01 01:06:46.672851 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:46.672823    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"]
Aug 01 01:06:46.675108 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:06:46.675079    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff28501_2989_4295_971b_67989d5b1a67.slice/crio-40e378c09cc0aed4c445e2319ab81ef1ed4f3d6097bc1e34e8ffd1a12ea6eb7e WatchSource:0}: Error finding container 40e378c09cc0aed4c445e2319ab81ef1ed4f3d6097bc1e34e8ffd1a12ea6eb7e: Status 404 returned error can't find the container with id 40e378c09cc0aed4c445e2319ab81ef1ed4f3d6097bc1e34e8ffd1a12ea6eb7e
Aug 01 01:06:47.384211 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:47.384173    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm" event={"ID":"3ff28501-2989-4295-971b-67989d5b1a67","Type":"ContainerStarted","Data":"ec784c6b1651f6ff72da52ae49b64185c670188e8120cf034cd4aa11e9191475"}
Aug 01 01:06:47.384629 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:47.384234    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm" event={"ID":"3ff28501-2989-4295-971b-67989d5b1a67","Type":"ContainerStarted","Data":"40e378c09cc0aed4c445e2319ab81ef1ed4f3d6097bc1e34e8ffd1a12ea6eb7e"}
Aug 01 01:06:47.398475 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:47.398430    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm" podStartSLOduration=1.398415428 podStartE2EDuration="1.398415428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:06:47.397551788 +0000 UTC m=+2276.094720840" watchObservedRunningTime="2026-08-01 01:06:47.398415428 +0000 UTC m=+2276.095584486"
Aug 01 01:06:48.390687 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:48.390654    2547 generic.go:356] "Generic (PLEG): container finished" podID="3ff28501-2989-4295-971b-67989d5b1a67" containerID="ec784c6b1651f6ff72da52ae49b64185c670188e8120cf034cd4aa11e9191475" exitCode=0
Aug 01 01:06:48.391057 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:48.390737    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm" event={"ID":"3ff28501-2989-4295-971b-67989d5b1a67","Type":"ContainerDied","Data":"ec784c6b1651f6ff72da52ae49b64185c670188e8120cf034cd4aa11e9191475"}
Aug 01 01:06:49.532914 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:49.532892    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"
Aug 01 01:06:49.634688 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:49.634657    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff28501-2989-4295-971b-67989d5b1a67-maas-api-service-ca\") pod \"3ff28501-2989-4295-971b-67989d5b1a67\" (UID: \"3ff28501-2989-4295-971b-67989d5b1a67\") "
Aug 01 01:06:49.635021 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:49.634999    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ff28501-2989-4295-971b-67989d5b1a67-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ff28501-2989-4295-971b-67989d5b1a67" (UID: "3ff28501-2989-4295-971b-67989d5b1a67"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:06:49.735822 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:49.735792    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff28501-2989-4295-971b-67989d5b1a67-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:06:50.402428 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:50.402399    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"
Aug 01 01:06:50.402615 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:50.402441    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm" event={"ID":"3ff28501-2989-4295-971b-67989d5b1a67","Type":"ContainerDied","Data":"40e378c09cc0aed4c445e2319ab81ef1ed4f3d6097bc1e34e8ffd1a12ea6eb7e"}
Aug 01 01:06:50.402615 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:50.402531    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40e378c09cc0aed4c445e2319ab81ef1ed4f3d6097bc1e34e8ffd1a12ea6eb7e"
Aug 01 01:06:52.130616 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:06:52.130587    2547 scope.go:117] "RemoveContainer" containerID="3bd72d0085675557c17df9f85c7634bcc7f8b6090499f6624269f5cf8e68368f"
Aug 01 01:07:02.006274 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:07:02.006236    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"]
Aug 01 01:07:02.009646 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:07:02.009623    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e23e15a8-vdrjm"]
Aug 01 01:07:03.881025 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:07:03.880992    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ff28501-2989-4295-971b-67989d5b1a67" path="/var/lib/kubelet/pods/3ff28501-2989-4295-971b-67989d5b1a67/volumes"
Aug 01 01:08:51.991905 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:08:51.991866    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:08:51.995514 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:08:51.995448    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:09:02.217623 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.217582    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"]
Aug 01 01:09:02.218246 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.218184    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff28501-2989-4295-971b-67989d5b1a67" containerName="revoke-keys"
Aug 01 01:09:02.218246 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.218204    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff28501-2989-4295-971b-67989d5b1a67" containerName="revoke-keys"
Aug 01 01:09:02.218365 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.218314    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff28501-2989-4295-971b-67989d5b1a67" containerName="revoke-keys"
Aug 01 01:09:02.222160 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.222131    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:02.224699 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.224676    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-47a30d-dockercfg-jnckh\""
Aug 01 01:09:02.224846 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.224676    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-47a30d\""
Aug 01 01:09:02.233111 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.233080    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"]
Aug 01 01:09:02.409902 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.409861    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klqtp\" (UniqueName: \"kubernetes.io/projected/a95c2778-ac96-46d1-97fd-cb049b8d81a2-kube-api-access-klqtp\") pod \"payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92\" (UID: \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:02.410074 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.409935    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95c2778-ac96-46d1-97fd-cb049b8d81a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92\" (UID: \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:02.510624 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.510526    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klqtp\" (UniqueName: \"kubernetes.io/projected/a95c2778-ac96-46d1-97fd-cb049b8d81a2-kube-api-access-klqtp\") pod \"payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92\" (UID: \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:02.510798 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.510622    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95c2778-ac96-46d1-97fd-cb049b8d81a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92\" (UID: \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:02.511400 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.511374    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95c2778-ac96-46d1-97fd-cb049b8d81a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92\" (UID: \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:02.519615 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.519579    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klqtp\" (UniqueName: \"kubernetes.io/projected/a95c2778-ac96-46d1-97fd-cb049b8d81a2-kube-api-access-klqtp\") pod \"payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92\" (UID: \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:02.538116 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.538073    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:02.679721 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:02.679694    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"]
Aug 01 01:09:02.681593 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:09:02.681555    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95c2778_ac96_46d1_97fd_cb049b8d81a2.slice/crio-344182e0dd5d50aa67e52bf0db6c7eea69cc6f94bc12b152e2331ac219816b85 WatchSource:0}: Error finding container 344182e0dd5d50aa67e52bf0db6c7eea69cc6f94bc12b152e2331ac219816b85: Status 404 returned error can't find the container with id 344182e0dd5d50aa67e52bf0db6c7eea69cc6f94bc12b152e2331ac219816b85
Aug 01 01:09:03.138344 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:03.138307    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92" event={"ID":"a95c2778-ac96-46d1-97fd-cb049b8d81a2","Type":"ContainerStarted","Data":"e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814"}
Aug 01 01:09:03.138544 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:03.138368    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:03.138544 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:03.138386    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92" event={"ID":"a95c2778-ac96-46d1-97fd-cb049b8d81a2","Type":"ContainerStarted","Data":"344182e0dd5d50aa67e52bf0db6c7eea69cc6f94bc12b152e2331ac219816b85"}
Aug 01 01:09:03.153587 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:03.153537    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92" podStartSLOduration=1.153474292 podStartE2EDuration="1.153474292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:09:03.152780463 +0000 UTC m=+2411.849949547" watchObservedRunningTime="2026-08-01 01:09:03.153474292 +0000 UTC m=+2411.850643354"
Aug 01 01:09:14.145659 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:14.145573    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:09:29.269771 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.269729    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"]
Aug 01 01:09:29.276118 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.276080    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.278600 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.278575    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-061b54-serving-cert\""
Aug 01 01:09:29.280781 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.280742    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"]
Aug 01 01:09:29.357562 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.357532    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.357717 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.357567    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe2d991-4c18-497a-b16a-61f00be95ebd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.357717 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.357692    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwrz\" (UniqueName: \"kubernetes.io/projected/dfe2d991-4c18-497a-b16a-61f00be95ebd-kube-api-access-lgwrz\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.458787 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.458752    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwrz\" (UniqueName: \"kubernetes.io/projected/dfe2d991-4c18-497a-b16a-61f00be95ebd-kube-api-access-lgwrz\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.458949 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.458906    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.458949 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.458945    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe2d991-4c18-497a-b16a-61f00be95ebd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.459072 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:09:29.459043    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-serving-cert: secret "maas-api-e2e-inf-b-061b54-serving-cert" not found
Aug 01 01:09:29.459129 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:09:29.459107    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls podName:dfe2d991-4c18-497a-b16a-61f00be95ebd nodeName:}" failed. No retries permitted until 2026-08-01 01:09:29.95909102 +0000 UTC m=+2438.656260061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls") pod "maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s" (UID: "dfe2d991-4c18-497a-b16a-61f00be95ebd") : secret "maas-api-e2e-inf-b-061b54-serving-cert" not found
Aug 01 01:09:29.459597 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.459575    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe2d991-4c18-497a-b16a-61f00be95ebd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.467005 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.466979    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwrz\" (UniqueName: \"kubernetes.io/projected/dfe2d991-4c18-497a-b16a-61f00be95ebd-kube-api-access-lgwrz\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.964610 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.964576    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.967019 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.966998    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls\") pod \"maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:29.995843 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.995814    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"]
Aug 01 01:09:29.999602 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:29.999585    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:30.001717 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.001692    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-061b54-dockercfg-v8qvl\""
Aug 01 01:09:30.001717 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.001703    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-061b54\""
Aug 01 01:09:30.010228 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.010208    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"]
Aug 01 01:09:30.065491 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.065442    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sprh7\" (UniqueName: \"kubernetes.io/projected/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-kube-api-access-sprh7\") pod \"payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw\" (UID: \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:30.065679 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.065497    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw\" (UID: \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:30.166937 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.166903    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sprh7\" (UniqueName: \"kubernetes.io/projected/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-kube-api-access-sprh7\") pod \"payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw\" (UID: \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:30.166937 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.166944    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw\" (UID: \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:30.167683 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.167663    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw\" (UID: \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:30.174659 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.174628    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sprh7\" (UniqueName: \"kubernetes.io/projected/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-kube-api-access-sprh7\") pod \"payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw\" (UID: \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:30.191457 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.191428    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:30.312263 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.312234    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:30.334960 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.334933    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"]
Aug 01 01:09:30.335342 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:09:30.335318    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe2d991_4c18_497a_b16a_61f00be95ebd.slice/crio-36029f516a1cf129988a3c1e709fce89b6c3d0d7498ae58354a15f7094cce75d WatchSource:0}: Error finding container 36029f516a1cf129988a3c1e709fce89b6c3d0d7498ae58354a15f7094cce75d: Status 404 returned error can't find the container with id 36029f516a1cf129988a3c1e709fce89b6c3d0d7498ae58354a15f7094cce75d
Aug 01 01:09:30.336796 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.336774    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 01 01:09:30.656786 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:30.656763    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"]
Aug 01 01:09:30.658914 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:09:30.658882    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ab96b1_dace_4e49_b088_6e3fa29e0e7f.slice/crio-c51342620a4bf7fd28b82a6ce0ccfac7b51c85ea6be0a7e0fddce7de051f814f WatchSource:0}: Error finding container c51342620a4bf7fd28b82a6ce0ccfac7b51c85ea6be0a7e0fddce7de051f814f: Status 404 returned error can't find the container with id c51342620a4bf7fd28b82a6ce0ccfac7b51c85ea6be0a7e0fddce7de051f814f
Aug 01 01:09:31.299389 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:31.299353    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s" event={"ID":"dfe2d991-4c18-497a-b16a-61f00be95ebd","Type":"ContainerStarted","Data":"0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a"}
Aug 01 01:09:31.299610 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:31.299541    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:31.299610 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:31.299582    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s" event={"ID":"dfe2d991-4c18-497a-b16a-61f00be95ebd","Type":"ContainerStarted","Data":"36029f516a1cf129988a3c1e709fce89b6c3d0d7498ae58354a15f7094cce75d"}
Aug 01 01:09:31.300899 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:31.300874    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw" event={"ID":"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f","Type":"ContainerStarted","Data":"15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923"}
Aug 01 01:09:31.301031 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:31.300915    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw" event={"ID":"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f","Type":"ContainerStarted","Data":"c51342620a4bf7fd28b82a6ce0ccfac7b51c85ea6be0a7e0fddce7de051f814f"}
Aug 01 01:09:31.301031 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:31.300956    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:31.317847 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:31.317800    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s" podStartSLOduration=1.909859545 podStartE2EDuration="2.317787078s" totalImagesPullingTime="407.927533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:09:31.315233383 +0000 UTC m=+2440.012402445" watchObservedRunningTime="2026-08-01 01:09:31.317787078 +0000 UTC m=+2440.014956186"
Aug 01 01:09:31.333299 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:31.333257    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw" podStartSLOduration=2.333243461 podStartE2EDuration="2.333243461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:09:31.33051019 +0000 UTC m=+2440.027679253" watchObservedRunningTime="2026-08-01 01:09:31.333243461 +0000 UTC m=+2440.030412523"
Aug 01 01:09:37.314410 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:37.314374    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:09:42.311371 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:42.311291    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:09:52.165967 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:09:52.165935    2547 scope.go:117] "RemoveContainer" containerID="151239f116160fdf2c6791082b77c375d9dc26aa982f6322741a7ef95037a34b"
Aug 01 01:11:44.431051 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.431014    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"]
Aug 01 01:11:44.434784 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.434765    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"
Aug 01 01:11:44.436941 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.436915    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:11:44.441504 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.441460    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"]
Aug 01 01:11:44.600642 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.600601    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe2b2726-c1a1-422a-a8ff-d5d518230d2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26\" (UID: \"fe2b2726-c1a1-422a-a8ff-d5d518230d2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"
Aug 01 01:11:44.701882 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.701780    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe2b2726-c1a1-422a-a8ff-d5d518230d2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26\" (UID: \"fe2b2726-c1a1-422a-a8ff-d5d518230d2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"
Aug 01 01:11:44.702529 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.702507    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe2b2726-c1a1-422a-a8ff-d5d518230d2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26\" (UID: \"fe2b2726-c1a1-422a-a8ff-d5d518230d2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"
Aug 01 01:11:44.747578 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.747545    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"
Aug 01 01:11:44.894711 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:44.894683    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"]
Aug 01 01:11:44.896912 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:11:44.896884    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2b2726_c1a1_422a_a8ff_d5d518230d2a.slice/crio-abb12c48f79fa355e1c118f44bfffd0cd2e6f2fe2e2e74b575604aefa719ac0c WatchSource:0}: Error finding container abb12c48f79fa355e1c118f44bfffd0cd2e6f2fe2e2e74b575604aefa719ac0c: Status 404 returned error can't find the container with id abb12c48f79fa355e1c118f44bfffd0cd2e6f2fe2e2e74b575604aefa719ac0c
Aug 01 01:11:45.035755 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:45.035720    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26" event={"ID":"fe2b2726-c1a1-422a-a8ff-d5d518230d2a","Type":"ContainerStarted","Data":"abb12c48f79fa355e1c118f44bfffd0cd2e6f2fe2e2e74b575604aefa719ac0c"}
Aug 01 01:11:46.042931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:46.042894    2547 generic.go:356] "Generic (PLEG): container finished" podID="fe2b2726-c1a1-422a-a8ff-d5d518230d2a" containerID="491e484254259e83d226feae9a9b1d191f59728b6a0020e032f967dab38da2d7" exitCode=0
Aug 01 01:11:46.043303 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:46.042974    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26" event={"ID":"fe2b2726-c1a1-422a-a8ff-d5d518230d2a","Type":"ContainerDied","Data":"491e484254259e83d226feae9a9b1d191f59728b6a0020e032f967dab38da2d7"}
Aug 01 01:11:47.199233 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:47.199208    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"
Aug 01 01:11:47.327370 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:47.327283    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe2b2726-c1a1-422a-a8ff-d5d518230d2a-maas-api-service-ca\") pod \"fe2b2726-c1a1-422a-a8ff-d5d518230d2a\" (UID: \"fe2b2726-c1a1-422a-a8ff-d5d518230d2a\") "
Aug 01 01:11:47.327628 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:47.327607    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe2b2726-c1a1-422a-a8ff-d5d518230d2a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe2b2726-c1a1-422a-a8ff-d5d518230d2a" (UID: "fe2b2726-c1a1-422a-a8ff-d5d518230d2a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:11:47.428794 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:47.428756    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe2b2726-c1a1-422a-a8ff-d5d518230d2a-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:11:48.061361 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:48.061333    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"
Aug 01 01:11:48.061547 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:48.061340    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26" event={"ID":"fe2b2726-c1a1-422a-a8ff-d5d518230d2a","Type":"ContainerDied","Data":"abb12c48f79fa355e1c118f44bfffd0cd2e6f2fe2e2e74b575604aefa719ac0c"}
Aug 01 01:11:48.061547 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:48.061452    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abb12c48f79fa355e1c118f44bfffd0cd2e6f2fe2e2e74b575604aefa719ac0c"
Aug 01 01:11:55.032779 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.032744    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"]
Aug 01 01:11:55.033246 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.032970    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92" podUID="a95c2778-ac96-46d1-97fd-cb049b8d81a2" containerName="payload-pre-processing" containerID="cri-o://e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814" gracePeriod=30
Aug 01 01:11:55.172158 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.172119    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"]
Aug 01 01:11:55.175559 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.175532    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47a30d-4dn26"]
Aug 01 01:11:55.313807 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.313770    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:11:55.396831 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.396798    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95c2778-ac96-46d1-97fd-cb049b8d81a2-plugins-config-volume\") pod \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\" (UID: \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\") "
Aug 01 01:11:55.396831 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.396837    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klqtp\" (UniqueName: \"kubernetes.io/projected/a95c2778-ac96-46d1-97fd-cb049b8d81a2-kube-api-access-klqtp\") pod \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\" (UID: \"a95c2778-ac96-46d1-97fd-cb049b8d81a2\") "
Aug 01 01:11:55.397206 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.397184    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a95c2778-ac96-46d1-97fd-cb049b8d81a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a95c2778-ac96-46d1-97fd-cb049b8d81a2" (UID: "a95c2778-ac96-46d1-97fd-cb049b8d81a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:11:55.398937 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.398912    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95c2778-ac96-46d1-97fd-cb049b8d81a2-kube-api-access-klqtp" (OuterVolumeSpecName: "kube-api-access-klqtp") pod "a95c2778-ac96-46d1-97fd-cb049b8d81a2" (UID: "a95c2778-ac96-46d1-97fd-cb049b8d81a2"). InnerVolumeSpecName "kube-api-access-klqtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:11:55.497849 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.497812    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95c2778-ac96-46d1-97fd-cb049b8d81a2-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:11:55.497849 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.497844    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klqtp\" (UniqueName: \"kubernetes.io/projected/a95c2778-ac96-46d1-97fd-cb049b8d81a2-kube-api-access-klqtp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:11:55.881818 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:55.881786    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe2b2726-c1a1-422a-a8ff-d5d518230d2a" path="/var/lib/kubelet/pods/fe2b2726-c1a1-422a-a8ff-d5d518230d2a/volumes"
Aug 01 01:11:56.106374 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.106338    2547 generic.go:356] "Generic (PLEG): container finished" podID="a95c2778-ac96-46d1-97fd-cb049b8d81a2" containerID="e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814" exitCode=0
Aug 01 01:11:56.106845 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.106381    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"
Aug 01 01:11:56.106845 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.106424    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92" event={"ID":"a95c2778-ac96-46d1-97fd-cb049b8d81a2","Type":"ContainerDied","Data":"e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814"}
Aug 01 01:11:56.106845 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.106504    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92" event={"ID":"a95c2778-ac96-46d1-97fd-cb049b8d81a2","Type":"ContainerDied","Data":"344182e0dd5d50aa67e52bf0db6c7eea69cc6f94bc12b152e2331ac219816b85"}
Aug 01 01:11:56.106845 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.106532    2547 scope.go:117] "RemoveContainer" containerID="e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814"
Aug 01 01:11:56.115326 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.115307    2547 scope.go:117] "RemoveContainer" containerID="e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814"
Aug 01 01:11:56.115630 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:11:56.115608    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814\": container with ID starting with e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814 not found: ID does not exist" containerID="e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814"
Aug 01 01:11:56.115720 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.115643    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814"} err="failed to get container status \"e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814\": rpc error: code = NotFound desc = could not find container \"e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814\": container with ID starting with e6daaaf09985506b07c012e34850df64c05855b51b8543def3ff80bf4b388814 not found: ID does not exist"
Aug 01 01:11:56.122938 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.122909    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"]
Aug 01 01:11:56.124946 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:56.124927    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-47a30d-98485f4b4-b9z92"]
Aug 01 01:11:57.880614 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:11:57.880583    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95c2778-ac96-46d1-97fd-cb049b8d81a2" path="/var/lib/kubelet/pods/a95c2778-ac96-46d1-97fd-cb049b8d81a2/volumes"
Aug 01 01:12:02.183226 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.183190    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"]
Aug 01 01:12:02.183662 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.183640    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95c2778-ac96-46d1-97fd-cb049b8d81a2" containerName="payload-pre-processing"
Aug 01 01:12:02.183662 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.183653    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95c2778-ac96-46d1-97fd-cb049b8d81a2" containerName="payload-pre-processing"
Aug 01 01:12:02.183750 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.183669    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2b2726-c1a1-422a-a8ff-d5d518230d2a" containerName="revoke-keys"
Aug 01 01:12:02.183750 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.183675    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2b2726-c1a1-422a-a8ff-d5d518230d2a" containerName="revoke-keys"
Aug 01 01:12:02.183750 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.183737    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2b2726-c1a1-422a-a8ff-d5d518230d2a" containerName="revoke-keys"
Aug 01 01:12:02.183750 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.183748    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95c2778-ac96-46d1-97fd-cb049b8d81a2" containerName="payload-pre-processing"
Aug 01 01:12:02.186956 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.186939    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"
Aug 01 01:12:02.189125 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.189104    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:12:02.192938 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.192916    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"]
Aug 01 01:12:02.261873 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.261841    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20f687-a887-47f9-990f-fd9bb46b7a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd\" (UID: \"4c20f687-a887-47f9-990f-fd9bb46b7a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"
Aug 01 01:12:02.362912 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.362869    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20f687-a887-47f9-990f-fd9bb46b7a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd\" (UID: \"4c20f687-a887-47f9-990f-fd9bb46b7a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"
Aug 01 01:12:02.363568 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.363547    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20f687-a887-47f9-990f-fd9bb46b7a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd\" (UID: \"4c20f687-a887-47f9-990f-fd9bb46b7a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"
Aug 01 01:12:02.500051 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.500007    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"
Aug 01 01:12:02.642356 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:02.642330    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"]
Aug 01 01:12:02.644665 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:12:02.644634    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c20f687_a887_47f9_990f_fd9bb46b7a75.slice/crio-eddd5cb0f1265a8c7960cf42376674d97e155d1d910d62fca41ac8a50214f7d7 WatchSource:0}: Error finding container eddd5cb0f1265a8c7960cf42376674d97e155d1d910d62fca41ac8a50214f7d7: Status 404 returned error can't find the container with id eddd5cb0f1265a8c7960cf42376674d97e155d1d910d62fca41ac8a50214f7d7
Aug 01 01:12:03.146349 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:03.146312    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd" event={"ID":"4c20f687-a887-47f9-990f-fd9bb46b7a75","Type":"ContainerStarted","Data":"278b346d2fd227d6426efd0bbe2caaf1e42a70a551753f7320b16d51d8db108e"}
Aug 01 01:12:03.146575 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:03.146362    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd" event={"ID":"4c20f687-a887-47f9-990f-fd9bb46b7a75","Type":"ContainerStarted","Data":"eddd5cb0f1265a8c7960cf42376674d97e155d1d910d62fca41ac8a50214f7d7"}
Aug 01 01:12:03.161245 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:03.161137    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd" podStartSLOduration=1.161117827 podStartE2EDuration="1.161117827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:12:03.160249816 +0000 UTC m=+2591.857418890" watchObservedRunningTime="2026-08-01 01:12:03.161117827 +0000 UTC m=+2591.858286993"
Aug 01 01:12:04.153299 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:04.153258    2547 generic.go:356] "Generic (PLEG): container finished" podID="4c20f687-a887-47f9-990f-fd9bb46b7a75" containerID="278b346d2fd227d6426efd0bbe2caaf1e42a70a551753f7320b16d51d8db108e" exitCode=0
Aug 01 01:12:04.153691 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:04.153340    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd" event={"ID":"4c20f687-a887-47f9-990f-fd9bb46b7a75","Type":"ContainerDied","Data":"278b346d2fd227d6426efd0bbe2caaf1e42a70a551753f7320b16d51d8db108e"}
Aug 01 01:12:05.304420 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:05.304399    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"
Aug 01 01:12:05.389322 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:05.389281    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20f687-a887-47f9-990f-fd9bb46b7a75-maas-api-service-ca\") pod \"4c20f687-a887-47f9-990f-fd9bb46b7a75\" (UID: \"4c20f687-a887-47f9-990f-fd9bb46b7a75\") "
Aug 01 01:12:05.389715 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:05.389695    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c20f687-a887-47f9-990f-fd9bb46b7a75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c20f687-a887-47f9-990f-fd9bb46b7a75" (UID: "4c20f687-a887-47f9-990f-fd9bb46b7a75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:12:05.490934 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:05.490894    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20f687-a887-47f9-990f-fd9bb46b7a75-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:12:06.165350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:06.165258    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd" event={"ID":"4c20f687-a887-47f9-990f-fd9bb46b7a75","Type":"ContainerDied","Data":"eddd5cb0f1265a8c7960cf42376674d97e155d1d910d62fca41ac8a50214f7d7"}
Aug 01 01:12:06.165350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:06.165313    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eddd5cb0f1265a8c7960cf42376674d97e155d1d910d62fca41ac8a50214f7d7"
Aug 01 01:12:06.165350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:06.165280    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"
Aug 01 01:12:12.605914 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:12.605868    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"]
Aug 01 01:12:12.606423 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:12.606140    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s" podUID="dfe2d991-4c18-497a-b16a-61f00be95ebd" containerName="maas-api" containerID="cri-o://0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a" gracePeriod=30
Aug 01 01:12:12.658720 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:12.658678    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"]
Aug 01 01:12:12.658971 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:12.658937    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw" podUID="b8ab96b1-dace-4e49-b088-6e3fa29e0e7f" containerName="payload-processing" containerID="cri-o://15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923" gracePeriod=30
Aug 01 01:12:12.809130 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:12.809092    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"]
Aug 01 01:12:12.811172 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:12.811151    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-061b54-qzbhd"]
Aug 01 01:12:12.961874 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:12.961845    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:12:13.050953 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.050925    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:12:13.065973 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.065954    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-plugins-config-volume\") pod \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\" (UID: \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\") "
Aug 01 01:12:13.066088 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.066031    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sprh7\" (UniqueName: \"kubernetes.io/projected/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-kube-api-access-sprh7\") pod \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\" (UID: \"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f\") "
Aug 01 01:12:13.066309 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.066282    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b8ab96b1-dace-4e49-b088-6e3fa29e0e7f" (UID: "b8ab96b1-dace-4e49-b088-6e3fa29e0e7f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:12:13.068023 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.067996    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-kube-api-access-sprh7" (OuterVolumeSpecName: "kube-api-access-sprh7") pod "b8ab96b1-dace-4e49-b088-6e3fa29e0e7f" (UID: "b8ab96b1-dace-4e49-b088-6e3fa29e0e7f"). InnerVolumeSpecName "kube-api-access-sprh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:12:13.167323 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.167236    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgwrz\" (UniqueName: \"kubernetes.io/projected/dfe2d991-4c18-497a-b16a-61f00be95ebd-kube-api-access-lgwrz\") pod \"dfe2d991-4c18-497a-b16a-61f00be95ebd\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") "
Aug 01 01:12:13.167323 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.167278    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe2d991-4c18-497a-b16a-61f00be95ebd-openshift-service-ca\") pod \"dfe2d991-4c18-497a-b16a-61f00be95ebd\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") "
Aug 01 01:12:13.167577 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.167342    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls\") pod \"dfe2d991-4c18-497a-b16a-61f00be95ebd\" (UID: \"dfe2d991-4c18-497a-b16a-61f00be95ebd\") "
Aug 01 01:12:13.167688 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.167649    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe2d991-4c18-497a-b16a-61f00be95ebd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dfe2d991-4c18-497a-b16a-61f00be95ebd" (UID: "dfe2d991-4c18-497a-b16a-61f00be95ebd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:12:13.167769 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.167736    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sprh7\" (UniqueName: \"kubernetes.io/projected/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-kube-api-access-sprh7\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:12:13.167769 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.167761    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:12:13.169530 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.169497    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dfe2d991-4c18-497a-b16a-61f00be95ebd" (UID: "dfe2d991-4c18-497a-b16a-61f00be95ebd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 01:12:13.169726 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.169703    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe2d991-4c18-497a-b16a-61f00be95ebd-kube-api-access-lgwrz" (OuterVolumeSpecName: "kube-api-access-lgwrz") pod "dfe2d991-4c18-497a-b16a-61f00be95ebd" (UID: "dfe2d991-4c18-497a-b16a-61f00be95ebd"). InnerVolumeSpecName "kube-api-access-lgwrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:12:13.204998 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.204968    2547 generic.go:356] "Generic (PLEG): container finished" podID="dfe2d991-4c18-497a-b16a-61f00be95ebd" containerID="0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a" exitCode=0
Aug 01 01:12:13.205150 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.205011    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"
Aug 01 01:12:13.205150 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.205011    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s" event={"ID":"dfe2d991-4c18-497a-b16a-61f00be95ebd","Type":"ContainerDied","Data":"0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a"}
Aug 01 01:12:13.205150 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.205137    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s" event={"ID":"dfe2d991-4c18-497a-b16a-61f00be95ebd","Type":"ContainerDied","Data":"36029f516a1cf129988a3c1e709fce89b6c3d0d7498ae58354a15f7094cce75d"}
Aug 01 01:12:13.205305 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.205172    2547 scope.go:117] "RemoveContainer" containerID="0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a"
Aug 01 01:12:13.206494 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.206449    2547 generic.go:356] "Generic (PLEG): container finished" podID="b8ab96b1-dace-4e49-b088-6e3fa29e0e7f" containerID="15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923" exitCode=0
Aug 01 01:12:13.206608 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.206511    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"
Aug 01 01:12:13.206608 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.206517    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw" event={"ID":"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f","Type":"ContainerDied","Data":"15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923"}
Aug 01 01:12:13.206608 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.206561    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw" event={"ID":"b8ab96b1-dace-4e49-b088-6e3fa29e0e7f","Type":"ContainerDied","Data":"c51342620a4bf7fd28b82a6ce0ccfac7b51c85ea6be0a7e0fddce7de051f814f"}
Aug 01 01:12:13.215711 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.215691    2547 scope.go:117] "RemoveContainer" containerID="0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a"
Aug 01 01:12:13.216022 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:12:13.215995    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a\": container with ID starting with 0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a not found: ID does not exist" containerID="0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a"
Aug 01 01:12:13.216113 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.216026    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a"} err="failed to get container status \"0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a\": rpc error: code = NotFound desc = could not find container \"0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a\": container with ID starting with 0898f36f00f79a43ddd68f511c5d90926f132776003f29099c138f5ac923aa0a not found: ID does not exist"
Aug 01 01:12:13.216113 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.216044    2547 scope.go:117] "RemoveContainer" containerID="15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923"
Aug 01 01:12:13.223795 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.223776    2547 scope.go:117] "RemoveContainer" containerID="15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923"
Aug 01 01:12:13.224035 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:12:13.224012    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923\": container with ID starting with 15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923 not found: ID does not exist" containerID="15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923"
Aug 01 01:12:13.224100 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.224045    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923"} err="failed to get container status \"15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923\": rpc error: code = NotFound desc = could not find container \"15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923\": container with ID starting with 15446b1bcb36e4759570a355af63468a5856412861d9da64aced0a4a6b8ce923 not found: ID does not exist"
Aug 01 01:12:13.250089 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.250054    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"]
Aug 01 01:12:13.256690 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.256663    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-061b54-6ff5d5d98d-kpj4s"]
Aug 01 01:12:13.268396 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.268375    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgwrz\" (UniqueName: \"kubernetes.io/projected/dfe2d991-4c18-497a-b16a-61f00be95ebd-kube-api-access-lgwrz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:12:13.268396 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.268396    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe2d991-4c18-497a-b16a-61f00be95ebd-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:12:13.268562 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.268407    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe2d991-4c18-497a-b16a-61f00be95ebd-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:12:13.271597 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.271575    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"]
Aug 01 01:12:13.280234 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.280208    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-061b54-77cbb98d48-552dw"]
Aug 01 01:12:13.881375 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.881344    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c20f687-a887-47f9-990f-fd9bb46b7a75" path="/var/lib/kubelet/pods/4c20f687-a887-47f9-990f-fd9bb46b7a75/volumes"
Aug 01 01:12:13.881772 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.881757    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ab96b1-dace-4e49-b088-6e3fa29e0e7f" path="/var/lib/kubelet/pods/b8ab96b1-dace-4e49-b088-6e3fa29e0e7f/volumes"
Aug 01 01:12:13.882164 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:13.882150    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe2d991-4c18-497a-b16a-61f00be95ebd" path="/var/lib/kubelet/pods/dfe2d991-4c18-497a-b16a-61f00be95ebd/volumes"
Aug 01 01:12:24.107697 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.107664    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"]
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108098    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe2d991-4c18-497a-b16a-61f00be95ebd" containerName="maas-api"
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108111    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe2d991-4c18-497a-b16a-61f00be95ebd" containerName="maas-api"
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108139    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c20f687-a887-47f9-990f-fd9bb46b7a75" containerName="revoke-keys"
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108148    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c20f687-a887-47f9-990f-fd9bb46b7a75" containerName="revoke-keys"
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108164    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ab96b1-dace-4e49-b088-6e3fa29e0e7f" containerName="payload-processing"
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108172    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ab96b1-dace-4e49-b088-6e3fa29e0e7f" containerName="payload-processing"
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108271    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c20f687-a887-47f9-990f-fd9bb46b7a75" containerName="revoke-keys"
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108288    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe2d991-4c18-497a-b16a-61f00be95ebd" containerName="maas-api"
Aug 01 01:12:24.108319 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.108303    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ab96b1-dace-4e49-b088-6e3fa29e0e7f" containerName="payload-processing"
Aug 01 01:12:24.113310 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.113291    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.115306 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.115286    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3b6f87-serving-cert\""
Aug 01 01:12:24.121784 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.121758    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"]
Aug 01 01:12:24.274256 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.274216    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb4dr\" (UniqueName: \"kubernetes.io/projected/46117c1a-e962-4bab-a72e-6184a092d004-kube-api-access-tb4dr\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.274256 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.274262    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.274467 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.274318    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46117c1a-e962-4bab-a72e-6184a092d004-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.375444 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.375346    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb4dr\" (UniqueName: \"kubernetes.io/projected/46117c1a-e962-4bab-a72e-6184a092d004-kube-api-access-tb4dr\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.375444 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.375399    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.375444 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.375428    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46117c1a-e962-4bab-a72e-6184a092d004-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.375716 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:12:24.375567    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-serving-cert: secret "maas-api-e2e-api-a-3b6f87-serving-cert" not found
Aug 01 01:12:24.375716 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:12:24.375629    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls podName:46117c1a-e962-4bab-a72e-6184a092d004 nodeName:}" failed. No retries permitted until 2026-08-01 01:12:24.875613753 +0000 UTC m=+2613.572782793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls") pod "maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj" (UID: "46117c1a-e962-4bab-a72e-6184a092d004") : secret "maas-api-e2e-api-a-3b6f87-serving-cert" not found
Aug 01 01:12:24.376083 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.376063    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46117c1a-e962-4bab-a72e-6184a092d004-openshift-service-ca\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.386108 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.386083    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb4dr\" (UniqueName: \"kubernetes.io/projected/46117c1a-e962-4bab-a72e-6184a092d004-kube-api-access-tb4dr\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.880110 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.880063    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:24.882691 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:24.882656    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls\") pod \"maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:25.026261 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:25.026227    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:25.169526 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:25.169499    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"]
Aug 01 01:12:25.171667 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:12:25.171634    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46117c1a_e962_4bab_a72e_6184a092d004.slice/crio-c3be2c41540ef3cdd6f3827b6840126578b50c87d3fc692b36551a7de1ca84bd WatchSource:0}: Error finding container c3be2c41540ef3cdd6f3827b6840126578b50c87d3fc692b36551a7de1ca84bd: Status 404 returned error can't find the container with id c3be2c41540ef3cdd6f3827b6840126578b50c87d3fc692b36551a7de1ca84bd
Aug 01 01:12:25.277544 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:25.277511    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj" event={"ID":"46117c1a-e962-4bab-a72e-6184a092d004","Type":"ContainerStarted","Data":"c3be2c41540ef3cdd6f3827b6840126578b50c87d3fc692b36551a7de1ca84bd"}
Aug 01 01:12:26.284077 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:26.284040    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj" event={"ID":"46117c1a-e962-4bab-a72e-6184a092d004","Type":"ContainerStarted","Data":"b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6"}
Aug 01 01:12:26.284531 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:26.284256    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:26.299382 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:26.299334    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj" podStartSLOduration=1.7145798380000001 podStartE2EDuration="2.299317794s" totalImagesPullingTime="584.737956ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:12:26.297855348 +0000 UTC m=+2614.995024410" watchObservedRunningTime="2026-08-01 01:12:26.299317794 +0000 UTC m=+2614.996486855"
Aug 01 01:12:32.295472 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:32.295441    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:12:52.213370 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.213342    2547 scope.go:117] "RemoveContainer" containerID="ec784c6b1651f6ff72da52ae49b64185c670188e8120cf034cd4aa11e9191475"
Aug 01 01:12:52.331424 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.331390    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"]
Aug 01 01:12:52.336642 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.336616    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.338863 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.338835    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-113a68-serving-cert\""
Aug 01 01:12:52.347380 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.347352    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"]
Aug 01 01:12:52.444523 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.444474    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea275f14-a30f-4725-90f2-72f43fe2351c-maas-api-tls\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.444691 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.444539    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea275f14-a30f-4725-90f2-72f43fe2351c-openshift-service-ca\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.444691 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.444562    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztw6k\" (UniqueName: \"kubernetes.io/projected/ea275f14-a30f-4725-90f2-72f43fe2351c-kube-api-access-ztw6k\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.545096 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.545062    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea275f14-a30f-4725-90f2-72f43fe2351c-maas-api-tls\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.545272 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.545109    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea275f14-a30f-4725-90f2-72f43fe2351c-openshift-service-ca\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.545272 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.545136    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztw6k\" (UniqueName: \"kubernetes.io/projected/ea275f14-a30f-4725-90f2-72f43fe2351c-kube-api-access-ztw6k\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.545871 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.545850    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea275f14-a30f-4725-90f2-72f43fe2351c-openshift-service-ca\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.547596 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.547576    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea275f14-a30f-4725-90f2-72f43fe2351c-maas-api-tls\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.552583 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.552551    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztw6k\" (UniqueName: \"kubernetes.io/projected/ea275f14-a30f-4725-90f2-72f43fe2351c-kube-api-access-ztw6k\") pod \"maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.649395 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.649365    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:52.962004 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.961928    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"]
Aug 01 01:12:52.965700 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.965679    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:52.967904 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.967883    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-113a68-dockercfg-vnxnr\""
Aug 01 01:12:52.968053 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.967917    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-113a68\""
Aug 01 01:12:52.979120 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.979095    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"]
Aug 01 01:12:52.997467 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:52.997442    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"]
Aug 01 01:12:52.998978 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:12:52.998954    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea275f14_a30f_4725_90f2_72f43fe2351c.slice/crio-fd5d177274c97e4e02d0b76a73a3085becf419177df219649353a19d2ab49021 WatchSource:0}: Error finding container fd5d177274c97e4e02d0b76a73a3085becf419177df219649353a19d2ab49021: Status 404 returned error can't find the container with id fd5d177274c97e4e02d0b76a73a3085becf419177df219649353a19d2ab49021
Aug 01 01:12:53.050301 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.050280    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7fzj\" (UniqueName: \"kubernetes.io/projected/53e31949-5491-4ff6-afa2-f37d3e9d341e-kube-api-access-n7fzj\") pod \"payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb\" (UID: \"53e31949-5491-4ff6-afa2-f37d3e9d341e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:53.050418 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.050355    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53e31949-5491-4ff6-afa2-f37d3e9d341e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb\" (UID: \"53e31949-5491-4ff6-afa2-f37d3e9d341e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:53.151849 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.151810    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7fzj\" (UniqueName: \"kubernetes.io/projected/53e31949-5491-4ff6-afa2-f37d3e9d341e-kube-api-access-n7fzj\") pod \"payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb\" (UID: \"53e31949-5491-4ff6-afa2-f37d3e9d341e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:53.152007 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.151929    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53e31949-5491-4ff6-afa2-f37d3e9d341e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb\" (UID: \"53e31949-5491-4ff6-afa2-f37d3e9d341e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:53.152684 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.152667    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53e31949-5491-4ff6-afa2-f37d3e9d341e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb\" (UID: \"53e31949-5491-4ff6-afa2-f37d3e9d341e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:53.173562 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.173536    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7fzj\" (UniqueName: \"kubernetes.io/projected/53e31949-5491-4ff6-afa2-f37d3e9d341e-kube-api-access-n7fzj\") pod \"payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb\" (UID: \"53e31949-5491-4ff6-afa2-f37d3e9d341e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:53.277399 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.277369    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:53.432143 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.432116    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"]
Aug 01 01:12:53.434269 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:12:53.434243    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e31949_5491_4ff6_afa2_f37d3e9d341e.slice/crio-0228b87c6c779a845985d6d398dbd4cc0e65e2f0bf442fcda1ac251bf73e86f9 WatchSource:0}: Error finding container 0228b87c6c779a845985d6d398dbd4cc0e65e2f0bf442fcda1ac251bf73e86f9: Status 404 returned error can't find the container with id 0228b87c6c779a845985d6d398dbd4cc0e65e2f0bf442fcda1ac251bf73e86f9
Aug 01 01:12:53.439593 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.439570    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq" event={"ID":"ea275f14-a30f-4725-90f2-72f43fe2351c","Type":"ContainerStarted","Data":"c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f"}
Aug 01 01:12:53.439680 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.439616    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq" event={"ID":"ea275f14-a30f-4725-90f2-72f43fe2351c","Type":"ContainerStarted","Data":"fd5d177274c97e4e02d0b76a73a3085becf419177df219649353a19d2ab49021"}
Aug 01 01:12:53.440351 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.440331    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:12:53.459502 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:53.459447    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq" podStartSLOduration=1.165357093 podStartE2EDuration="1.459432529s" totalImagesPullingTime="294.075436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:12:53.457774912 +0000 UTC m=+2642.154943986" watchObservedRunningTime="2026-08-01 01:12:53.459432529 +0000 UTC m=+2642.156601591"
Aug 01 01:12:54.446945 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:54.446897    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb" event={"ID":"53e31949-5491-4ff6-afa2-f37d3e9d341e","Type":"ContainerStarted","Data":"636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e"}
Aug 01 01:12:54.447426 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:54.446961    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb" event={"ID":"53e31949-5491-4ff6-afa2-f37d3e9d341e","Type":"ContainerStarted","Data":"0228b87c6c779a845985d6d398dbd4cc0e65e2f0bf442fcda1ac251bf73e86f9"}
Aug 01 01:12:54.447426 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:54.447104    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:12:54.464018 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:54.463960    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb" podStartSLOduration=2.463945194 podStartE2EDuration="2.463945194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:12:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:12:54.461995793 +0000 UTC m=+2643.159164879" watchObservedRunningTime="2026-08-01 01:12:54.463945194 +0000 UTC m=+2643.161114255"
Aug 01 01:12:59.452222 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:12:59.452190    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:13:05.455103 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:05.455077    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:13:18.891239 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:18.891205    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"]
Aug 01 01:13:18.895135 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:18.895118    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"
Aug 01 01:13:18.897182 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:18.897156    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:13:18.901581 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:18.901551    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"]
Aug 01 01:13:18.912411 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:18.911850    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6b97451-3983-4a1f-b692-ea7f998d86c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z\" (UID: \"e6b97451-3983-4a1f-b692-ea7f998d86c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"
Aug 01 01:13:19.012940 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:19.012898    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6b97451-3983-4a1f-b692-ea7f998d86c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z\" (UID: \"e6b97451-3983-4a1f-b692-ea7f998d86c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"
Aug 01 01:13:19.013608 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:19.013586    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6b97451-3983-4a1f-b692-ea7f998d86c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z\" (UID: \"e6b97451-3983-4a1f-b692-ea7f998d86c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"
Aug 01 01:13:19.215939 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:19.215908    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"
Aug 01 01:13:19.354035 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:19.354004    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"]
Aug 01 01:13:19.355809 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:13:19.355769    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b97451_3983_4a1f_b692_ea7f998d86c8.slice/crio-651c3f54b1b13375279152d19126ed1dbd67a82f249cc5f84a972fd2670525d6 WatchSource:0}: Error finding container 651c3f54b1b13375279152d19126ed1dbd67a82f249cc5f84a972fd2670525d6: Status 404 returned error can't find the container with id 651c3f54b1b13375279152d19126ed1dbd67a82f249cc5f84a972fd2670525d6
Aug 01 01:13:19.602148 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:19.602107    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z" event={"ID":"e6b97451-3983-4a1f-b692-ea7f998d86c8","Type":"ContainerStarted","Data":"651c3f54b1b13375279152d19126ed1dbd67a82f249cc5f84a972fd2670525d6"}
Aug 01 01:13:20.609644 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:20.609609    2547 generic.go:356] "Generic (PLEG): container finished" podID="e6b97451-3983-4a1f-b692-ea7f998d86c8" containerID="d65a63aabf669635e7b9caa4ee449aa3d51da7bbcf3541735e68001695e23615" exitCode=0
Aug 01 01:13:20.610016 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:20.609642    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z" event={"ID":"e6b97451-3983-4a1f-b692-ea7f998d86c8","Type":"ContainerDied","Data":"d65a63aabf669635e7b9caa4ee449aa3d51da7bbcf3541735e68001695e23615"}
Aug 01 01:13:21.758021 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:21.757993    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"
Aug 01 01:13:21.840245 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:21.840213    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6b97451-3983-4a1f-b692-ea7f998d86c8-maas-api-service-ca\") pod \"e6b97451-3983-4a1f-b692-ea7f998d86c8\" (UID: \"e6b97451-3983-4a1f-b692-ea7f998d86c8\") "
Aug 01 01:13:21.840590 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:21.840565    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6b97451-3983-4a1f-b692-ea7f998d86c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e6b97451-3983-4a1f-b692-ea7f998d86c8" (UID: "e6b97451-3983-4a1f-b692-ea7f998d86c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:13:21.941849 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:21.941817    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6b97451-3983-4a1f-b692-ea7f998d86c8-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:22.621519 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:22.621471    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"
Aug 01 01:13:22.621519 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:22.621513    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z" event={"ID":"e6b97451-3983-4a1f-b692-ea7f998d86c8","Type":"ContainerDied","Data":"651c3f54b1b13375279152d19126ed1dbd67a82f249cc5f84a972fd2670525d6"}
Aug 01 01:13:22.621754 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:22.621562    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="651c3f54b1b13375279152d19126ed1dbd67a82f249cc5f84a972fd2670525d6"
Aug 01 01:13:34.382723 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.382679    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"]
Aug 01 01:13:34.383318 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.382907    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj" podUID="46117c1a-e962-4bab-a72e-6184a092d004" containerName="maas-api" containerID="cri-o://b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6" gracePeriod=30
Aug 01 01:13:34.575642 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.575608    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"]
Aug 01 01:13:34.577750 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.577723    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b6f87-nkt9z"]
Aug 01 01:13:34.653835 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.653811    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:13:34.691955 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.691916    2547 generic.go:356] "Generic (PLEG): container finished" podID="46117c1a-e962-4bab-a72e-6184a092d004" containerID="b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6" exitCode=0
Aug 01 01:13:34.692139 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.691962    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"
Aug 01 01:13:34.692139 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.692006    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj" event={"ID":"46117c1a-e962-4bab-a72e-6184a092d004","Type":"ContainerDied","Data":"b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6"}
Aug 01 01:13:34.692139 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.692070    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj" event={"ID":"46117c1a-e962-4bab-a72e-6184a092d004","Type":"ContainerDied","Data":"c3be2c41540ef3cdd6f3827b6840126578b50c87d3fc692b36551a7de1ca84bd"}
Aug 01 01:13:34.692926 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.692100    2547 scope.go:117] "RemoveContainer" containerID="b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6"
Aug 01 01:13:34.701975 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.701954    2547 scope.go:117] "RemoveContainer" containerID="b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6"
Aug 01 01:13:34.702314 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:13:34.702294    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6\": container with ID starting with b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6 not found: ID does not exist" containerID="b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6"
Aug 01 01:13:34.702385 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.702326    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6"} err="failed to get container status \"b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6\": rpc error: code = NotFound desc = could not find container \"b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6\": container with ID starting with b801b17ed7ab29b73b85407f8e48b6f5f5ccc78dc947290db47a28dffa6e6ee6 not found: ID does not exist"
Aug 01 01:13:34.769703 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.769670    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls\") pod \"46117c1a-e962-4bab-a72e-6184a092d004\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") "
Aug 01 01:13:34.769882 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.769726    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46117c1a-e962-4bab-a72e-6184a092d004-openshift-service-ca\") pod \"46117c1a-e962-4bab-a72e-6184a092d004\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") "
Aug 01 01:13:34.769882 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.769751    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb4dr\" (UniqueName: \"kubernetes.io/projected/46117c1a-e962-4bab-a72e-6184a092d004-kube-api-access-tb4dr\") pod \"46117c1a-e962-4bab-a72e-6184a092d004\" (UID: \"46117c1a-e962-4bab-a72e-6184a092d004\") "
Aug 01 01:13:34.770115 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.770083    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46117c1a-e962-4bab-a72e-6184a092d004-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46117c1a-e962-4bab-a72e-6184a092d004" (UID: "46117c1a-e962-4bab-a72e-6184a092d004"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:13:34.771931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.771906    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46117c1a-e962-4bab-a72e-6184a092d004" (UID: "46117c1a-e962-4bab-a72e-6184a092d004"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 01:13:34.771931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.771912    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46117c1a-e962-4bab-a72e-6184a092d004-kube-api-access-tb4dr" (OuterVolumeSpecName: "kube-api-access-tb4dr") pod "46117c1a-e962-4bab-a72e-6184a092d004" (UID: "46117c1a-e962-4bab-a72e-6184a092d004"). InnerVolumeSpecName "kube-api-access-tb4dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:13:34.871611 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.871575    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46117c1a-e962-4bab-a72e-6184a092d004-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:34.871611 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.871606    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46117c1a-e962-4bab-a72e-6184a092d004-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:34.871611 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:34.871618    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb4dr\" (UniqueName: \"kubernetes.io/projected/46117c1a-e962-4bab-a72e-6184a092d004-kube-api-access-tb4dr\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:35.013170 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:35.013136    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"]
Aug 01 01:13:35.016909 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:35.016881    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3b6f87-756c99ccc4-4t8gj"]
Aug 01 01:13:35.881617 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:35.881586    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46117c1a-e962-4bab-a72e-6184a092d004" path="/var/lib/kubelet/pods/46117c1a-e962-4bab-a72e-6184a092d004/volumes"
Aug 01 01:13:35.881999 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:35.881949    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6b97451-3983-4a1f-b692-ea7f998d86c8" path="/var/lib/kubelet/pods/e6b97451-3983-4a1f-b692-ea7f998d86c8/volumes"
Aug 01 01:13:41.679539 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.679502    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"]
Aug 01 01:13:41.679971 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.679958    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46117c1a-e962-4bab-a72e-6184a092d004" containerName="maas-api"
Aug 01 01:13:41.679971 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.679972    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="46117c1a-e962-4bab-a72e-6184a092d004" containerName="maas-api"
Aug 01 01:13:41.680046 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.679993    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6b97451-3983-4a1f-b692-ea7f998d86c8" containerName="revoke-keys"
Aug 01 01:13:41.680046 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.679999    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b97451-3983-4a1f-b692-ea7f998d86c8" containerName="revoke-keys"
Aug 01 01:13:41.680108 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.680056    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6b97451-3983-4a1f-b692-ea7f998d86c8" containerName="revoke-keys"
Aug 01 01:13:41.680108 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.680066    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="46117c1a-e962-4bab-a72e-6184a092d004" containerName="maas-api"
Aug 01 01:13:41.684443 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.684427    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"
Aug 01 01:13:41.687305 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.687279    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:13:41.690006 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.689979    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"]
Aug 01 01:13:41.841646 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.841611    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f55fad60-bde0-47b6-a756-6fda90497392-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-113a68-b2f7c\" (UID: \"f55fad60-bde0-47b6-a756-6fda90497392\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"
Aug 01 01:13:41.942972 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.942857    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f55fad60-bde0-47b6-a756-6fda90497392-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-113a68-b2f7c\" (UID: \"f55fad60-bde0-47b6-a756-6fda90497392\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"
Aug 01 01:13:41.943535 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.943517    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f55fad60-bde0-47b6-a756-6fda90497392-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-113a68-b2f7c\" (UID: \"f55fad60-bde0-47b6-a756-6fda90497392\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"
Aug 01 01:13:41.996591 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:41.996554    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"
Aug 01 01:13:42.138317 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:42.138287    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"]
Aug 01 01:13:42.140007 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:13:42.139978    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55fad60_bde0_47b6_a756_6fda90497392.slice/crio-4ea4d97d692851add3a439075f661905b78bcc25c495f209f1d157e8468bbe0a WatchSource:0}: Error finding container 4ea4d97d692851add3a439075f661905b78bcc25c495f209f1d157e8468bbe0a: Status 404 returned error can't find the container with id 4ea4d97d692851add3a439075f661905b78bcc25c495f209f1d157e8468bbe0a
Aug 01 01:13:42.741000 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:42.740959    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c" event={"ID":"f55fad60-bde0-47b6-a756-6fda90497392","Type":"ContainerStarted","Data":"5d2dc908216575069f79b8fdb456218ad9a06eeda0a65bd9d416a19026c31d53"}
Aug 01 01:13:42.741366 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:42.741053    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c" event={"ID":"f55fad60-bde0-47b6-a756-6fda90497392","Type":"ContainerStarted","Data":"4ea4d97d692851add3a439075f661905b78bcc25c495f209f1d157e8468bbe0a"}
Aug 01 01:13:42.754813 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:42.754763    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c" podStartSLOduration=1.754747727 podStartE2EDuration="1.754747727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:13:42.753690479 +0000 UTC m=+2691.450859542" watchObservedRunningTime="2026-08-01 01:13:42.754747727 +0000 UTC m=+2691.451916788"
Aug 01 01:13:43.747551 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:43.747455    2547 generic.go:356] "Generic (PLEG): container finished" podID="f55fad60-bde0-47b6-a756-6fda90497392" containerID="5d2dc908216575069f79b8fdb456218ad9a06eeda0a65bd9d416a19026c31d53" exitCode=0
Aug 01 01:13:43.747551 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:43.747517    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c" event={"ID":"f55fad60-bde0-47b6-a756-6fda90497392","Type":"ContainerDied","Data":"5d2dc908216575069f79b8fdb456218ad9a06eeda0a65bd9d416a19026c31d53"}
Aug 01 01:13:44.898681 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:44.898647    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"
Aug 01 01:13:45.075562 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:45.075452    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f55fad60-bde0-47b6-a756-6fda90497392-maas-api-service-ca\") pod \"f55fad60-bde0-47b6-a756-6fda90497392\" (UID: \"f55fad60-bde0-47b6-a756-6fda90497392\") "
Aug 01 01:13:45.075865 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:45.075838    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f55fad60-bde0-47b6-a756-6fda90497392-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f55fad60-bde0-47b6-a756-6fda90497392" (UID: "f55fad60-bde0-47b6-a756-6fda90497392"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:13:45.177126 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:45.177090    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f55fad60-bde0-47b6-a756-6fda90497392-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:45.761265 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:45.761233    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"
Aug 01 01:13:45.761475 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:45.761273    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c" event={"ID":"f55fad60-bde0-47b6-a756-6fda90497392","Type":"ContainerDied","Data":"4ea4d97d692851add3a439075f661905b78bcc25c495f209f1d157e8468bbe0a"}
Aug 01 01:13:45.761475 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:45.761319    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ea4d97d692851add3a439075f661905b78bcc25c495f209f1d157e8468bbe0a"
Aug 01 01:13:52.032956 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:52.032923    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:13:52.038531 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:52.038509    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:13:57.223015 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.222975    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"]
Aug 01 01:13:57.223562 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.223236    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq" podUID="ea275f14-a30f-4725-90f2-72f43fe2351c" containerName="maas-api" containerID="cri-o://c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f" gracePeriod=30
Aug 01 01:13:57.280901 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.280861    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"]
Aug 01 01:13:57.281167 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.281135    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb" podUID="53e31949-5491-4ff6-afa2-f37d3e9d341e" containerName="payload-pre-processing" containerID="cri-o://636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e" gracePeriod=30
Aug 01 01:13:57.412032 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.411984    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"]
Aug 01 01:13:57.415727 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.415683    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113a68-b2f7c"]
Aug 01 01:13:57.565677 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.565648    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:13:57.583925 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.583592    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea275f14-a30f-4725-90f2-72f43fe2351c-maas-api-tls\") pod \"ea275f14-a30f-4725-90f2-72f43fe2351c\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") "
Aug 01 01:13:57.583925 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.583736    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztw6k\" (UniqueName: \"kubernetes.io/projected/ea275f14-a30f-4725-90f2-72f43fe2351c-kube-api-access-ztw6k\") pod \"ea275f14-a30f-4725-90f2-72f43fe2351c\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") "
Aug 01 01:13:57.583925 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.583792    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea275f14-a30f-4725-90f2-72f43fe2351c-openshift-service-ca\") pod \"ea275f14-a30f-4725-90f2-72f43fe2351c\" (UID: \"ea275f14-a30f-4725-90f2-72f43fe2351c\") "
Aug 01 01:13:57.584434 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.584389    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea275f14-a30f-4725-90f2-72f43fe2351c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea275f14-a30f-4725-90f2-72f43fe2351c" (UID: "ea275f14-a30f-4725-90f2-72f43fe2351c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:13:57.586758 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.586707    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea275f14-a30f-4725-90f2-72f43fe2351c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea275f14-a30f-4725-90f2-72f43fe2351c" (UID: "ea275f14-a30f-4725-90f2-72f43fe2351c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 01:13:57.586964 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.586937    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea275f14-a30f-4725-90f2-72f43fe2351c-kube-api-access-ztw6k" (OuterVolumeSpecName: "kube-api-access-ztw6k") pod "ea275f14-a30f-4725-90f2-72f43fe2351c" (UID: "ea275f14-a30f-4725-90f2-72f43fe2351c"). InnerVolumeSpecName "kube-api-access-ztw6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:13:57.592635 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.592602    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:13:57.684782 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.684744    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53e31949-5491-4ff6-afa2-f37d3e9d341e-plugins-config-volume\") pod \"53e31949-5491-4ff6-afa2-f37d3e9d341e\" (UID: \"53e31949-5491-4ff6-afa2-f37d3e9d341e\") "
Aug 01 01:13:57.684958 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.684938    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7fzj\" (UniqueName: \"kubernetes.io/projected/53e31949-5491-4ff6-afa2-f37d3e9d341e-kube-api-access-n7fzj\") pod \"53e31949-5491-4ff6-afa2-f37d3e9d341e\" (UID: \"53e31949-5491-4ff6-afa2-f37d3e9d341e\") "
Aug 01 01:13:57.685222 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.685202    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztw6k\" (UniqueName: \"kubernetes.io/projected/ea275f14-a30f-4725-90f2-72f43fe2351c-kube-api-access-ztw6k\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:57.685222 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.685220    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea275f14-a30f-4725-90f2-72f43fe2351c-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:57.685366 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.685236    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea275f14-a30f-4725-90f2-72f43fe2351c-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:57.685366 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.685265    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53e31949-5491-4ff6-afa2-f37d3e9d341e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53e31949-5491-4ff6-afa2-f37d3e9d341e" (UID: "53e31949-5491-4ff6-afa2-f37d3e9d341e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:13:57.687575 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.687545    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e31949-5491-4ff6-afa2-f37d3e9d341e-kube-api-access-n7fzj" (OuterVolumeSpecName: "kube-api-access-n7fzj") pod "53e31949-5491-4ff6-afa2-f37d3e9d341e" (UID: "53e31949-5491-4ff6-afa2-f37d3e9d341e"). InnerVolumeSpecName "kube-api-access-n7fzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:13:57.785997 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.785904    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7fzj\" (UniqueName: \"kubernetes.io/projected/53e31949-5491-4ff6-afa2-f37d3e9d341e-kube-api-access-n7fzj\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:57.785997 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.785947    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53e31949-5491-4ff6-afa2-f37d3e9d341e-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:13:57.827847 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.827812    2547 generic.go:356] "Generic (PLEG): container finished" podID="ea275f14-a30f-4725-90f2-72f43fe2351c" containerID="c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f" exitCode=0
Aug 01 01:13:57.828047 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.827863    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"
Aug 01 01:13:57.828047 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.827905    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq" event={"ID":"ea275f14-a30f-4725-90f2-72f43fe2351c","Type":"ContainerDied","Data":"c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f"}
Aug 01 01:13:57.828047 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.827966    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq" event={"ID":"ea275f14-a30f-4725-90f2-72f43fe2351c","Type":"ContainerDied","Data":"fd5d177274c97e4e02d0b76a73a3085becf419177df219649353a19d2ab49021"}
Aug 01 01:13:57.828047 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.827997    2547 scope.go:117] "RemoveContainer" containerID="c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f"
Aug 01 01:13:57.829271 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.829244    2547 generic.go:356] "Generic (PLEG): container finished" podID="53e31949-5491-4ff6-afa2-f37d3e9d341e" containerID="636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e" exitCode=0
Aug 01 01:13:57.829397 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.829283    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"
Aug 01 01:13:57.829397 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.829346    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb" event={"ID":"53e31949-5491-4ff6-afa2-f37d3e9d341e","Type":"ContainerDied","Data":"636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e"}
Aug 01 01:13:57.829559 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.829403    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb" event={"ID":"53e31949-5491-4ff6-afa2-f37d3e9d341e","Type":"ContainerDied","Data":"0228b87c6c779a845985d6d398dbd4cc0e65e2f0bf442fcda1ac251bf73e86f9"}
Aug 01 01:13:57.837606 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.837583    2547 scope.go:117] "RemoveContainer" containerID="c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f"
Aug 01 01:13:57.837973 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:13:57.837945    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f\": container with ID starting with c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f not found: ID does not exist" containerID="c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f"
Aug 01 01:13:57.838024 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.837989    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f"} err="failed to get container status \"c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f\": rpc error: code = NotFound desc = could not find container \"c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f\": container with ID starting with c7400d07636605840aa11bbf66489581e492e7a779d8acbf6d5454dcef0c8e8f not found: ID does not exist"
Aug 01 01:13:57.838024 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.838014    2547 scope.go:117] "RemoveContainer" containerID="636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e"
Aug 01 01:13:57.846819 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.846793    2547 scope.go:117] "RemoveContainer" containerID="636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e"
Aug 01 01:13:57.847095 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:13:57.847077    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e\": container with ID starting with 636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e not found: ID does not exist" containerID="636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e"
Aug 01 01:13:57.847144 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.847106    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e"} err="failed to get container status \"636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e\": rpc error: code = NotFound desc = could not find container \"636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e\": container with ID starting with 636fbfda98d3d3555df5c4170c850002d0147bdb6c941d19e1a3b6f44c341d7e not found: ID does not exist"
Aug 01 01:13:57.853346 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.853310    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"]
Aug 01 01:13:57.858449 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.858403    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-113a68-f7b458f96-fqbcb"]
Aug 01 01:13:57.866322 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.866280    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"]
Aug 01 01:13:57.868604 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.868576    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-113a68-fcdf8fb5c-sh2vq"]
Aug 01 01:13:57.881587 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.881554    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53e31949-5491-4ff6-afa2-f37d3e9d341e" path="/var/lib/kubelet/pods/53e31949-5491-4ff6-afa2-f37d3e9d341e/volumes"
Aug 01 01:13:57.881967 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.881954    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea275f14-a30f-4725-90f2-72f43fe2351c" path="/var/lib/kubelet/pods/ea275f14-a30f-4725-90f2-72f43fe2351c/volumes"
Aug 01 01:13:57.882288 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:13:57.882275    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f55fad60-bde0-47b6-a756-6fda90497392" path="/var/lib/kubelet/pods/f55fad60-bde0-47b6-a756-6fda90497392/volumes"
Aug 01 01:14:08.735367 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.735330    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"]
Aug 01 01:14:08.735992 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.735969    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e31949-5491-4ff6-afa2-f37d3e9d341e" containerName="payload-pre-processing"
Aug 01 01:14:08.736079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.735995    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e31949-5491-4ff6-afa2-f37d3e9d341e" containerName="payload-pre-processing"
Aug 01 01:14:08.736079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.736015    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea275f14-a30f-4725-90f2-72f43fe2351c" containerName="maas-api"
Aug 01 01:14:08.736079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.736024    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea275f14-a30f-4725-90f2-72f43fe2351c" containerName="maas-api"
Aug 01 01:14:08.736079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.736067    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f55fad60-bde0-47b6-a756-6fda90497392" containerName="revoke-keys"
Aug 01 01:14:08.736079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.736079    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f55fad60-bde0-47b6-a756-6fda90497392" containerName="revoke-keys"
Aug 01 01:14:08.736318 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.736185    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="53e31949-5491-4ff6-afa2-f37d3e9d341e" containerName="payload-pre-processing"
Aug 01 01:14:08.736318 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.736201    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea275f14-a30f-4725-90f2-72f43fe2351c" containerName="maas-api"
Aug 01 01:14:08.736318 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.736217    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f55fad60-bde0-47b6-a756-6fda90497392" containerName="revoke-keys"
Aug 01 01:14:08.739644 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.739618    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.741934 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.741909    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-1e2f5b-serving-cert\""
Aug 01 01:14:08.750773 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.750738    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"]
Aug 01 01:14:08.792461 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.792410    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5wjt\" (UniqueName: \"kubernetes.io/projected/a2053e9d-170f-49cc-ae29-374442bd746d-kube-api-access-z5wjt\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.792680 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.792520    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2053e9d-170f-49cc-ae29-374442bd746d-maas-api-tls\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.792680 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.792555    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2053e9d-170f-49cc-ae29-374442bd746d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.893880 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.893838    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2053e9d-170f-49cc-ae29-374442bd746d-maas-api-tls\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.894083 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.893897    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2053e9d-170f-49cc-ae29-374442bd746d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.894083 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.894028    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5wjt\" (UniqueName: \"kubernetes.io/projected/a2053e9d-170f-49cc-ae29-374442bd746d-kube-api-access-z5wjt\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.894706 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.894680    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2053e9d-170f-49cc-ae29-374442bd746d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.896457 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.896434    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2053e9d-170f-49cc-ae29-374442bd746d-maas-api-tls\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:08.902856 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:08.902823    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5wjt\" (UniqueName: \"kubernetes.io/projected/a2053e9d-170f-49cc-ae29-374442bd746d-kube-api-access-z5wjt\") pod \"maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:09.052607 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:09.052508    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:09.209823 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:09.209745    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"]
Aug 01 01:14:09.212329 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:14:09.212292    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2053e9d_170f_49cc_ae29_374442bd746d.slice/crio-d1216eade23b256ec3aa8e384e2d8739ebd9fa19964c5bf62789e25841e8c9af WatchSource:0}: Error finding container d1216eade23b256ec3aa8e384e2d8739ebd9fa19964c5bf62789e25841e8c9af: Status 404 returned error can't find the container with id d1216eade23b256ec3aa8e384e2d8739ebd9fa19964c5bf62789e25841e8c9af
Aug 01 01:14:09.904634 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:09.904515    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg" event={"ID":"a2053e9d-170f-49cc-ae29-374442bd746d","Type":"ContainerStarted","Data":"ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc"}
Aug 01 01:14:09.904634 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:09.904582    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg" event={"ID":"a2053e9d-170f-49cc-ae29-374442bd746d","Type":"ContainerStarted","Data":"d1216eade23b256ec3aa8e384e2d8739ebd9fa19964c5bf62789e25841e8c9af"}
Aug 01 01:14:09.904634 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:09.904613    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:09.931367 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:09.931304    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg" podStartSLOduration=1.5379111399999998 podStartE2EDuration="1.931286475s" totalImagesPullingTime="393.375335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:14:09.929540046 +0000 UTC m=+2718.626709112" watchObservedRunningTime="2026-08-01 01:14:09.931286475 +0000 UTC m=+2718.628455536"
Aug 01 01:14:15.917147 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:15.917116    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:14:36.814846 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.814807    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"]
Aug 01 01:14:36.819249 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.819222    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:36.821245 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.821221    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-4224e1-serving-cert\""
Aug 01 01:14:36.830366 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.830331    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"]
Aug 01 01:14:36.872972 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.872923    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:36.873155 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.873040    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:36.873155 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.873093    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44fn\" (UniqueName: \"kubernetes.io/projected/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-kube-api-access-r44fn\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:36.973572 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.973525    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:36.973792 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.973610    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r44fn\" (UniqueName: \"kubernetes.io/projected/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-kube-api-access-r44fn\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:36.973792 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.973652    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:36.973792 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:14:36.973672    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-serving-cert: secret "maas-api-e2e-shared-b-4224e1-serving-cert" not found
Aug 01 01:14:36.973792 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:14:36.973767    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls podName:9b16932f-c7c5-4d9c-848b-5e5938af5d9c nodeName:}" failed. No retries permitted until 2026-08-01 01:14:37.473744165 +0000 UTC m=+2746.170913205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls") pod "maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc" (UID: "9b16932f-c7c5-4d9c-848b-5e5938af5d9c") : secret "maas-api-e2e-shared-b-4224e1-serving-cert" not found
Aug 01 01:14:36.974387 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.974361    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:36.982542 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:36.982512    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44fn\" (UniqueName: \"kubernetes.io/projected/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-kube-api-access-r44fn\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:37.456464 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.456423    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"]
Aug 01 01:14:37.460280 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.460258    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:37.462449 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.462422    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-4224e1\""
Aug 01 01:14:37.462630 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.462473    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-4224e1-dockercfg-89255\""
Aug 01 01:14:37.467968 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.467930    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"]
Aug 01 01:14:37.477008 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.476970    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:37.477203 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.477035    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d70458b-f1f9-47ec-8e0a-40bd54fea403-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8\" (UID: \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:37.477203 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.477102    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b785k\" (UniqueName: \"kubernetes.io/projected/8d70458b-f1f9-47ec-8e0a-40bd54fea403-kube-api-access-b785k\") pod \"payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8\" (UID: \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:37.479460 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.479434    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls\") pod \"maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:37.577809 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.577773    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d70458b-f1f9-47ec-8e0a-40bd54fea403-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8\" (UID: \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:37.578018 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.577839    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b785k\" (UniqueName: \"kubernetes.io/projected/8d70458b-f1f9-47ec-8e0a-40bd54fea403-kube-api-access-b785k\") pod \"payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8\" (UID: \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:37.578665 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.578637    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d70458b-f1f9-47ec-8e0a-40bd54fea403-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8\" (UID: \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:37.586240 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.586205    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b785k\" (UniqueName: \"kubernetes.io/projected/8d70458b-f1f9-47ec-8e0a-40bd54fea403-kube-api-access-b785k\") pod \"payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8\" (UID: \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:37.733296 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.733257    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:37.774585 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.774545    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:37.897885 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.897782    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"]
Aug 01 01:14:37.905908 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.905871    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 01 01:14:37.944605 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:37.944565    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"]
Aug 01 01:14:37.949043 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:14:37.949010    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d70458b_f1f9_47ec_8e0a_40bd54fea403.slice/crio-eae22903c62bf0f076390fd0bb1fabfaebad9c20feff08a80e038d8feec4cbd7 WatchSource:0}: Error finding container eae22903c62bf0f076390fd0bb1fabfaebad9c20feff08a80e038d8feec4cbd7: Status 404 returned error can't find the container with id eae22903c62bf0f076390fd0bb1fabfaebad9c20feff08a80e038d8feec4cbd7
Aug 01 01:14:38.085421 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:38.085382    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8" event={"ID":"8d70458b-f1f9-47ec-8e0a-40bd54fea403","Type":"ContainerStarted","Data":"d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d"}
Aug 01 01:14:38.085649 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:38.085451    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8" event={"ID":"8d70458b-f1f9-47ec-8e0a-40bd54fea403","Type":"ContainerStarted","Data":"eae22903c62bf0f076390fd0bb1fabfaebad9c20feff08a80e038d8feec4cbd7"}
Aug 01 01:14:38.085649 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:38.085600    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:14:38.086941 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:38.086911    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc" event={"ID":"9b16932f-c7c5-4d9c-848b-5e5938af5d9c","Type":"ContainerStarted","Data":"46d58e27c4f4d792d36f740677e05a13afae209f5364980d0ffa85fc1920f080"}
Aug 01 01:14:38.102369 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:38.102311    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8" podStartSLOduration=1.102291696 podStartE2EDuration="1.102291696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:14:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:14:38.099070852 +0000 UTC m=+2746.796240122" watchObservedRunningTime="2026-08-01 01:14:38.102291696 +0000 UTC m=+2746.799460757"
Aug 01 01:14:39.103440 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:39.103400    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc" event={"ID":"9b16932f-c7c5-4d9c-848b-5e5938af5d9c","Type":"ContainerStarted","Data":"f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66"}
Aug 01 01:14:39.103895 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:39.103509    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:39.121533 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:39.121460    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc" podStartSLOduration=2.714404026 podStartE2EDuration="3.121442192s" totalImagesPullingTime="407.038166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:14:39.118615802 +0000 UTC m=+2747.815784864" watchObservedRunningTime="2026-08-01 01:14:39.121442192 +0000 UTC m=+2747.818611254"
Aug 01 01:14:45.116410 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:45.116377    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:14:49.106428 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:14:49.106398    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:15:00.132695 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.132654    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"]
Aug 01 01:15:00.137810 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.137786    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"]
Aug 01 01:15:00.137985 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.137919    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"
Aug 01 01:15:00.140985 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.140957    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68mnr\""
Aug 01 01:15:00.141536 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.141516    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5"]
Aug 01 01:15:00.141807 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.141635    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"
Aug 01 01:15:00.145853 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.145830    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"]
Aug 01 01:15:00.146195 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.145935    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5"
Aug 01 01:15:00.146848 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.146828    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"]
Aug 01 01:15:00.150298 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.150110    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5"]
Aug 01 01:15:00.153323 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.153303    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"
Aug 01 01:15:00.162905 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.162878    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"
Aug 01 01:15:00.194344 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.194317    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5"
Aug 01 01:15:00.337451 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.337362    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"]
Aug 01 01:15:00.339643 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:15:00.339607    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd125698_58dc_4f2b_a2d6_c96f4e3ac332.slice/crio-973bcc6e1ed256b59f92011ddb8f0fcde0b8ce9bd715cf6d6b2105d577b16393 WatchSource:0}: Error finding container 973bcc6e1ed256b59f92011ddb8f0fcde0b8ce9bd715cf6d6b2105d577b16393: Status 404 returned error can't find the container with id 973bcc6e1ed256b59f92011ddb8f0fcde0b8ce9bd715cf6d6b2105d577b16393
Aug 01 01:15:00.372223 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.372165    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"]
Aug 01 01:15:00.389756 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:15:00.389704    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc455db6b_01cb_4693_9516_58f6666798ae.slice/crio-ec519d3eade12e366e060dd6520940dca1651fcac3786d45c6664a97967f3595 WatchSource:0}: Error finding container ec519d3eade12e366e060dd6520940dca1651fcac3786d45c6664a97967f3595: Status 404 returned error can't find the container with id ec519d3eade12e366e060dd6520940dca1651fcac3786d45c6664a97967f3595
Aug 01 01:15:00.425658 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:00.425630    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5"]
Aug 01 01:15:00.429756 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:15:00.429725    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e671970_dbc6_4934_bd35_51f48aba2f69.slice/crio-e0cfe37daf591ce053b333078de87affad172f89788a007a74ba9cefc167065e WatchSource:0}: Error finding container e0cfe37daf591ce053b333078de87affad172f89788a007a74ba9cefc167065e: Status 404 returned error can't find the container with id e0cfe37daf591ce053b333078de87affad172f89788a007a74ba9cefc167065e
Aug 01 01:15:01.240355 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.240317    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm" event={"ID":"dd125698-58dc-4f2b-a2d6-c96f4e3ac332","Type":"ContainerStarted","Data":"1927088fcb82a4d964c21361245bc7572098ab2c89206c17747cf92f019ab02e"}
Aug 01 01:15:01.240876 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.240414    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm" event={"ID":"dd125698-58dc-4f2b-a2d6-c96f4e3ac332","Type":"ContainerStarted","Data":"973bcc6e1ed256b59f92011ddb8f0fcde0b8ce9bd715cf6d6b2105d577b16393"}
Aug 01 01:15:01.242031 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.242003    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd" event={"ID":"c455db6b-01cb-4693-9516-58f6666798ae","Type":"ContainerStarted","Data":"17c3a620aa7a243b88879f133c2495c690e368b1ea3fe5ed01cc3cfe646b3c8c"}
Aug 01 01:15:01.242131 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.242054    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd" event={"ID":"c455db6b-01cb-4693-9516-58f6666798ae","Type":"ContainerStarted","Data":"ec519d3eade12e366e060dd6520940dca1651fcac3786d45c6664a97967f3595"}
Aug 01 01:15:01.243550 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.243526    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5" event={"ID":"1e671970-dbc6-4934-bd35-51f48aba2f69","Type":"ContainerStarted","Data":"d2862f2580d0260946154d3d0190a7c1f9ec523e1f04362dbf65f3f1dab60da7"}
Aug 01 01:15:01.243663 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.243562    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5" event={"ID":"1e671970-dbc6-4934-bd35-51f48aba2f69","Type":"ContainerStarted","Data":"e0cfe37daf591ce053b333078de87affad172f89788a007a74ba9cefc167065e"}
Aug 01 01:15:01.255900 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.255849    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm" podStartSLOduration=1.255836024 podStartE2EDuration="1.255836024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:15:01.254981111 +0000 UTC m=+2769.952150173" watchObservedRunningTime="2026-08-01 01:15:01.255836024 +0000 UTC m=+2769.953005086"
Aug 01 01:15:01.272523 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.272457    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5" podStartSLOduration=1.27243287 podStartE2EDuration="1.27243287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:15:01.27032941 +0000 UTC m=+2769.967498472" watchObservedRunningTime="2026-08-01 01:15:01.27243287 +0000 UTC m=+2769.969601932"
Aug 01 01:15:01.285642 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:01.285591    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd" podStartSLOduration=1.285574262 podStartE2EDuration="1.285574262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:15:01.284039165 +0000 UTC m=+2769.981208229" watchObservedRunningTime="2026-08-01 01:15:01.285574262 +0000 UTC m=+2769.982743324"
Aug 01 01:15:02.251312 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:02.251272    2547 generic.go:356] "Generic (PLEG): container finished" podID="dd125698-58dc-4f2b-a2d6-c96f4e3ac332" containerID="1927088fcb82a4d964c21361245bc7572098ab2c89206c17747cf92f019ab02e" exitCode=0
Aug 01 01:15:02.251753 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:02.251361    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm" event={"ID":"dd125698-58dc-4f2b-a2d6-c96f4e3ac332","Type":"ContainerDied","Data":"1927088fcb82a4d964c21361245bc7572098ab2c89206c17747cf92f019ab02e"}
Aug 01 01:15:02.252905 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:02.252883    2547 generic.go:356] "Generic (PLEG): container finished" podID="c455db6b-01cb-4693-9516-58f6666798ae" containerID="17c3a620aa7a243b88879f133c2495c690e368b1ea3fe5ed01cc3cfe646b3c8c" exitCode=0
Aug 01 01:15:02.253029 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:02.252954    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd" event={"ID":"c455db6b-01cb-4693-9516-58f6666798ae","Type":"ContainerDied","Data":"17c3a620aa7a243b88879f133c2495c690e368b1ea3fe5ed01cc3cfe646b3c8c"}
Aug 01 01:15:02.254378 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:02.254357    2547 generic.go:356] "Generic (PLEG): container finished" podID="1e671970-dbc6-4934-bd35-51f48aba2f69" containerID="d2862f2580d0260946154d3d0190a7c1f9ec523e1f04362dbf65f3f1dab60da7" exitCode=0
Aug 01 01:15:02.254473 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:02.254420    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5" event={"ID":"1e671970-dbc6-4934-bd35-51f48aba2f69","Type":"ContainerDied","Data":"d2862f2580d0260946154d3d0190a7c1f9ec523e1f04362dbf65f3f1dab60da7"}
Aug 01 01:15:03.437925 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:03.437898    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"
Aug 01 01:15:03.440774 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:03.440745    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"
Aug 01 01:15:03.477597 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:03.477568    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5"
Aug 01 01:15:04.268489 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.268448    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"
Aug 01 01:15:04.268489 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.268467    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd" event={"ID":"c455db6b-01cb-4693-9516-58f6666798ae","Type":"ContainerDied","Data":"ec519d3eade12e366e060dd6520940dca1651fcac3786d45c6664a97967f3595"}
Aug 01 01:15:04.268762 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.268534    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec519d3eade12e366e060dd6520940dca1651fcac3786d45c6664a97967f3595"
Aug 01 01:15:04.269936 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.269912    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5" event={"ID":"1e671970-dbc6-4934-bd35-51f48aba2f69","Type":"ContainerDied","Data":"e0cfe37daf591ce053b333078de87affad172f89788a007a74ba9cefc167065e"}
Aug 01 01:15:04.269936 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.269931    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29759115-5fcc5"
Aug 01 01:15:04.270108 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.269957    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0cfe37daf591ce053b333078de87affad172f89788a007a74ba9cefc167065e"
Aug 01 01:15:04.271453 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.271432    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"
Aug 01 01:15:04.271453 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.271437    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm" event={"ID":"dd125698-58dc-4f2b-a2d6-c96f4e3ac332","Type":"ContainerDied","Data":"973bcc6e1ed256b59f92011ddb8f0fcde0b8ce9bd715cf6d6b2105d577b16393"}
Aug 01 01:15:04.271613 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:15:04.271468    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="973bcc6e1ed256b59f92011ddb8f0fcde0b8ce9bd715cf6d6b2105d577b16393"
Aug 01 01:17:52.299608 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:17:52.299573    2547 scope.go:117] "RemoveContainer" containerID="491e484254259e83d226feae9a9b1d191f59728b6a0020e032f967dab38da2d7"
Aug 01 01:18:52.067024 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:18:52.066993    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:18:52.073764 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:18:52.073742    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:18:52.320071 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:18:52.319982    2547 scope.go:117] "RemoveContainer" containerID="278b346d2fd227d6426efd0bbe2caaf1e42a70a551753f7320b16d51d8db108e"
Aug 01 01:19:52.341192 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:19:52.341157    2547 scope.go:117] "RemoveContainer" containerID="5d2dc908216575069f79b8fdb456218ad9a06eeda0a65bd9d416a19026c31d53"
Aug 01 01:19:52.350470 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:19:52.350443    2547 scope.go:117] "RemoveContainer" containerID="d65a63aabf669635e7b9caa4ee449aa3d51da7bbcf3541735e68001695e23615"
Aug 01 01:22:19.736517 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.736473    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7505-139668798874928"]
Aug 01 01:22:19.736948 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.736908    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c455db6b-01cb-4693-9516-58f6666798ae" containerName="cleanup"
Aug 01 01:22:19.736948 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.736918    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c455db6b-01cb-4693-9516-58f6666798ae" containerName="cleanup"
Aug 01 01:22:19.736948 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.736935    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e671970-dbc6-4934-bd35-51f48aba2f69" containerName="cleanup"
Aug 01 01:22:19.736948 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.736940    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e671970-dbc6-4934-bd35-51f48aba2f69" containerName="cleanup"
Aug 01 01:22:19.736948 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.736946    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd125698-58dc-4f2b-a2d6-c96f4e3ac332" containerName="cleanup"
Aug 01 01:22:19.736948 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.736951    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd125698-58dc-4f2b-a2d6-c96f4e3ac332" containerName="cleanup"
Aug 01 01:22:19.737177 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.737008    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd125698-58dc-4f2b-a2d6-c96f4e3ac332" containerName="cleanup"
Aug 01 01:22:19.737177 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.737017    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e671970-dbc6-4934-bd35-51f48aba2f69" containerName="cleanup"
Aug 01 01:22:19.737177 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.737026    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c455db6b-01cb-4693-9516-58f6666798ae" containerName="cleanup"
Aug 01 01:22:19.740115 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.740099    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798874928"
Aug 01 01:22:19.742405 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.742377    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9mcmd\""
Aug 01 01:22:19.745301 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.745270    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798874928"]
Aug 01 01:22:19.834728 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.834698    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxv9c\" (UniqueName: \"kubernetes.io/projected/18f8bfb2-b369-4a16-a546-2abe16cd7575-kube-api-access-gxv9c\") pod \"test-curl-7505-139668798874928\" (UID: \"18f8bfb2-b369-4a16-a546-2abe16cd7575\") " pod="opendatahub/test-curl-7505-139668798874928"
Aug 01 01:22:19.935738 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.935710    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxv9c\" (UniqueName: \"kubernetes.io/projected/18f8bfb2-b369-4a16-a546-2abe16cd7575-kube-api-access-gxv9c\") pod \"test-curl-7505-139668798874928\" (UID: \"18f8bfb2-b369-4a16-a546-2abe16cd7575\") " pod="opendatahub/test-curl-7505-139668798874928"
Aug 01 01:22:19.943407 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:19.943384    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxv9c\" (UniqueName: \"kubernetes.io/projected/18f8bfb2-b369-4a16-a546-2abe16cd7575-kube-api-access-gxv9c\") pod \"test-curl-7505-139668798874928\" (UID: \"18f8bfb2-b369-4a16-a546-2abe16cd7575\") " pod="opendatahub/test-curl-7505-139668798874928"
Aug 01 01:22:20.050642 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:20.050564    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798874928"
Aug 01 01:22:20.189606 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:20.189581    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798874928"]
Aug 01 01:22:20.191255 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:20.191232    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18f8bfb2_b369_4a16_a546_2abe16cd7575.slice/crio-f3fcc3c9b1567612f3b5200caa47b21b10aeec76db272b2afd577a672f33ca2f WatchSource:0}: Error finding container f3fcc3c9b1567612f3b5200caa47b21b10aeec76db272b2afd577a672f33ca2f: Status 404 returned error can't find the container with id f3fcc3c9b1567612f3b5200caa47b21b10aeec76db272b2afd577a672f33ca2f
Aug 01 01:22:20.192911 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:20.192889    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 01 01:22:20.793350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:20.793314    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798874928" event={"ID":"18f8bfb2-b369-4a16-a546-2abe16cd7575","Type":"ContainerStarted","Data":"f3fcc3c9b1567612f3b5200caa47b21b10aeec76db272b2afd577a672f33ca2f"}
Aug 01 01:22:21.799955 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:21.799912    2547 generic.go:356] "Generic (PLEG): container finished" podID="18f8bfb2-b369-4a16-a546-2abe16cd7575" containerID="eab1fe9700b61c42f98e8c50fdae39220a9f6bf339c69c01e834e999379d2533" exitCode=0
Aug 01 01:22:21.800370 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:21.799999    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798874928" event={"ID":"18f8bfb2-b369-4a16-a546-2abe16cd7575","Type":"ContainerDied","Data":"eab1fe9700b61c42f98e8c50fdae39220a9f6bf339c69c01e834e999379d2533"}
Aug 01 01:22:22.946300 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:22.946274    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798874928"
Aug 01 01:22:22.978507 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:22.978465    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7505-139668798874928_18f8bfb2-b369-4a16-a546-2abe16cd7575/test-curl-7505-139668798874928/0.log"
Aug 01 01:22:23.000459 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.000433    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7505-139668798874928"]
Aug 01 01:22:23.005638 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.005618    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7505-139668798874928"]
Aug 01 01:22:23.064489 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.064415    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxv9c\" (UniqueName: \"kubernetes.io/projected/18f8bfb2-b369-4a16-a546-2abe16cd7575-kube-api-access-gxv9c\") pod \"18f8bfb2-b369-4a16-a546-2abe16cd7575\" (UID: \"18f8bfb2-b369-4a16-a546-2abe16cd7575\") "
Aug 01 01:22:23.066472 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.066450    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f8bfb2-b369-4a16-a546-2abe16cd7575-kube-api-access-gxv9c" (OuterVolumeSpecName: "kube-api-access-gxv9c") pod "18f8bfb2-b369-4a16-a546-2abe16cd7575" (UID: "18f8bfb2-b369-4a16-a546-2abe16cd7575"). InnerVolumeSpecName "kube-api-access-gxv9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:22:23.122615 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.122583    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7505-139668798873776"]
Aug 01 01:22:23.123064 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.123045    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f8bfb2-b369-4a16-a546-2abe16cd7575" containerName="test-curl-7505-139668798874928"
Aug 01 01:22:23.123140 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.123067    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f8bfb2-b369-4a16-a546-2abe16cd7575" containerName="test-curl-7505-139668798874928"
Aug 01 01:22:23.123213 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.123200    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="18f8bfb2-b369-4a16-a546-2abe16cd7575" containerName="test-curl-7505-139668798874928"
Aug 01 01:22:23.126267 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.126249    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:23.130673 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.130655    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798873776"]
Aug 01 01:22:23.166045 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.166011    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxv9c\" (UniqueName: \"kubernetes.io/projected/18f8bfb2-b369-4a16-a546-2abe16cd7575-kube-api-access-gxv9c\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:22:23.267320 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.267287    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxnq\" (UniqueName: \"kubernetes.io/projected/e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf-kube-api-access-mtxnq\") pod \"test-curl-7505-139668798873776\" (UID: \"e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf\") " pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:23.368255 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.368195    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxnq\" (UniqueName: \"kubernetes.io/projected/e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf-kube-api-access-mtxnq\") pod \"test-curl-7505-139668798873776\" (UID: \"e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf\") " pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:23.375685 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.375665    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxnq\" (UniqueName: \"kubernetes.io/projected/e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf-kube-api-access-mtxnq\") pod \"test-curl-7505-139668798873776\" (UID: \"e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf\") " pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:23.436702 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.436678    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:23.568304 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.568277    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798873776"]
Aug 01 01:22:23.570117 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:23.570087    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode14bd7ad_31a4_4efb_be6e_68f0fc64cbdf.slice/crio-4fcbc392038c317818354009b7952a7e8cfc5caea9237dc7e41e77c293708e66 WatchSource:0}: Error finding container 4fcbc392038c317818354009b7952a7e8cfc5caea9237dc7e41e77c293708e66: Status 404 returned error can't find the container with id 4fcbc392038c317818354009b7952a7e8cfc5caea9237dc7e41e77c293708e66
Aug 01 01:22:23.811399 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.811376    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798874928"
Aug 01 01:22:23.811576 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.811409    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3fcc3c9b1567612f3b5200caa47b21b10aeec76db272b2afd577a672f33ca2f"
Aug 01 01:22:23.812444 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.812422    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798873776" event={"ID":"e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf","Type":"ContainerStarted","Data":"4fcbc392038c317818354009b7952a7e8cfc5caea9237dc7e41e77c293708e66"}
Aug 01 01:22:23.821457 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:22:23.821432    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7505-139668798874928\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="18f8bfb2-b369-4a16-a546-2abe16cd7575" pod="opendatahub/test-curl-7505-139668798874928"
Aug 01 01:22:23.881200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:23.881179    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f8bfb2-b369-4a16-a546-2abe16cd7575" path="/var/lib/kubelet/pods/18f8bfb2-b369-4a16-a546-2abe16cd7575/volumes"
Aug 01 01:22:24.819644 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:24.819609    2547 generic.go:356] "Generic (PLEG): container finished" podID="e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf" containerID="654806a2975409ca75e7414a8f2e9586f380ed2bb64d71aca88ab3a057adf764" exitCode=0
Aug 01 01:22:24.820027 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:24.819698    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798873776" event={"ID":"e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf","Type":"ContainerDied","Data":"654806a2975409ca75e7414a8f2e9586f380ed2bb64d71aca88ab3a057adf764"}
Aug 01 01:22:25.967787 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:25.967760    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:25.987088 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:25.987060    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7505-139668798873776_e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf/test-curl-7505-139668798873776/0.log"
Aug 01 01:22:26.009393 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.009366    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7505-139668798873776"]
Aug 01 01:22:26.012905 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.012879    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7505-139668798873776"]
Aug 01 01:22:26.094673 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.094605    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtxnq\" (UniqueName: \"kubernetes.io/projected/e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf-kube-api-access-mtxnq\") pod \"e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf\" (UID: \"e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf\") "
Aug 01 01:22:26.096613 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.096592    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf-kube-api-access-mtxnq" (OuterVolumeSpecName: "kube-api-access-mtxnq") pod "e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf" (UID: "e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf"). InnerVolumeSpecName "kube-api-access-mtxnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:22:26.177590 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.177566    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:26.178028 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.178015    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf" containerName="test-curl-7505-139668798873776"
Aug 01 01:22:26.178068 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.178030    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf" containerName="test-curl-7505-139668798873776"
Aug 01 01:22:26.178110 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.178104    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf" containerName="test-curl-7505-139668798873776"
Aug 01 01:22:26.181182 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.181168    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:26.187534 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.187506    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:26.195630 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.195606    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtxnq\" (UniqueName: \"kubernetes.io/projected/e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf-kube-api-access-mtxnq\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:22:26.296580 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.296550    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhtb7\" (UniqueName: \"kubernetes.io/projected/326cae70-4023-4e02-bc3e-09885961f3c1-kube-api-access-xhtb7\") pod \"test-curl-7505-139668798786848\" (UID: \"326cae70-4023-4e02-bc3e-09885961f3c1\") " pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:26.397270 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.397213    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhtb7\" (UniqueName: \"kubernetes.io/projected/326cae70-4023-4e02-bc3e-09885961f3c1-kube-api-access-xhtb7\") pod \"test-curl-7505-139668798786848\" (UID: \"326cae70-4023-4e02-bc3e-09885961f3c1\") " pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:26.404780 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.404755    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhtb7\" (UniqueName: \"kubernetes.io/projected/326cae70-4023-4e02-bc3e-09885961f3c1-kube-api-access-xhtb7\") pod \"test-curl-7505-139668798786848\" (UID: \"326cae70-4023-4e02-bc3e-09885961f3c1\") " pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:26.492627 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.492606    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:26.626781 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.626756    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:26.628550 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:26.628525    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod326cae70_4023_4e02_bc3e_09885961f3c1.slice/crio-e0f3ab0a3cd9273797fa110b6a83d5cdd158ddeb09f6eaf76123d6092bf0600a WatchSource:0}: Error finding container e0f3ab0a3cd9273797fa110b6a83d5cdd158ddeb09f6eaf76123d6092bf0600a: Status 404 returned error can't find the container with id e0f3ab0a3cd9273797fa110b6a83d5cdd158ddeb09f6eaf76123d6092bf0600a
Aug 01 01:22:26.831403 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.831373    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:26.831604 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.831377    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fcbc392038c317818354009b7952a7e8cfc5caea9237dc7e41e77c293708e66"
Aug 01 01:22:26.832701 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:26.832654    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798786848" event={"ID":"326cae70-4023-4e02-bc3e-09885961f3c1","Type":"ContainerStarted","Data":"e0f3ab0a3cd9273797fa110b6a83d5cdd158ddeb09f6eaf76123d6092bf0600a"}
Aug 01 01:22:26.841908 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:22:26.841882    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7505-139668798873776\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf" pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:27.840669 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:27.840630    2547 generic.go:356] "Generic (PLEG): container finished" podID="326cae70-4023-4e02-bc3e-09885961f3c1" containerID="72a8e7f2d1010eee0b223040b703a3184a5b160bea138ad110cb3a59485ff0d5" exitCode=0
Aug 01 01:22:27.841073 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:27.840715    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798786848" event={"ID":"326cae70-4023-4e02-bc3e-09885961f3c1","Type":"ContainerDied","Data":"72a8e7f2d1010eee0b223040b703a3184a5b160bea138ad110cb3a59485ff0d5"}
Aug 01 01:22:27.842403 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:22:27.842378    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7505-139668798873776\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf" pod="opendatahub/test-curl-7505-139668798873776"
Aug 01 01:22:27.880549 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:27.880523    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf" path="/var/lib/kubelet/pods/e14bd7ad-31a4-4efb-be6e-68f0fc64cbdf/volumes"
Aug 01 01:22:28.994070 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:28.994049    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:29.012308 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.012283    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7505-139668798786848_326cae70-4023-4e02-bc3e-09885961f3c1/test-curl-7505-139668798786848/0.log"
Aug 01 01:22:29.033031 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.033003    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:29.036146 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.036125    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:29.123988 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.123929    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhtb7\" (UniqueName: \"kubernetes.io/projected/326cae70-4023-4e02-bc3e-09885961f3c1-kube-api-access-xhtb7\") pod \"326cae70-4023-4e02-bc3e-09885961f3c1\" (UID: \"326cae70-4023-4e02-bc3e-09885961f3c1\") "
Aug 01 01:22:29.125959 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.125939    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326cae70-4023-4e02-bc3e-09885961f3c1-kube-api-access-xhtb7" (OuterVolumeSpecName: "kube-api-access-xhtb7") pod "326cae70-4023-4e02-bc3e-09885961f3c1" (UID: "326cae70-4023-4e02-bc3e-09885961f3c1"). InnerVolumeSpecName "kube-api-access-xhtb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:22:29.147476 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.147451    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:29.147930 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.147917    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="326cae70-4023-4e02-bc3e-09885961f3c1" containerName="test-curl-7505-139668798786848"
Aug 01 01:22:29.147979 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.147932    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="326cae70-4023-4e02-bc3e-09885961f3c1" containerName="test-curl-7505-139668798786848"
Aug 01 01:22:29.148020 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.147997    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="326cae70-4023-4e02-bc3e-09885961f3c1" containerName="test-curl-7505-139668798786848"
Aug 01 01:22:29.151101 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.151080    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:29.154056 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.154033    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:29.225101 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.225080    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhtb7\" (UniqueName: \"kubernetes.io/projected/326cae70-4023-4e02-bc3e-09885961f3c1-kube-api-access-xhtb7\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:22:29.326403 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.326372    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wvlp\" (UniqueName: \"kubernetes.io/projected/c458ee66-4f28-47e2-838a-cf7025f798d5-kube-api-access-4wvlp\") pod \"test-curl-7505-139668798786848\" (UID: \"c458ee66-4f28-47e2-838a-cf7025f798d5\") " pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:29.427454 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.427399    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wvlp\" (UniqueName: \"kubernetes.io/projected/c458ee66-4f28-47e2-838a-cf7025f798d5-kube-api-access-4wvlp\") pod \"test-curl-7505-139668798786848\" (UID: \"c458ee66-4f28-47e2-838a-cf7025f798d5\") " pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:29.435796 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.435778    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wvlp\" (UniqueName: \"kubernetes.io/projected/c458ee66-4f28-47e2-838a-cf7025f798d5-kube-api-access-4wvlp\") pod \"test-curl-7505-139668798786848\" (UID: \"c458ee66-4f28-47e2-838a-cf7025f798d5\") " pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:29.462649 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.462630    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:29.592091 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.592062    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:29.593770 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:29.593741    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc458ee66_4f28_47e2_838a_cf7025f798d5.slice/crio-f22f5069f29c15cd26258de41ba0a3ae7b576fc498d70bab97095c62254f1281 WatchSource:0}: Error finding container f22f5069f29c15cd26258de41ba0a3ae7b576fc498d70bab97095c62254f1281: Status 404 returned error can't find the container with id f22f5069f29c15cd26258de41ba0a3ae7b576fc498d70bab97095c62254f1281
Aug 01 01:22:29.852731 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.852696    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798786848" event={"ID":"c458ee66-4f28-47e2-838a-cf7025f798d5","Type":"ContainerStarted","Data":"f22f5069f29c15cd26258de41ba0a3ae7b576fc498d70bab97095c62254f1281"}
Aug 01 01:22:29.853887 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.853869    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0f3ab0a3cd9273797fa110b6a83d5cdd158ddeb09f6eaf76123d6092bf0600a"
Aug 01 01:22:29.854010 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.853895    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:29.865940 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.865909    2547 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7505-139668798786848" oldPodUID="326cae70-4023-4e02-bc3e-09885961f3c1" podUID="c458ee66-4f28-47e2-838a-cf7025f798d5"
Aug 01 01:22:29.884603 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:29.882330    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="326cae70-4023-4e02-bc3e-09885961f3c1" path="/var/lib/kubelet/pods/326cae70-4023-4e02-bc3e-09885961f3c1/volumes"
Aug 01 01:22:30.863370 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:30.863336    2547 generic.go:356] "Generic (PLEG): container finished" podID="c458ee66-4f28-47e2-838a-cf7025f798d5" containerID="18b5ab92621955fe122c9c2de4d3366a4a071a0697f7be76ca780c5bdc938d02" exitCode=0
Aug 01 01:22:30.863757 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:30.863421    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798786848" event={"ID":"c458ee66-4f28-47e2-838a-cf7025f798d5","Type":"ContainerDied","Data":"18b5ab92621955fe122c9c2de4d3366a4a071a0697f7be76ca780c5bdc938d02"}
Aug 01 01:22:32.008256 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.008235    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:32.026121 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.026093    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7505-139668798786848_c458ee66-4f28-47e2-838a-cf7025f798d5/test-curl-7505-139668798786848/0.log"
Aug 01 01:22:32.047349 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.047321    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:32.052363 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.052341    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7505-139668798786848"]
Aug 01 01:22:32.151614 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.151553    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wvlp\" (UniqueName: \"kubernetes.io/projected/c458ee66-4f28-47e2-838a-cf7025f798d5-kube-api-access-4wvlp\") pod \"c458ee66-4f28-47e2-838a-cf7025f798d5\" (UID: \"c458ee66-4f28-47e2-838a-cf7025f798d5\") "
Aug 01 01:22:32.153562 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.153539    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c458ee66-4f28-47e2-838a-cf7025f798d5-kube-api-access-4wvlp" (OuterVolumeSpecName: "kube-api-access-4wvlp") pod "c458ee66-4f28-47e2-838a-cf7025f798d5" (UID: "c458ee66-4f28-47e2-838a-cf7025f798d5"). InnerVolumeSpecName "kube-api-access-4wvlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:22:32.170792 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.170768    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:32.171241 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.171223    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c458ee66-4f28-47e2-838a-cf7025f798d5" containerName="test-curl-7505-139668798786848"
Aug 01 01:22:32.171325 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.171244    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c458ee66-4f28-47e2-838a-cf7025f798d5" containerName="test-curl-7505-139668798786848"
Aug 01 01:22:32.171405 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.171391    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c458ee66-4f28-47e2-838a-cf7025f798d5" containerName="test-curl-7505-139668798786848"
Aug 01 01:22:32.174362 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.174345    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:32.177949 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.177925    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:32.252578 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.252550    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wvlp\" (UniqueName: \"kubernetes.io/projected/c458ee66-4f28-47e2-838a-cf7025f798d5-kube-api-access-4wvlp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:22:32.353819 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.353793    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdhtg\" (UniqueName: \"kubernetes.io/projected/798e19bf-bdc3-47c0-b301-8e8040fb525d-kube-api-access-gdhtg\") pod \"test-curl-7505-139668798710096\" (UID: \"798e19bf-bdc3-47c0-b301-8e8040fb525d\") " pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:32.455298 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.455222    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdhtg\" (UniqueName: \"kubernetes.io/projected/798e19bf-bdc3-47c0-b301-8e8040fb525d-kube-api-access-gdhtg\") pod \"test-curl-7505-139668798710096\" (UID: \"798e19bf-bdc3-47c0-b301-8e8040fb525d\") " pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:32.462623 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.462600    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdhtg\" (UniqueName: \"kubernetes.io/projected/798e19bf-bdc3-47c0-b301-8e8040fb525d-kube-api-access-gdhtg\") pod \"test-curl-7505-139668798710096\" (UID: \"798e19bf-bdc3-47c0-b301-8e8040fb525d\") " pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:32.485596 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.485576    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:32.621864 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.621837    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:32.623826 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:32.623797    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod798e19bf_bdc3_47c0_b301_8e8040fb525d.slice/crio-1574fb0d45c52e18a056678e2297f0da727855519e469a2f826d031e37c708c9 WatchSource:0}: Error finding container 1574fb0d45c52e18a056678e2297f0da727855519e469a2f826d031e37c708c9: Status 404 returned error can't find the container with id 1574fb0d45c52e18a056678e2297f0da727855519e469a2f826d031e37c708c9
Aug 01 01:22:32.877179 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.877153    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:32.877179 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.877177    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f22f5069f29c15cd26258de41ba0a3ae7b576fc498d70bab97095c62254f1281"
Aug 01 01:22:32.878375 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:32.878351    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798710096" event={"ID":"798e19bf-bdc3-47c0-b301-8e8040fb525d","Type":"ContainerStarted","Data":"1574fb0d45c52e18a056678e2297f0da727855519e469a2f826d031e37c708c9"}
Aug 01 01:22:32.888436 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:22:32.888414    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7505-139668798786848\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="c458ee66-4f28-47e2-838a-cf7025f798d5" pod="opendatahub/test-curl-7505-139668798786848"
Aug 01 01:22:33.886635 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:33.884387    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c458ee66-4f28-47e2-838a-cf7025f798d5" path="/var/lib/kubelet/pods/c458ee66-4f28-47e2-838a-cf7025f798d5/volumes"
Aug 01 01:22:33.893744 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:33.893713    2547 generic.go:356] "Generic (PLEG): container finished" podID="798e19bf-bdc3-47c0-b301-8e8040fb525d" containerID="554c274d3ddbadfb29c81a97c5092c1632e9d8834ad72317c58bdb667caab619" exitCode=0
Aug 01 01:22:33.893875 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:33.893793    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798710096" event={"ID":"798e19bf-bdc3-47c0-b301-8e8040fb525d","Type":"ContainerDied","Data":"554c274d3ddbadfb29c81a97c5092c1632e9d8834ad72317c58bdb667caab619"}
Aug 01 01:22:35.063950 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.063922    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:35.079696 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.079669    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdhtg\" (UniqueName: \"kubernetes.io/projected/798e19bf-bdc3-47c0-b301-8e8040fb525d-kube-api-access-gdhtg\") pod \"798e19bf-bdc3-47c0-b301-8e8040fb525d\" (UID: \"798e19bf-bdc3-47c0-b301-8e8040fb525d\") "
Aug 01 01:22:35.081785 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.081722    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7505-139668798710096_798e19bf-bdc3-47c0-b301-8e8040fb525d/test-curl-7505-139668798710096/0.log"
Aug 01 01:22:35.082030 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.081988    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/798e19bf-bdc3-47c0-b301-8e8040fb525d-kube-api-access-gdhtg" (OuterVolumeSpecName: "kube-api-access-gdhtg") pod "798e19bf-bdc3-47c0-b301-8e8040fb525d" (UID: "798e19bf-bdc3-47c0-b301-8e8040fb525d"). InnerVolumeSpecName "kube-api-access-gdhtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:22:35.103073 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.103051    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:35.106443 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.106421    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:35.180936 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.180875    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdhtg\" (UniqueName: \"kubernetes.io/projected/798e19bf-bdc3-47c0-b301-8e8040fb525d-kube-api-access-gdhtg\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:22:35.222341 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.222310    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:35.222908 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.222887    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="798e19bf-bdc3-47c0-b301-8e8040fb525d" containerName="test-curl-7505-139668798710096"
Aug 01 01:22:35.222908 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.222909    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="798e19bf-bdc3-47c0-b301-8e8040fb525d" containerName="test-curl-7505-139668798710096"
Aug 01 01:22:35.223079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.223062    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="798e19bf-bdc3-47c0-b301-8e8040fb525d" containerName="test-curl-7505-139668798710096"
Aug 01 01:22:35.226212 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.226194    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:35.231561 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.231539    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:35.281840 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.281811    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwpj\" (UniqueName: \"kubernetes.io/projected/a056ce2a-6b27-46b1-b10e-8221a811ddb8-kube-api-access-hfwpj\") pod \"test-curl-7505-139668798710096\" (UID: \"a056ce2a-6b27-46b1-b10e-8221a811ddb8\") " pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:35.382854 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.382825    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwpj\" (UniqueName: \"kubernetes.io/projected/a056ce2a-6b27-46b1-b10e-8221a811ddb8-kube-api-access-hfwpj\") pod \"test-curl-7505-139668798710096\" (UID: \"a056ce2a-6b27-46b1-b10e-8221a811ddb8\") " pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:35.390702 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.390672    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwpj\" (UniqueName: \"kubernetes.io/projected/a056ce2a-6b27-46b1-b10e-8221a811ddb8-kube-api-access-hfwpj\") pod \"test-curl-7505-139668798710096\" (UID: \"a056ce2a-6b27-46b1-b10e-8221a811ddb8\") " pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:35.537001 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.536975    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:35.876828 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:35.876800    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda056ce2a_6b27_46b1_b10e_8221a811ddb8.slice/crio-63741a784d91ad63f410c47b04a3b720bc59785df44b0f5222325c90f1d48d28 WatchSource:0}: Error finding container 63741a784d91ad63f410c47b04a3b720bc59785df44b0f5222325c90f1d48d28: Status 404 returned error can't find the container with id 63741a784d91ad63f410c47b04a3b720bc59785df44b0f5222325c90f1d48d28
Aug 01 01:22:35.881289 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.881263    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="798e19bf-bdc3-47c0-b301-8e8040fb525d" path="/var/lib/kubelet/pods/798e19bf-bdc3-47c0-b301-8e8040fb525d/volumes"
Aug 01 01:22:35.881689 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.881675    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:35.906424 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.906400    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798710096" event={"ID":"a056ce2a-6b27-46b1-b10e-8221a811ddb8","Type":"ContainerStarted","Data":"63741a784d91ad63f410c47b04a3b720bc59785df44b0f5222325c90f1d48d28"}
Aug 01 01:22:35.907605 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.907589    2547 scope.go:117] "RemoveContainer" containerID="554c274d3ddbadfb29c81a97c5092c1632e9d8834ad72317c58bdb667caab619"
Aug 01 01:22:35.907679 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:35.907603    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:36.915063 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:36.915030    2547 generic.go:356] "Generic (PLEG): container finished" podID="a056ce2a-6b27-46b1-b10e-8221a811ddb8" containerID="c4749fdb7652639df2a457eb8bd6d7cc2c1f7ad36e7dc2f5fd4e70f6aa6af9f8" exitCode=0
Aug 01 01:22:36.915533 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:36.915104    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7505-139668798710096" event={"ID":"a056ce2a-6b27-46b1-b10e-8221a811ddb8","Type":"ContainerDied","Data":"c4749fdb7652639df2a457eb8bd6d7cc2c1f7ad36e7dc2f5fd4e70f6aa6af9f8"}
Aug 01 01:22:38.067763 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.067737    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:38.085432 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.085407    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7505-139668798710096_a056ce2a-6b27-46b1-b10e-8221a811ddb8/test-curl-7505-139668798710096/0.log"
Aug 01 01:22:38.104183 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.104156    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfwpj\" (UniqueName: \"kubernetes.io/projected/a056ce2a-6b27-46b1-b10e-8221a811ddb8-kube-api-access-hfwpj\") pod \"a056ce2a-6b27-46b1-b10e-8221a811ddb8\" (UID: \"a056ce2a-6b27-46b1-b10e-8221a811ddb8\") "
Aug 01 01:22:38.106199 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.106176    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:38.106349 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.106329    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a056ce2a-6b27-46b1-b10e-8221a811ddb8-kube-api-access-hfwpj" (OuterVolumeSpecName: "kube-api-access-hfwpj") pod "a056ce2a-6b27-46b1-b10e-8221a811ddb8" (UID: "a056ce2a-6b27-46b1-b10e-8221a811ddb8"). InnerVolumeSpecName "kube-api-access-hfwpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:22:38.111534 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.111511    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7505-139668798710096"]
Aug 01 01:22:38.205200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.205123    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfwpj\" (UniqueName: \"kubernetes.io/projected/a056ce2a-6b27-46b1-b10e-8221a811ddb8-kube-api-access-hfwpj\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:22:38.927288 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.927255    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:38.927445 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:38.927298    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63741a784d91ad63f410c47b04a3b720bc59785df44b0f5222325c90f1d48d28"
Aug 01 01:22:38.938362 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:22:38.938088    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7505-139668798710096\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="a056ce2a-6b27-46b1-b10e-8221a811ddb8" pod="opendatahub/test-curl-7505-139668798710096"
Aug 01 01:22:39.880641 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:39.880605    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a056ce2a-6b27-46b1-b10e-8221a811ddb8" path="/var/lib/kubelet/pods/a056ce2a-6b27-46b1-b10e-8221a811ddb8/volumes"
Aug 01 01:22:43.683151 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.683121    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"]
Aug 01 01:22:43.683675 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.683653    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a056ce2a-6b27-46b1-b10e-8221a811ddb8" containerName="test-curl-7505-139668798710096"
Aug 01 01:22:43.683675 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.683676    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a056ce2a-6b27-46b1-b10e-8221a811ddb8" containerName="test-curl-7505-139668798710096"
Aug 01 01:22:43.683777 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.683763    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a056ce2a-6b27-46b1-b10e-8221a811ddb8" containerName="test-curl-7505-139668798710096"
Aug 01 01:22:43.687122 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.687104    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:43.689522 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.689500    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-2db7f1-serving-cert\""
Aug 01 01:22:43.695814 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.695791    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"]
Aug 01 01:22:43.757803 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.757775    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npkqv\" (UniqueName: \"kubernetes.io/projected/51bb3339-cd3d-44eb-af6f-864f04c98327-kube-api-access-npkqv\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:43.757925 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.757842    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:43.757925 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.757900    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51bb3339-cd3d-44eb-af6f-864f04c98327-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:43.858615 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.858584    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npkqv\" (UniqueName: \"kubernetes.io/projected/51bb3339-cd3d-44eb-af6f-864f04c98327-kube-api-access-npkqv\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:43.858767 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.858644    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:43.858767 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.858679    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51bb3339-cd3d-44eb-af6f-864f04c98327-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:43.858883 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:22:43.858812    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-serving-cert: secret "maas-api-e2e-ipp-a-2db7f1-serving-cert" not found
Aug 01 01:22:43.858938 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:22:43.858893    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls podName:51bb3339-cd3d-44eb-af6f-864f04c98327 nodeName:}" failed. No retries permitted until 2026-08-01 01:22:44.358869973 +0000 UTC m=+3233.056039015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls") pod "maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm" (UID: "51bb3339-cd3d-44eb-af6f-864f04c98327") : secret "maas-api-e2e-ipp-a-2db7f1-serving-cert" not found
Aug 01 01:22:43.859247 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.859229    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51bb3339-cd3d-44eb-af6f-864f04c98327-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:43.868825 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:43.868799    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npkqv\" (UniqueName: \"kubernetes.io/projected/51bb3339-cd3d-44eb-af6f-864f04c98327-kube-api-access-npkqv\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:44.286454 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.286418    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"]
Aug 01 01:22:44.290273 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.290257    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:44.292644 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.292622    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-2db7f1\""
Aug 01 01:22:44.295538 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.295513    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"]
Aug 01 01:22:44.310523 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.310471    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"]
Aug 01 01:22:44.310771 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.310726    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:44.313758 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.313720    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"]
Aug 01 01:22:44.314831 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.314809    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-2db7f1-dockercfg-vfq7z\""
Aug 01 01:22:44.362934 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.362907    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvffd\" (UniqueName: \"kubernetes.io/projected/5f0205ed-999d-4481-a910-abcc3d24d398-kube-api-access-mvffd\") pod \"payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr\" (UID: \"5f0205ed-999d-4481-a910-abcc3d24d398\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:44.363044 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.362953    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:44.363044 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.362978    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff60273-fda4-4d89-8b33-9d3408866272-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75\" (UID: \"6ff60273-fda4-4d89-8b33-9d3408866272\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:44.363121 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.363100    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgt7z\" (UniqueName: \"kubernetes.io/projected/6ff60273-fda4-4d89-8b33-9d3408866272-kube-api-access-qgt7z\") pod \"payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75\" (UID: \"6ff60273-fda4-4d89-8b33-9d3408866272\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:44.363153 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.363137    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f0205ed-999d-4481-a910-abcc3d24d398-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr\" (UID: \"5f0205ed-999d-4481-a910-abcc3d24d398\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:44.365263 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.365247    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:44.463630 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.463594    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvffd\" (UniqueName: \"kubernetes.io/projected/5f0205ed-999d-4481-a910-abcc3d24d398-kube-api-access-mvffd\") pod \"payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr\" (UID: \"5f0205ed-999d-4481-a910-abcc3d24d398\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:44.463791 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.463651    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff60273-fda4-4d89-8b33-9d3408866272-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75\" (UID: \"6ff60273-fda4-4d89-8b33-9d3408866272\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:44.463791 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.463682    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgt7z\" (UniqueName: \"kubernetes.io/projected/6ff60273-fda4-4d89-8b33-9d3408866272-kube-api-access-qgt7z\") pod \"payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75\" (UID: \"6ff60273-fda4-4d89-8b33-9d3408866272\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:44.463791 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.463715    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f0205ed-999d-4481-a910-abcc3d24d398-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr\" (UID: \"5f0205ed-999d-4481-a910-abcc3d24d398\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:44.464328 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.464308    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff60273-fda4-4d89-8b33-9d3408866272-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75\" (UID: \"6ff60273-fda4-4d89-8b33-9d3408866272\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:44.464369 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.464354    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f0205ed-999d-4481-a910-abcc3d24d398-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr\" (UID: \"5f0205ed-999d-4481-a910-abcc3d24d398\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:44.472996 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.472966    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvffd\" (UniqueName: \"kubernetes.io/projected/5f0205ed-999d-4481-a910-abcc3d24d398-kube-api-access-mvffd\") pod \"payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr\" (UID: \"5f0205ed-999d-4481-a910-abcc3d24d398\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:44.473105 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.473058    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgt7z\" (UniqueName: \"kubernetes.io/projected/6ff60273-fda4-4d89-8b33-9d3408866272-kube-api-access-qgt7z\") pod \"payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75\" (UID: \"6ff60273-fda4-4d89-8b33-9d3408866272\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:44.599121 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.599042    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:44.604081 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.604057    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:44.625446 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.625421    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:44.968626 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.968582    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"]
Aug 01 01:22:44.970428 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:44.970398    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0205ed_999d_4481_a910_abcc3d24d398.slice/crio-751a1a6e739f6103ff7ae1ab3ffefe8a008eb83860e2968a2bee251edad97d15 WatchSource:0}: Error finding container 751a1a6e739f6103ff7ae1ab3ffefe8a008eb83860e2968a2bee251edad97d15: Status 404 returned error can't find the container with id 751a1a6e739f6103ff7ae1ab3ffefe8a008eb83860e2968a2bee251edad97d15
Aug 01 01:22:44.971662 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:44.971640    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"]
Aug 01 01:22:44.972316 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:44.972297    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51bb3339_cd3d_44eb_af6f_864f04c98327.slice/crio-4c4e6f7e20fabeb79df58bb3248fda501ddd5850212a54c2aa2c2d47b6da0058 WatchSource:0}: Error finding container 4c4e6f7e20fabeb79df58bb3248fda501ddd5850212a54c2aa2c2d47b6da0058: Status 404 returned error can't find the container with id 4c4e6f7e20fabeb79df58bb3248fda501ddd5850212a54c2aa2c2d47b6da0058
Aug 01 01:22:45.012404 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.012376    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"]
Aug 01 01:22:45.013759 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:22:45.013736    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff60273_fda4_4d89_8b33_9d3408866272.slice/crio-a00d400971422e886ecc38cc9e350bc4cd5182945fe9c59d02c47c2ca41aaaef WatchSource:0}: Error finding container a00d400971422e886ecc38cc9e350bc4cd5182945fe9c59d02c47c2ca41aaaef: Status 404 returned error can't find the container with id a00d400971422e886ecc38cc9e350bc4cd5182945fe9c59d02c47c2ca41aaaef
Aug 01 01:22:45.968685 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.968647    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75" event={"ID":"6ff60273-fda4-4d89-8b33-9d3408866272","Type":"ContainerStarted","Data":"dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489"}
Aug 01 01:22:45.969096 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.968704    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75" event={"ID":"6ff60273-fda4-4d89-8b33-9d3408866272","Type":"ContainerStarted","Data":"a00d400971422e886ecc38cc9e350bc4cd5182945fe9c59d02c47c2ca41aaaef"}
Aug 01 01:22:45.969096 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.968730    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:45.970248 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.970219    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr" event={"ID":"5f0205ed-999d-4481-a910-abcc3d24d398","Type":"ContainerStarted","Data":"25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0"}
Aug 01 01:22:45.970354 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.970261    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:22:45.970354 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.970277    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr" event={"ID":"5f0205ed-999d-4481-a910-abcc3d24d398","Type":"ContainerStarted","Data":"751a1a6e739f6103ff7ae1ab3ffefe8a008eb83860e2968a2bee251edad97d15"}
Aug 01 01:22:45.971692 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.971664    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm" event={"ID":"51bb3339-cd3d-44eb-af6f-864f04c98327","Type":"ContainerStarted","Data":"b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e"}
Aug 01 01:22:45.971814 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.971712    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm" event={"ID":"51bb3339-cd3d-44eb-af6f-864f04c98327","Type":"ContainerStarted","Data":"4c4e6f7e20fabeb79df58bb3248fda501ddd5850212a54c2aa2c2d47b6da0058"}
Aug 01 01:22:45.971814 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.971756    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:45.987567 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:45.987530    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75" podStartSLOduration=1.987516574 podStartE2EDuration="1.987516574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:22:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:22:45.986411527 +0000 UTC m=+3234.683580590" watchObservedRunningTime="2026-08-01 01:22:45.987516574 +0000 UTC m=+3234.684685636"
Aug 01 01:22:46.005080 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:46.005038    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr" podStartSLOduration=2.005022826 podStartE2EDuration="2.005022826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:22:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:22:46.00455634 +0000 UTC m=+3234.701725402" watchObservedRunningTime="2026-08-01 01:22:46.005022826 +0000 UTC m=+3234.702191899"
Aug 01 01:22:46.028393 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:46.028353    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm" podStartSLOduration=2.533951 podStartE2EDuration="3.028338948s" totalImagesPullingTime="494.387948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:22:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:22:46.026425128 +0000 UTC m=+3234.723594191" watchObservedRunningTime="2026-08-01 01:22:46.028338948 +0000 UTC m=+3234.725508011"
Aug 01 01:22:51.983498 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:51.983460    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:22:56.980721 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:56.980681    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:22:56.981350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:22:56.981324    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:23:08.124074 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.124043    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"]
Aug 01 01:23:08.127936 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.127916    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.130157 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.130134    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-576e07-openshift-default-dockercfg-wbqzc\""
Aug 01 01:23:08.139118 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.139058    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"]
Aug 01 01:23:08.280368 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280332    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-data\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.280368 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280373    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-socket\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.280629 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280391    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b02a08a-41f9-4d30-b044-221726c0244d-istiod-ca-cert\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.280629 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280410    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b02a08a-41f9-4d30-b044-221726c0244d-istio-podinfo\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.280629 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280501    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-certs\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.280629 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280538    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-credential-socket\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.280629 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280563    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-envoy\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.280801 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280639    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv58l\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-kube-api-access-fv58l\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.280801 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.280692    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-istio-token\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382136 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382049    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv58l\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-kube-api-access-fv58l\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382136 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382124    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-istio-token\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382341 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382178    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-data\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382341 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382208    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-socket\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382341 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382230    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b02a08a-41f9-4d30-b044-221726c0244d-istiod-ca-cert\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382341 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382257    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b02a08a-41f9-4d30-b044-221726c0244d-istio-podinfo\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382341 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382291    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-certs\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382341 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382332    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-credential-socket\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382731 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382706    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-socket\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382793 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382739    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-data\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382850 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382788    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-envoy\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382850 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382794    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-credential-socket\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.382850 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.382825    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-certs\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.383165 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.383142    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b02a08a-41f9-4d30-b044-221726c0244d-istiod-ca-cert\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.385214 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.385183    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b02a08a-41f9-4d30-b044-221726c0244d-istio-podinfo\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.385421 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.385395    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-envoy\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.389868 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.389847    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-istio-token\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.390185 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.390168    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv58l\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-kube-api-access-fv58l\") pod \"e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") " pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.441248 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.441222    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:08.584561 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.584524    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"]
Aug 01 01:23:08.586561 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:23:08.586534    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b02a08a_41f9_4d30_b044_221726c0244d.slice/crio-acf506187ec26156964966cc3ef2b653dc3ffb3645a0fc320b3b07f15739a628 WatchSource:0}: Error finding container acf506187ec26156964966cc3ef2b653dc3ffb3645a0fc320b3b07f15739a628: Status 404 returned error can't find the container with id acf506187ec26156964966cc3ef2b653dc3ffb3645a0fc320b3b07f15739a628
Aug 01 01:23:08.588749 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.588717    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:23:08.588834 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.588783    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:23:08.588834 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:08.588810    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:23:09.111417 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:09.111382    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" event={"ID":"0b02a08a-41f9-4d30-b044-221726c0244d","Type":"ContainerStarted","Data":"27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f"}
Aug 01 01:23:09.111607 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:09.111440    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" event={"ID":"0b02a08a-41f9-4d30-b044-221726c0244d","Type":"ContainerStarted","Data":"acf506187ec26156964966cc3ef2b653dc3ffb3645a0fc320b3b07f15739a628"}
Aug 01 01:23:09.130151 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:09.130101    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" podStartSLOduration=1.13007561 podStartE2EDuration="1.13007561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:23:09.129452025 +0000 UTC m=+3257.826621090" watchObservedRunningTime="2026-08-01 01:23:09.13007561 +0000 UTC m=+3257.827244673"
Aug 01 01:23:09.441435 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:09.441367    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:09.446081 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:09.446055    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:10.119077 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:10.119046    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:10.119843 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:10.119826    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:25.583878 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:25.583151    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": read tcp 10.133.0.2:56904->10.133.0.92:15021: read: connection reset by peer" start-of-body=
Aug 01 01:23:25.583878 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:25.583230    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": read tcp 10.133.0.2:56904->10.133.0.92:15021: read: connection reset by peer"
Aug 01 01:23:26.225328 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:26.225292    2547 generic.go:356] "Generic (PLEG): container finished" podID="0b02a08a-41f9-4d30-b044-221726c0244d" containerID="27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f" exitCode=0
Aug 01 01:23:26.225510 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:26.225365    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" event={"ID":"0b02a08a-41f9-4d30-b044-221726c0244d","Type":"ContainerDied","Data":"27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f"}
Aug 01 01:23:26.225722 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:26.225708    2547 scope.go:117] "RemoveContainer" containerID="27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f"
Aug 01 01:23:26.226695 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:26.226665    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:23:26.226809 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:26.226730    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:23:26.226809 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:26.226759    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:23:27.233279 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:27.233243    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" event={"ID":"0b02a08a-41f9-4d30-b044-221726c0244d","Type":"ContainerStarted","Data":"cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d"}
Aug 01 01:23:27.442197 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:27.442153    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:27.442446 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:27.442421    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Aug 01 01:23:27.442582 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:27.442518    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Aug 01 01:23:28.441806 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:28.441769    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Aug 01 01:23:28.442203 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:28.441822    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Aug 01 01:23:29.441600 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:29.441564    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Aug 01 01:23:29.441767 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:29.441615    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Aug 01 01:23:30.441710 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:30.441674    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Aug 01 01:23:30.442094 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:30.441728    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Aug 01 01:23:31.442527 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:31.442467    2547 patch_prober.go:28] interesting pod/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Aug 01 01:23:31.442973 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:31.442554    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Aug 01 01:23:32.445549 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:32.445517    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:32.445959 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:32.445774    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:32.446511 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:32.446475    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:23:42.878821 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:42.878790    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cd9b2_c6f1a116-ec4e-49c7-8e92-eec6259c8b20/payload-processing/0.log"
Aug 01 01:23:52.103949 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:52.103922    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:23:52.112628 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:23:52.112605    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:24:25.710132 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:25.710056    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75_6ff60273-fda4-4d89-8b33-9d3408866272/payload-processing/0.log"
Aug 01 01:24:25.833962 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:25.833925    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cd9b2_c6f1a116-ec4e-49c7-8e92-eec6259c8b20/payload-processing/0.log"
Aug 01 01:24:26.512630 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.512598    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"]
Aug 01 01:24:26.516550 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.516528    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.518640 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.518610    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-659af5-openshift-default-dockercfg-59dnf\""
Aug 01 01:24:26.527287 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.527266    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"]
Aug 01 01:24:26.626719 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626685    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-data\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.626719 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626720    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52d8bb-01a4-44fa-9661-542908d86430-istiod-ca-cert\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.626931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626757    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-socket\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.626931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626775    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-istio-token\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.626931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626796    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kndjp\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-kube-api-access-kndjp\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.626931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626824    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-envoy\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.626931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626841    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-credential-socket\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.626931 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626920    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-certs\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.627123 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.626984    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52d8bb-01a4-44fa-9661-542908d86430-istio-podinfo\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.727962 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.727921    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-credential-socket\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728353 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.727977    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-certs\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728353 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728023    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52d8bb-01a4-44fa-9661-542908d86430-istio-podinfo\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728353 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728064    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-data\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728353 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728079    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52d8bb-01a4-44fa-9661-542908d86430-istiod-ca-cert\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728353 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728203    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-socket\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728353 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728238    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-istio-token\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728353 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728268    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kndjp\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-kube-api-access-kndjp\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728353 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728313    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-envoy\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728810 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728366    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-credential-socket\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728810 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728405    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-certs\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728810 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728431    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-data\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728973 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728831    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52d8bb-01a4-44fa-9661-542908d86430-istiod-ca-cert\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.728973 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.728912    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-socket\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.730492 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.730466    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52d8bb-01a4-44fa-9661-542908d86430-istio-podinfo\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.730553 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.730471    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-envoy\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.735421 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.735397    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-istio-token\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.735652 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.735636    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kndjp\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-kube-api-access-kndjp\") pod \"e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") " pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.827274 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.827192    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:26.967044 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.967020    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"]
Aug 01 01:24:26.969587 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:24:26.969555    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d52d8bb_01a4_44fa_9661_542908d86430.slice/crio-97af883e09780b9d3806e5c5d655e420ed17c4dd6edc45c8f20ebf4b51791d87 WatchSource:0}: Error finding container 97af883e09780b9d3806e5c5d655e420ed17c4dd6edc45c8f20ebf4b51791d87: Status 404 returned error can't find the container with id 97af883e09780b9d3806e5c5d655e420ed17c4dd6edc45c8f20ebf4b51791d87
Aug 01 01:24:26.971798 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.971764    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:24:26.971906 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.971828    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:24:26.971906 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:26.971856    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:24:27.599539 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:27.599502    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" event={"ID":"6d52d8bb-01a4-44fa-9661-542908d86430","Type":"ContainerStarted","Data":"926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5"}
Aug 01 01:24:27.599746 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:27.599588    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" event={"ID":"6d52d8bb-01a4-44fa-9661-542908d86430","Type":"ContainerStarted","Data":"97af883e09780b9d3806e5c5d655e420ed17c4dd6edc45c8f20ebf4b51791d87"}
Aug 01 01:24:27.620047 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:27.619996    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" podStartSLOduration=1.619982857 podStartE2EDuration="1.619982857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:24:27.61888688 +0000 UTC m=+3336.316055941" watchObservedRunningTime="2026-08-01 01:24:27.619982857 +0000 UTC m=+3336.317151918"
Aug 01 01:24:27.828322 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:27.828291    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:28.832986 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:28.832956    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:29.611983 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:29.611950    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:29.612952 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:29.612931    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:45.653645 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:45.653605    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 01 01:24:45.654030 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:45.653675    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 01 01:24:46.719422 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:46.719389    2547 generic.go:356] "Generic (PLEG): container finished" podID="6d52d8bb-01a4-44fa-9661-542908d86430" containerID="926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5" exitCode=0
Aug 01 01:24:46.719866 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:46.719461    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" event={"ID":"6d52d8bb-01a4-44fa-9661-542908d86430","Type":"ContainerDied","Data":"926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5"}
Aug 01 01:24:46.719913 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:46.719863    2547 scope.go:117] "RemoveContainer" containerID="926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5"
Aug 01 01:24:46.720981 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:46.720950    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:24:46.721088 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:46.721032    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:24:46.721152 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:46.721084    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 01 01:24:47.728018 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:47.727982    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" event={"ID":"6d52d8bb-01a4-44fa-9661-542908d86430","Type":"ContainerStarted","Data":"fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84"}
Aug 01 01:24:47.828079 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:47.828047    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:47.828255 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:47.828235    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Aug 01 01:24:47.828306 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:47.828284    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Aug 01 01:24:48.827783 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:48.827747    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Aug 01 01:24:48.828151 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:48.827800    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Aug 01 01:24:49.827766 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:49.827732    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Aug 01 01:24:49.827938 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:49.827789    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Aug 01 01:24:50.828366 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:50.828321    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Aug 01 01:24:50.828787 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:50.828392    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Aug 01 01:24:51.827737 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:51.827703    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Aug 01 01:24:51.827913 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:51.827754    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Aug 01 01:24:52.917562 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:52.917525    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:52.918186 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:52.918159    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:52.918917 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:52.918899    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:24:59.040351 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:59.040314    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"]
Aug 01 01:24:59.040842 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:24:59.040791    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy" containerID="cri-o://fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84" gracePeriod=30
Aug 01 01:25:04.306253 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.306168    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:25:04.389866 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.389818    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52d8bb-01a4-44fa-9661-542908d86430-istio-podinfo\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390065 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.389894    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kndjp\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-kube-api-access-kndjp\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390065 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.389926    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-envoy\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390065 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.389987    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-istio-token\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390065 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390009    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52d8bb-01a4-44fa-9661-542908d86430-istiod-ca-cert\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390065 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390042    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-socket\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390336 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390073    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-credential-socket\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390336 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390128    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-certs\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390336 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390174    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-data\") pod \"6d52d8bb-01a4-44fa-9661-542908d86430\" (UID: \"6d52d8bb-01a4-44fa-9661-542908d86430\") "
Aug 01 01:25:04.390532 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390345    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:25:04.390597 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390447    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d52d8bb-01a4-44fa-9661-542908d86430-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:25:04.390597 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390564    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:25:04.390709 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390584    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:25:04.390709 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390624    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:25:04.390836 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390813    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52d8bb-01a4-44fa-9661-542908d86430-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.390895 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390840    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.390895 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390854    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.390895 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390868    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.390895 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.390881    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.392263 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.392234    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:25:04.392388 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.392269    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d52d8bb-01a4-44fa-9661-542908d86430-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 01 01:25:04.392388 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.392306    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-kube-api-access-kndjp" (OuterVolumeSpecName: "kube-api-access-kndjp") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "kube-api-access-kndjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:25:04.392388 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.392325    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d52d8bb-01a4-44fa-9661-542908d86430" (UID: "6d52d8bb-01a4-44fa-9661-542908d86430"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:25:04.491571 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.491532    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52d8bb-01a4-44fa-9661-542908d86430-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.491571 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.491563    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kndjp\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-kube-api-access-kndjp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.491571 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.491573    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52d8bb-01a4-44fa-9661-542908d86430-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.491816 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.491582    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52d8bb-01a4-44fa-9661-542908d86430-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:04.837310 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.837275    2547 generic.go:356] "Generic (PLEG): container finished" podID="6d52d8bb-01a4-44fa-9661-542908d86430" containerID="fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84" exitCode=0
Aug 01 01:25:04.837528 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.837328    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"
Aug 01 01:25:04.837528 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.837364    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" event={"ID":"6d52d8bb-01a4-44fa-9661-542908d86430","Type":"ContainerDied","Data":"fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84"}
Aug 01 01:25:04.837528 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.837416    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq" event={"ID":"6d52d8bb-01a4-44fa-9661-542908d86430","Type":"ContainerDied","Data":"97af883e09780b9d3806e5c5d655e420ed17c4dd6edc45c8f20ebf4b51791d87"}
Aug 01 01:25:04.837528 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.837445    2547 scope.go:117] "RemoveContainer" containerID="fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84"
Aug 01 01:25:04.848323 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.848305    2547 scope.go:117] "RemoveContainer" containerID="926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5"
Aug 01 01:25:04.857559 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.857534    2547 scope.go:117] "RemoveContainer" containerID="fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84"
Aug 01 01:25:04.857874 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:25:04.857854    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84\": container with ID starting with fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84 not found: ID does not exist" containerID="fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84"
Aug 01 01:25:04.857945 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.857883    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84"} err="failed to get container status \"fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84\": rpc error: code = NotFound desc = could not find container \"fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84\": container with ID starting with fab31c66fa0642f4b6af66c6a9e257c980577f0fa59bc9203c8358464066be84 not found: ID does not exist"
Aug 01 01:25:04.857945 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.857904    2547 scope.go:117] "RemoveContainer" containerID="926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5"
Aug 01 01:25:04.858144 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:25:04.858127    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5\": container with ID starting with 926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5 not found: ID does not exist" containerID="926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5"
Aug 01 01:25:04.858195 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.858150    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5"} err="failed to get container status \"926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5\": rpc error: code = NotFound desc = could not find container \"926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5\": container with ID starting with 926272b8a381178441a234f5b93f8fb5af4b91f5c2c0fafcff31e6dd724a43d5 not found: ID does not exist"
Aug 01 01:25:04.859258 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.859233    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"]
Aug 01 01:25:04.862669 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:04.862645    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-659af5-openshift-default-57f7d95c84-6v8fq"]
Aug 01 01:25:05.882068 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:05.882026    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" path="/var/lib/kubelet/pods/6d52d8bb-01a4-44fa-9661-542908d86430/volumes"
Aug 01 01:25:18.445512 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.445460    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"]
Aug 01 01:25:18.446331 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.446268    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm" podUID="51bb3339-cd3d-44eb-af6f-864f04c98327" containerName="maas-api" containerID="cri-o://b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e" gracePeriod=30
Aug 01 01:25:18.497924 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.497890    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"]
Aug 01 01:25:18.498435 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.498145    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75" podUID="6ff60273-fda4-4d89-8b33-9d3408866272" containerName="payload-processing" containerID="cri-o://dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489" gracePeriod=30
Aug 01 01:25:18.505215 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.505185    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"]
Aug 01 01:25:18.505678 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.505567    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr" podUID="5f0205ed-999d-4481-a910-abcc3d24d398" containerName="payload-pre-processing" containerID="cri-o://25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0" gracePeriod=30
Aug 01 01:25:18.788442 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.788417    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:25:18.805866 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.805842    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:25:18.820935 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.820912    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:25:18.921386 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.921356    2547 generic.go:356] "Generic (PLEG): container finished" podID="6ff60273-fda4-4d89-8b33-9d3408866272" containerID="dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489" exitCode=0
Aug 01 01:25:18.921558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.921395    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"
Aug 01 01:25:18.921558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.921444    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75" event={"ID":"6ff60273-fda4-4d89-8b33-9d3408866272","Type":"ContainerDied","Data":"dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489"}
Aug 01 01:25:18.921558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.921505    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75" event={"ID":"6ff60273-fda4-4d89-8b33-9d3408866272","Type":"ContainerDied","Data":"a00d400971422e886ecc38cc9e350bc4cd5182945fe9c59d02c47c2ca41aaaef"}
Aug 01 01:25:18.921558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.921532    2547 scope.go:117] "RemoveContainer" containerID="dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489"
Aug 01 01:25:18.922705 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.922687    2547 generic.go:356] "Generic (PLEG): container finished" podID="5f0205ed-999d-4481-a910-abcc3d24d398" containerID="25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0" exitCode=0
Aug 01 01:25:18.922813 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.922738    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"
Aug 01 01:25:18.922813 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.922750    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr" event={"ID":"5f0205ed-999d-4481-a910-abcc3d24d398","Type":"ContainerDied","Data":"25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0"}
Aug 01 01:25:18.922813 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.922780    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr" event={"ID":"5f0205ed-999d-4481-a910-abcc3d24d398","Type":"ContainerDied","Data":"751a1a6e739f6103ff7ae1ab3ffefe8a008eb83860e2968a2bee251edad97d15"}
Aug 01 01:25:18.924039 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.924020    2547 generic.go:356] "Generic (PLEG): container finished" podID="51bb3339-cd3d-44eb-af6f-864f04c98327" containerID="b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e" exitCode=0
Aug 01 01:25:18.924153 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.924050    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"
Aug 01 01:25:18.924153 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.924142    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm" event={"ID":"51bb3339-cd3d-44eb-af6f-864f04c98327","Type":"ContainerDied","Data":"b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e"}
Aug 01 01:25:18.924256 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.924186    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm" event={"ID":"51bb3339-cd3d-44eb-af6f-864f04c98327","Type":"ContainerDied","Data":"4c4e6f7e20fabeb79df58bb3248fda501ddd5850212a54c2aa2c2d47b6da0058"}
Aug 01 01:25:18.929519 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.929497    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls\") pod \"51bb3339-cd3d-44eb-af6f-864f04c98327\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") "
Aug 01 01:25:18.929606 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.929543    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npkqv\" (UniqueName: \"kubernetes.io/projected/51bb3339-cd3d-44eb-af6f-864f04c98327-kube-api-access-npkqv\") pod \"51bb3339-cd3d-44eb-af6f-864f04c98327\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") "
Aug 01 01:25:18.929606 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.929580    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff60273-fda4-4d89-8b33-9d3408866272-plugins-config-volume\") pod \"6ff60273-fda4-4d89-8b33-9d3408866272\" (UID: \"6ff60273-fda4-4d89-8b33-9d3408866272\") "
Aug 01 01:25:18.929710 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.929620    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51bb3339-cd3d-44eb-af6f-864f04c98327-openshift-service-ca\") pod \"51bb3339-cd3d-44eb-af6f-864f04c98327\" (UID: \"51bb3339-cd3d-44eb-af6f-864f04c98327\") "
Aug 01 01:25:18.929710 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.929659    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvffd\" (UniqueName: \"kubernetes.io/projected/5f0205ed-999d-4481-a910-abcc3d24d398-kube-api-access-mvffd\") pod \"5f0205ed-999d-4481-a910-abcc3d24d398\" (UID: \"5f0205ed-999d-4481-a910-abcc3d24d398\") "
Aug 01 01:25:18.929710 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.929688    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgt7z\" (UniqueName: \"kubernetes.io/projected/6ff60273-fda4-4d89-8b33-9d3408866272-kube-api-access-qgt7z\") pod \"6ff60273-fda4-4d89-8b33-9d3408866272\" (UID: \"6ff60273-fda4-4d89-8b33-9d3408866272\") "
Aug 01 01:25:18.929859 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.929816    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f0205ed-999d-4481-a910-abcc3d24d398-plugins-config-volume\") pod \"5f0205ed-999d-4481-a910-abcc3d24d398\" (UID: \"5f0205ed-999d-4481-a910-abcc3d24d398\") "
Aug 01 01:25:18.930357 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.929998    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff60273-fda4-4d89-8b33-9d3408866272-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ff60273-fda4-4d89-8b33-9d3408866272" (UID: "6ff60273-fda4-4d89-8b33-9d3408866272"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:25:18.930357 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.930085    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51bb3339-cd3d-44eb-af6f-864f04c98327-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "51bb3339-cd3d-44eb-af6f-864f04c98327" (UID: "51bb3339-cd3d-44eb-af6f-864f04c98327"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:25:18.930357 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.930333    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ff60273-fda4-4d89-8b33-9d3408866272-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:18.930357 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.930330    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f0205ed-999d-4481-a910-abcc3d24d398-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f0205ed-999d-4481-a910-abcc3d24d398" (UID: "5f0205ed-999d-4481-a910-abcc3d24d398"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:25:18.931791 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.931765    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0205ed-999d-4481-a910-abcc3d24d398-kube-api-access-mvffd" (OuterVolumeSpecName: "kube-api-access-mvffd") pod "5f0205ed-999d-4481-a910-abcc3d24d398" (UID: "5f0205ed-999d-4481-a910-abcc3d24d398"). InnerVolumeSpecName "kube-api-access-mvffd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:25:18.931980 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.931965    2547 scope.go:117] "RemoveContainer" containerID="dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489"
Aug 01 01:25:18.932167 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.932141    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51bb3339-cd3d-44eb-af6f-864f04c98327-kube-api-access-npkqv" (OuterVolumeSpecName: "kube-api-access-npkqv") pod "51bb3339-cd3d-44eb-af6f-864f04c98327" (UID: "51bb3339-cd3d-44eb-af6f-864f04c98327"). InnerVolumeSpecName "kube-api-access-npkqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:25:18.932244 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.932217    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "51bb3339-cd3d-44eb-af6f-864f04c98327" (UID: "51bb3339-cd3d-44eb-af6f-864f04c98327"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 01:25:18.932244 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:25:18.932226    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489\": container with ID starting with dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489 not found: ID does not exist" containerID="dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489"
Aug 01 01:25:18.932315 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.932252    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489"} err="failed to get container status \"dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489\": rpc error: code = NotFound desc = could not find container \"dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489\": container with ID starting with dd20583a1f8750ae25dab9f49b9e541661d118dbf04c4f4a2b6d9653805bb489 not found: ID does not exist"
Aug 01 01:25:18.932315 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.932267    2547 scope.go:117] "RemoveContainer" containerID="25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0"
Aug 01 01:25:18.932315 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.932291    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff60273-fda4-4d89-8b33-9d3408866272-kube-api-access-qgt7z" (OuterVolumeSpecName: "kube-api-access-qgt7z") pod "6ff60273-fda4-4d89-8b33-9d3408866272" (UID: "6ff60273-fda4-4d89-8b33-9d3408866272"). InnerVolumeSpecName "kube-api-access-qgt7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:25:18.940195 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.940178    2547 scope.go:117] "RemoveContainer" containerID="25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0"
Aug 01 01:25:18.940458 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:25:18.940439    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0\": container with ID starting with 25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0 not found: ID does not exist" containerID="25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0"
Aug 01 01:25:18.940532 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.940463    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0"} err="failed to get container status \"25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0\": rpc error: code = NotFound desc = could not find container \"25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0\": container with ID starting with 25f8bdffe8af82a66711a5c0bd0c3d3c3eb0c31a7ca84028746695ce5fe644e0 not found: ID does not exist"
Aug 01 01:25:18.940532 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.940490    2547 scope.go:117] "RemoveContainer" containerID="b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e"
Aug 01 01:25:18.950024 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.950008    2547 scope.go:117] "RemoveContainer" containerID="b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e"
Aug 01 01:25:18.950302 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:25:18.950284    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e\": container with ID starting with b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e not found: ID does not exist" containerID="b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e"
Aug 01 01:25:18.950351 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:18.950310    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e"} err="failed to get container status \"b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e\": rpc error: code = NotFound desc = could not find container \"b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e\": container with ID starting with b00ece58d7bab05738cf33821c19c68214138f0bdd6bd1fb553fd820672c474e not found: ID does not exist"
Aug 01 01:25:19.031746 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.031690    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f0205ed-999d-4481-a910-abcc3d24d398-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:19.031746 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.031713    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51bb3339-cd3d-44eb-af6f-864f04c98327-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:19.031746 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.031722    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npkqv\" (UniqueName: \"kubernetes.io/projected/51bb3339-cd3d-44eb-af6f-864f04c98327-kube-api-access-npkqv\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:19.031746 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.031731    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51bb3339-cd3d-44eb-af6f-864f04c98327-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:19.031746 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.031740    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvffd\" (UniqueName: \"kubernetes.io/projected/5f0205ed-999d-4481-a910-abcc3d24d398-kube-api-access-mvffd\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:19.031746 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.031748    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgt7z\" (UniqueName: \"kubernetes.io/projected/6ff60273-fda4-4d89-8b33-9d3408866272-kube-api-access-qgt7z\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:25:19.247366 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.247339    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"]
Aug 01 01:25:19.252854 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.252834    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-2db7f1-8589f6d6b6-j8q75"]
Aug 01 01:25:19.262239 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.262213    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"]
Aug 01 01:25:19.265892 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.265875    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2db7f1-85c6c7ddd7-qvzpm"]
Aug 01 01:25:19.276740 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.276720    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"]
Aug 01 01:25:19.280363 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.280344    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-2db7f1-6d7b954d56-hfkdr"]
Aug 01 01:25:19.881712 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.881635    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51bb3339-cd3d-44eb-af6f-864f04c98327" path="/var/lib/kubelet/pods/51bb3339-cd3d-44eb-af6f-864f04c98327/volumes"
Aug 01 01:25:19.882048 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.882035    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f0205ed-999d-4481-a910-abcc3d24d398" path="/var/lib/kubelet/pods/5f0205ed-999d-4481-a910-abcc3d24d398/volumes"
Aug 01 01:25:19.882428 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:25:19.882414    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff60273-fda4-4d89-8b33-9d3408866272" path="/var/lib/kubelet/pods/6ff60273-fda4-4d89-8b33-9d3408866272/volumes"
Aug 01 01:26:24.006155 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:24.006122    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"]
Aug 01 01:26:24.006838 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:24.006384    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy" containerID="cri-o://cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d" gracePeriod=30
Aug 01 01:26:29.268812 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.268751    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:26:29.362121 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.362081    2547 generic.go:356] "Generic (PLEG): container finished" podID="0b02a08a-41f9-4d30-b044-221726c0244d" containerID="cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d" exitCode=0
Aug 01 01:26:29.362283 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.362135    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"
Aug 01 01:26:29.362283 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.362164    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" event={"ID":"0b02a08a-41f9-4d30-b044-221726c0244d","Type":"ContainerDied","Data":"cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d"}
Aug 01 01:26:29.362283 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.362241    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz" event={"ID":"0b02a08a-41f9-4d30-b044-221726c0244d","Type":"ContainerDied","Data":"acf506187ec26156964966cc3ef2b653dc3ffb3645a0fc320b3b07f15739a628"}
Aug 01 01:26:29.362283 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.362273    2547 scope.go:117] "RemoveContainer" containerID="cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d"
Aug 01 01:26:29.371049 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.371032    2547 scope.go:117] "RemoveContainer" containerID="27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f"
Aug 01 01:26:29.379170 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379149    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv58l\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-kube-api-access-fv58l\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379170 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379166    2547 scope.go:117] "RemoveContainer" containerID="cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d"
Aug 01 01:26:29.379279 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379209    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b02a08a-41f9-4d30-b044-221726c0244d-istio-podinfo\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379279 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379254    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b02a08a-41f9-4d30-b044-221726c0244d-istiod-ca-cert\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379367 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379289    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-credential-socket\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379367 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379317    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-istio-token\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379509 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379366    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-envoy\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379509 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379410    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-socket\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379509 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:26:29.379410    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d\": container with ID starting with cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d not found: ID does not exist" containerID="cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d"
Aug 01 01:26:29.379509 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379450    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d"} err="failed to get container status \"cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d\": rpc error: code = NotFound desc = could not find container \"cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d\": container with ID starting with cc2bd42dc9a8451e37e304b61e7a2de1e9e7e523458336f91d1fd5a6b4a3a78d not found: ID does not exist"
Aug 01 01:26:29.379509 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379474    2547 scope.go:117] "RemoveContainer" containerID="27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f"
Aug 01 01:26:29.379791 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379461    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-data\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379791 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379631    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-certs\") pod \"0b02a08a-41f9-4d30-b044-221726c0244d\" (UID: \"0b02a08a-41f9-4d30-b044-221726c0244d\") "
Aug 01 01:26:29.379791 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379676    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:26:29.379791 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379699    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b02a08a-41f9-4d30-b044-221726c0244d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:26:29.380010 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379857    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:26:29.380010 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379897    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:26:29.380010 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.379984    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:26:29.380178 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.380064    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b02a08a-41f9-4d30-b044-221726c0244d-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.380178 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.380079    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.380178 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.380093    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.380178 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.380107    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.380178 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.380121    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.380442 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:26:29.380219    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f\": container with ID starting with 27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f not found: ID does not exist" containerID="27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f"
Aug 01 01:26:29.380442 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.380248    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f"} err="failed to get container status \"27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f\": rpc error: code = NotFound desc = could not find container \"27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f\": container with ID starting with 27a9764028089fee0fedad9162d25cf29872b07626d13e910f3e2dd49af1850f not found: ID does not exist"
Aug 01 01:26:29.381334 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.381307    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-kube-api-access-fv58l" (OuterVolumeSpecName: "kube-api-access-fv58l") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "kube-api-access-fv58l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:26:29.381750 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.381724    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:26:29.382012 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.381989    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b02a08a-41f9-4d30-b044-221726c0244d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 01 01:26:29.382077 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.382031    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b02a08a-41f9-4d30-b044-221726c0244d" (UID: "0b02a08a-41f9-4d30-b044-221726c0244d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 01 01:26:29.481385 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.481342    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv58l\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-kube-api-access-fv58l\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.481385 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.481385    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b02a08a-41f9-4d30-b044-221726c0244d-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.481385 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.481395    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b02a08a-41f9-4d30-b044-221726c0244d-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.481601 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.481404    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b02a08a-41f9-4d30-b044-221726c0244d-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:29.685421 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.685394    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"]
Aug 01 01:26:29.690504 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.690470    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-576e07-openshift-default-84bb46b984-xcrjz"]
Aug 01 01:26:29.881798 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:29.881767    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" path="/var/lib/kubelet/pods/0b02a08a-41f9-4d30-b044-221726c0244d/volumes"
Aug 01 01:26:34.812301 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:34.812261    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"]
Aug 01 01:26:34.813147 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:34.813084    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg" podUID="a2053e9d-170f-49cc-ae29-374442bd746d" containerName="maas-api" containerID="cri-o://ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc" gracePeriod=30
Aug 01 01:26:34.838962 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:34.838937    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"]
Aug 01 01:26:34.843460 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:34.843438    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-1e2f5b-29759115-8bhgm"]
Aug 01 01:26:35.081177 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.081146    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:26:35.232267 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.232233    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2053e9d-170f-49cc-ae29-374442bd746d-maas-api-tls\") pod \"a2053e9d-170f-49cc-ae29-374442bd746d\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") "
Aug 01 01:26:35.232450 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.232286    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5wjt\" (UniqueName: \"kubernetes.io/projected/a2053e9d-170f-49cc-ae29-374442bd746d-kube-api-access-z5wjt\") pod \"a2053e9d-170f-49cc-ae29-374442bd746d\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") "
Aug 01 01:26:35.232450 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.232438    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2053e9d-170f-49cc-ae29-374442bd746d-openshift-service-ca\") pod \"a2053e9d-170f-49cc-ae29-374442bd746d\" (UID: \"a2053e9d-170f-49cc-ae29-374442bd746d\") "
Aug 01 01:26:35.232806 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.232780    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2053e9d-170f-49cc-ae29-374442bd746d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2053e9d-170f-49cc-ae29-374442bd746d" (UID: "a2053e9d-170f-49cc-ae29-374442bd746d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:26:35.234370 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.234341    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2053e9d-170f-49cc-ae29-374442bd746d-kube-api-access-z5wjt" (OuterVolumeSpecName: "kube-api-access-z5wjt") pod "a2053e9d-170f-49cc-ae29-374442bd746d" (UID: "a2053e9d-170f-49cc-ae29-374442bd746d"). InnerVolumeSpecName "kube-api-access-z5wjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:26:35.234471 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.234366    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2053e9d-170f-49cc-ae29-374442bd746d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2053e9d-170f-49cc-ae29-374442bd746d" (UID: "a2053e9d-170f-49cc-ae29-374442bd746d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 01:26:35.333619 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.333532    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2053e9d-170f-49cc-ae29-374442bd746d-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:35.333619 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.333565    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2053e9d-170f-49cc-ae29-374442bd746d-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:35.333619 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.333575    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5wjt\" (UniqueName: \"kubernetes.io/projected/a2053e9d-170f-49cc-ae29-374442bd746d-kube-api-access-z5wjt\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:35.397595 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.397557    2547 generic.go:356] "Generic (PLEG): container finished" podID="a2053e9d-170f-49cc-ae29-374442bd746d" containerID="ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc" exitCode=0
Aug 01 01:26:35.397767 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.397607    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"
Aug 01 01:26:35.397767 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.397620    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg" event={"ID":"a2053e9d-170f-49cc-ae29-374442bd746d","Type":"ContainerDied","Data":"ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc"}
Aug 01 01:26:35.397767 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.397673    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg" event={"ID":"a2053e9d-170f-49cc-ae29-374442bd746d","Type":"ContainerDied","Data":"d1216eade23b256ec3aa8e384e2d8739ebd9fa19964c5bf62789e25841e8c9af"}
Aug 01 01:26:35.397767 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.397702    2547 scope.go:117] "RemoveContainer" containerID="ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc"
Aug 01 01:26:35.406985 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.406965    2547 scope.go:117] "RemoveContainer" containerID="ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc"
Aug 01 01:26:35.407219 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:26:35.407200    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc\": container with ID starting with ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc not found: ID does not exist" containerID="ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc"
Aug 01 01:26:35.407271 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.407244    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc"} err="failed to get container status \"ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc\": rpc error: code = NotFound desc = could not find container \"ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc\": container with ID starting with ac8e59332bea667dce323c0acc38dc11ddd69468422f1040d775913b0e33f5bc not found: ID does not exist"
Aug 01 01:26:35.421953 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.419522    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"]
Aug 01 01:26:35.426977 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.426950    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1e2f5b-86f5b4fc8-l5dhg"]
Aug 01 01:26:35.882338 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.882302    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2053e9d-170f-49cc-ae29-374442bd746d" path="/var/lib/kubelet/pods/a2053e9d-170f-49cc-ae29-374442bd746d/volumes"
Aug 01 01:26:35.882742 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:35.882629    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd125698-58dc-4f2b-a2d6-c96f4e3ac332" path="/var/lib/kubelet/pods/dd125698-58dc-4f2b-a2d6-c96f4e3ac332/volumes"
Aug 01 01:26:52.457306 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.457276    2547 scope.go:117] "RemoveContainer" containerID="1927088fcb82a4d964c21361245bc7572098ab2c89206c17747cf92f019ab02e"
Aug 01 01:26:52.512408 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.512376    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"]
Aug 01 01:26:52.512691 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.512636    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc" podUID="9b16932f-c7c5-4d9c-848b-5e5938af5d9c" containerName="maas-api" containerID="cri-o://f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66" gracePeriod=30
Aug 01 01:26:52.551189 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.551164    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"]
Aug 01 01:26:52.555859 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.555840    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4224e1-29759115-9q4rd"]
Aug 01 01:26:52.589440 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.589399    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"]
Aug 01 01:26:52.589710 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.589677    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8" podUID="8d70458b-f1f9-47ec-8e0a-40bd54fea403" containerName="payload-pre-processing" containerID="cri-o://d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d" gracePeriod=30
Aug 01 01:26:52.864039 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.864010    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:26:52.867325 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.867305    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:26:52.881251 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.881228    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-openshift-service-ca\") pod \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") "
Aug 01 01:26:52.881350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.881268    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r44fn\" (UniqueName: \"kubernetes.io/projected/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-kube-api-access-r44fn\") pod \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") "
Aug 01 01:26:52.881350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.881294    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b785k\" (UniqueName: \"kubernetes.io/projected/8d70458b-f1f9-47ec-8e0a-40bd54fea403-kube-api-access-b785k\") pod \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\" (UID: \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\") "
Aug 01 01:26:52.881350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.881342    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls\") pod \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\" (UID: \"9b16932f-c7c5-4d9c-848b-5e5938af5d9c\") "
Aug 01 01:26:52.881558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.881393    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d70458b-f1f9-47ec-8e0a-40bd54fea403-plugins-config-volume\") pod \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\" (UID: \"8d70458b-f1f9-47ec-8e0a-40bd54fea403\") "
Aug 01 01:26:52.881655 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.881630    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b16932f-c7c5-4d9c-848b-5e5938af5d9c" (UID: "9b16932f-c7c5-4d9c-848b-5e5938af5d9c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:26:52.881950 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.881905    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d70458b-f1f9-47ec-8e0a-40bd54fea403-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8d70458b-f1f9-47ec-8e0a-40bd54fea403" (UID: "8d70458b-f1f9-47ec-8e0a-40bd54fea403"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 01 01:26:52.882080 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.882052    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:52.882167 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.882084    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d70458b-f1f9-47ec-8e0a-40bd54fea403-plugins-config-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:52.883616 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.883593    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-kube-api-access-r44fn" (OuterVolumeSpecName: "kube-api-access-r44fn") pod "9b16932f-c7c5-4d9c-848b-5e5938af5d9c" (UID: "9b16932f-c7c5-4d9c-848b-5e5938af5d9c"). InnerVolumeSpecName "kube-api-access-r44fn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:26:52.883693 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.883626    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b16932f-c7c5-4d9c-848b-5e5938af5d9c" (UID: "9b16932f-c7c5-4d9c-848b-5e5938af5d9c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 01 01:26:52.883866 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.883844    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d70458b-f1f9-47ec-8e0a-40bd54fea403-kube-api-access-b785k" (OuterVolumeSpecName: "kube-api-access-b785k") pod "8d70458b-f1f9-47ec-8e0a-40bd54fea403" (UID: "8d70458b-f1f9-47ec-8e0a-40bd54fea403"). InnerVolumeSpecName "kube-api-access-b785k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 01 01:26:52.982736 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.982705    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b785k\" (UniqueName: \"kubernetes.io/projected/8d70458b-f1f9-47ec-8e0a-40bd54fea403-kube-api-access-b785k\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:52.982736 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.982734    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:52.982736 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:52.982747    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r44fn\" (UniqueName: \"kubernetes.io/projected/9b16932f-c7c5-4d9c-848b-5e5938af5d9c-kube-api-access-r44fn\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Aug 01 01:26:53.504309 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.504273    2547 generic.go:356] "Generic (PLEG): container finished" podID="9b16932f-c7c5-4d9c-848b-5e5938af5d9c" containerID="f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66" exitCode=0
Aug 01 01:26:53.504787 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.504330    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"
Aug 01 01:26:53.504787 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.504361    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc" event={"ID":"9b16932f-c7c5-4d9c-848b-5e5938af5d9c","Type":"ContainerDied","Data":"f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66"}
Aug 01 01:26:53.504787 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.504420    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc" event={"ID":"9b16932f-c7c5-4d9c-848b-5e5938af5d9c","Type":"ContainerDied","Data":"46d58e27c4f4d792d36f740677e05a13afae209f5364980d0ffa85fc1920f080"}
Aug 01 01:26:53.504787 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.504447    2547 scope.go:117] "RemoveContainer" containerID="f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66"
Aug 01 01:26:53.505850 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.505827    2547 generic.go:356] "Generic (PLEG): container finished" podID="8d70458b-f1f9-47ec-8e0a-40bd54fea403" containerID="d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d" exitCode=0
Aug 01 01:26:53.505947 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.505868    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"
Aug 01 01:26:53.505947 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.505884    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8" event={"ID":"8d70458b-f1f9-47ec-8e0a-40bd54fea403","Type":"ContainerDied","Data":"d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d"}
Aug 01 01:26:53.505947 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.505926    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8" event={"ID":"8d70458b-f1f9-47ec-8e0a-40bd54fea403","Type":"ContainerDied","Data":"eae22903c62bf0f076390fd0bb1fabfaebad9c20feff08a80e038d8feec4cbd7"}
Aug 01 01:26:53.514110 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.514090    2547 scope.go:117] "RemoveContainer" containerID="f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66"
Aug 01 01:26:53.514428 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:26:53.514390    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66\": container with ID starting with f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66 not found: ID does not exist" containerID="f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66"
Aug 01 01:26:53.514428 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.514420    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66"} err="failed to get container status \"f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66\": rpc error: code = NotFound desc = could not find container \"f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66\": container with ID starting with f6d967bc990a0af72742b76a42418648c3c6762ef72451bf0c75cf5b83170a66 not found: ID does not exist"
Aug 01 01:26:53.514595 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.514437    2547 scope.go:117] "RemoveContainer" containerID="d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d"
Aug 01 01:26:53.522958 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.522939    2547 scope.go:117] "RemoveContainer" containerID="d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d"
Aug 01 01:26:53.523192 ip-10-0-131-26 kubenswrapper[2547]: E0801 01:26:53.523174    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d\": container with ID starting with d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d not found: ID does not exist" containerID="d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d"
Aug 01 01:26:53.523239 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.523200    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d"} err="failed to get container status \"d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d\": rpc error: code = NotFound desc = could not find container \"d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d\": container with ID starting with d4e88add78936c2488eebbf1a2def82c207a0a2bbf75e49fd74c693e598cef2d not found: ID does not exist"
Aug 01 01:26:53.531174 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.531154    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"]
Aug 01 01:26:53.534446 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.534425    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4224e1-65b9454746-ctpgc"]
Aug 01 01:26:53.544248 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.544227    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"]
Aug 01 01:26:53.551370 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.550403    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4224e1-99cbb48d8-m7nb8"]
Aug 01 01:26:53.880757 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.880683    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d70458b-f1f9-47ec-8e0a-40bd54fea403" path="/var/lib/kubelet/pods/8d70458b-f1f9-47ec-8e0a-40bd54fea403/volumes"
Aug 01 01:26:53.881069 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.881056    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b16932f-c7c5-4d9c-848b-5e5938af5d9c" path="/var/lib/kubelet/pods/9b16932f-c7c5-4d9c-848b-5e5938af5d9c/volumes"
Aug 01 01:26:53.881307 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:26:53.881296    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c455db6b-01cb-4693-9516-58f6666798ae" path="/var/lib/kubelet/pods/c455db6b-01cb-4693-9516-58f6666798ae/volumes"
Aug 01 01:27:05.523297 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:05.523268    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r2522_9bcba17e-63e7-4dd8-b5e6-72c72275d59f/manager/0.log"
Aug 01 01:27:05.639687 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:05.639649    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4vnbh_98133ebe-7180-4352-8a49-c26879bd13db/manager/0.log"
Aug 01 01:27:05.897400 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:05.897326    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mg8zz_75201471-272a-49d6-9dba-a68a7bec8941/server/0.log"
Aug 01 01:27:06.013317 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:06.013289    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w7qdm_8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb/manager/0.log"
Aug 01 01:27:06.127224 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:06.127199    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c56689d88-96v6q_20b4a17b-3459-4d57-9721-196dfa0deb3c/copy-manifests/0.log"
Aug 01 01:27:06.132739 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:06.132721    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c56689d88-96v6q_20b4a17b-3459-4d57-9721-196dfa0deb3c/manager/0.log"
Aug 01 01:27:06.721587 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:06.721548    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-78cdcdf5c7-m9psf_ff3dfdcb-08d5-478c-80ab-b6b25224d7ba/maas-api/0.log"
Aug 01 01:27:06.939729 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:06.939706    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29759100-g8md2_a38d099d-fd60-4a4c-9c2d-76d2244978c7/cleanup/0.log"
Aug 01 01:27:07.054600 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:07.054542    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29759115-5fcc5_1e671970-dbc6-4934-bd35-51f48aba2f69/cleanup/0.log"
Aug 01 01:27:07.164532 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:07.164476    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6t9nf_9fb61fff-e021-43e7-a063-4f2703eebba3/postgres/0.log"
Aug 01 01:27:08.102400 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:08.102370    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-qx9k2_9e1dc749-58ac-4ccf-b027-26583ea9e85b/manager/0.log"
Aug 01 01:27:08.214174 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:08.214147    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-96bk4_3006f723-6ec2-4db8-abab-f9f49c02f47c/manager/0.log"
Aug 01 01:27:08.669098 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:08.669069    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-lbqdq_83eb1d46-55b2-47ff-bb1d-17224ba7c47c/manager/0.log"
Aug 01 01:27:09.011529 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:09.011502    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq_cef13b1c-89e2-40cf-ae1f-d2bc88bab124/istio-proxy/0.log"
Aug 01 01:27:09.347441 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:09.347369    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6db59d85d8-vzhv7_ceae8985-d97e-498c-8dfc-0e78377e2701/kube-auth-proxy/0.log"
Aug 01 01:27:09.461598 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:09.461572    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-75b9q_f8bad48f-e139-4854-a20c-dc666e8cef05/istio-proxy/1.log"
Aug 01 01:27:09.697388 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:09.697312    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cd9b2_c6f1a116-ec4e-49c7-8e92-eec6259c8b20/payload-processing/0.log"
Aug 01 01:27:09.813368 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:09.813342    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df4f94764-jnbqw_21764f3a-5c04-4e8b-bfa9-d29e519ea939/router/0.log"
Aug 01 01:27:10.298647 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:10.298615    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mxbb5_d412798a-a12f-4302-8428-13e7b9a3a741/main/0.log"
Aug 01 01:27:10.428614 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:10.428585    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-99vrg_88ac2dff-9616-49bf-9cfd-db044b3645cb/main/0.log"
Aug 01 01:27:16.019603 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.019528    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bl84r/must-gather-5qvhj"]
Aug 01 01:27:16.019975 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.019931    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2053e9d-170f-49cc-ae29-374442bd746d" containerName="maas-api"
Aug 01 01:27:16.019975 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.019943    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2053e9d-170f-49cc-ae29-374442bd746d" containerName="maas-api"
Aug 01 01:27:16.019975 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.019952    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51bb3339-cd3d-44eb-af6f-864f04c98327" containerName="maas-api"
Aug 01 01:27:16.019975 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.019958    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="51bb3339-cd3d-44eb-af6f-864f04c98327" containerName="maas-api"
Aug 01 01:27:16.019975 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.019966    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy"
Aug 01 01:27:16.019975 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.019974    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.019994    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d70458b-f1f9-47ec-8e0a-40bd54fea403" containerName="payload-pre-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020000    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d70458b-f1f9-47ec-8e0a-40bd54fea403" containerName="payload-pre-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020007    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b16932f-c7c5-4d9c-848b-5e5938af5d9c" containerName="maas-api"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020012    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b16932f-c7c5-4d9c-848b-5e5938af5d9c" containerName="maas-api"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020019    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff60273-fda4-4d89-8b33-9d3408866272" containerName="payload-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020024    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff60273-fda4-4d89-8b33-9d3408866272" containerName="payload-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020029    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020035    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020043    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0205ed-999d-4481-a910-abcc3d24d398" containerName="payload-pre-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020048    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0205ed-999d-4481-a910-abcc3d24d398" containerName="payload-pre-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020055    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020061    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020070    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020075    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020141    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d70458b-f1f9-47ec-8e0a-40bd54fea403" containerName="payload-pre-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020150    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff60273-fda4-4d89-8b33-9d3408866272" containerName="payload-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020156    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="51bb3339-cd3d-44eb-af6f-864f04c98327" containerName="maas-api"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020162    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020170    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b16932f-c7c5-4d9c-848b-5e5938af5d9c" containerName="maas-api"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020177    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f0205ed-999d-4481-a910-abcc3d24d398" containerName="payload-pre-processing"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020183    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020188    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d52d8bb-01a4-44fa-9661-542908d86430" containerName="istio-proxy"
Aug 01 01:27:16.020200 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020195    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2053e9d-170f-49cc-ae29-374442bd746d" containerName="maas-api"
Aug 01 01:27:16.020999 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.020317    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b02a08a-41f9-4d30-b044-221726c0244d" containerName="istio-proxy"
Aug 01 01:27:16.023602 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.023586    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bl84r/must-gather-5qvhj"
Aug 01 01:27:16.025645 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.025622    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bl84r\"/\"openshift-service-ca.crt\""
Aug 01 01:27:16.025754 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.025644    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bl84r\"/\"kube-root-ca.crt\""
Aug 01 01:27:16.025754 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.025623    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bl84r\"/\"default-dockercfg-hwcw7\""
Aug 01 01:27:16.034592 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.034571    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bl84r/must-gather-5qvhj"]
Aug 01 01:27:16.073089 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.073069    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/97737fad-381c-4093-a34e-79ed9742dc4a-must-gather-output\") pod \"must-gather-5qvhj\" (UID: \"97737fad-381c-4093-a34e-79ed9742dc4a\") " pod="openshift-must-gather-bl84r/must-gather-5qvhj"
Aug 01 01:27:16.073198 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.073105    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsqxw\" (UniqueName: \"kubernetes.io/projected/97737fad-381c-4093-a34e-79ed9742dc4a-kube-api-access-qsqxw\") pod \"must-gather-5qvhj\" (UID: \"97737fad-381c-4093-a34e-79ed9742dc4a\") " pod="openshift-must-gather-bl84r/must-gather-5qvhj"
Aug 01 01:27:16.174046 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.174022    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/97737fad-381c-4093-a34e-79ed9742dc4a-must-gather-output\") pod \"must-gather-5qvhj\" (UID: \"97737fad-381c-4093-a34e-79ed9742dc4a\") " pod="openshift-must-gather-bl84r/must-gather-5qvhj"
Aug 01 01:27:16.174146 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.174058    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsqxw\" (UniqueName: \"kubernetes.io/projected/97737fad-381c-4093-a34e-79ed9742dc4a-kube-api-access-qsqxw\") pod \"must-gather-5qvhj\" (UID: \"97737fad-381c-4093-a34e-79ed9742dc4a\") " pod="openshift-must-gather-bl84r/must-gather-5qvhj"
Aug 01 01:27:16.174366 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.174348    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/97737fad-381c-4093-a34e-79ed9742dc4a-must-gather-output\") pod \"must-gather-5qvhj\" (UID: \"97737fad-381c-4093-a34e-79ed9742dc4a\") " pod="openshift-must-gather-bl84r/must-gather-5qvhj"
Aug 01 01:27:16.187442 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.187423    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsqxw\" (UniqueName: \"kubernetes.io/projected/97737fad-381c-4093-a34e-79ed9742dc4a-kube-api-access-qsqxw\") pod \"must-gather-5qvhj\" (UID: \"97737fad-381c-4093-a34e-79ed9742dc4a\") " pod="openshift-must-gather-bl84r/must-gather-5qvhj"
Aug 01 01:27:16.335411 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.335345    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bl84r/must-gather-5qvhj"
Aug 01 01:27:16.474838 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.474811    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bl84r/must-gather-5qvhj"]
Aug 01 01:27:16.475944 ip-10-0-131-26 kubenswrapper[2547]: W0801 01:27:16.475897    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97737fad_381c_4093_a34e_79ed9742dc4a.slice/crio-ebb86a0995fde5c5e55a617f163e415ccef49189405c82de02c2df7af273cc4c WatchSource:0}: Error finding container ebb86a0995fde5c5e55a617f163e415ccef49189405c82de02c2df7af273cc4c: Status 404 returned error can't find the container with id ebb86a0995fde5c5e55a617f163e415ccef49189405c82de02c2df7af273cc4c
Aug 01 01:27:16.639103 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:16.639039    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bl84r/must-gather-5qvhj" event={"ID":"97737fad-381c-4093-a34e-79ed9742dc4a","Type":"ContainerStarted","Data":"ebb86a0995fde5c5e55a617f163e415ccef49189405c82de02c2df7af273cc4c"}
Aug 01 01:27:17.649645 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:17.649510    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bl84r/must-gather-5qvhj" event={"ID":"97737fad-381c-4093-a34e-79ed9742dc4a","Type":"ContainerStarted","Data":"95419d57c08359de81a33d2686b3c4f598ce752bad20353f3539ff0972b02da1"}
Aug 01 01:27:17.649645 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:17.649567    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bl84r/must-gather-5qvhj" event={"ID":"97737fad-381c-4093-a34e-79ed9742dc4a","Type":"ContainerStarted","Data":"b003e748d20f76e776edb5e4b6f38ce45a8dccf2987911b5aa2ec0c6fb30feee"}
Aug 01 01:27:17.666396 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:17.666334    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bl84r/must-gather-5qvhj" podStartSLOduration=1.88690867 podStartE2EDuration="2.666315513s" totalImagesPullingTime="779.406843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 01:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:27:17.664875666 +0000 UTC m=+3506.362044723" watchObservedRunningTime="2026-08-01 01:27:17.666315513 +0000 UTC m=+3506.363484576"
Aug 01 01:27:18.789094 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:18.789065    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k64vg_33c5e0f2-39ae-4f8d-a811-ffcd53e43241/global-pull-secret-syncer/0.log"
Aug 01 01:27:18.962028 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:18.961988    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zb65f_e1eae6f6-d17e-4028-b187-9f14b5ef1640/konnectivity-agent/0.log"
Aug 01 01:27:19.008968 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:19.008923    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-26.ec2.internal_af271ecab387b6c0bf980ddd473c7e57/haproxy/0.log"
Aug 01 01:27:24.076085 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:24.076047    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-qx9k2_9e1dc749-58ac-4ccf-b027-26583ea9e85b/manager/0.log"
Aug 01 01:27:24.101567 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:24.101527    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-96bk4_3006f723-6ec2-4db8-abab-f9f49c02f47c/manager/0.log"
Aug 01 01:27:24.336392 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:24.335086    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-lbqdq_83eb1d46-55b2-47ff-bb1d-17224ba7c47c/manager/0.log"
Aug 01 01:27:25.791697 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:25.791573    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edc211e1-5bbe-4658-b671-90fe0fcc0fb6/alertmanager/0.log"
Aug 01 01:27:25.817370 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:25.817324    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edc211e1-5bbe-4658-b671-90fe0fcc0fb6/config-reloader/0.log"
Aug 01 01:27:25.837988 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:25.837962    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edc211e1-5bbe-4658-b671-90fe0fcc0fb6/kube-rbac-proxy-web/0.log"
Aug 01 01:27:25.858537 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:25.858512    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edc211e1-5bbe-4658-b671-90fe0fcc0fb6/kube-rbac-proxy/0.log"
Aug 01 01:27:25.880823 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:25.880797    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edc211e1-5bbe-4658-b671-90fe0fcc0fb6/kube-rbac-proxy-metric/0.log"
Aug 01 01:27:25.902837 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:25.902803    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edc211e1-5bbe-4658-b671-90fe0fcc0fb6/prom-label-proxy/0.log"
Aug 01 01:27:25.932360 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:25.932329    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_edc211e1-5bbe-4658-b671-90fe0fcc0fb6/init-config-reloader/0.log"
Aug 01 01:27:26.244299 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.244262    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cs7pq_9b2a9172-9b05-4e41-b31f-28a1736f845f/node-exporter/0.log"
Aug 01 01:27:26.264818 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.264768    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cs7pq_9b2a9172-9b05-4e41-b31f-28a1736f845f/kube-rbac-proxy/0.log"
Aug 01 01:27:26.297413 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.297388    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cs7pq_9b2a9172-9b05-4e41-b31f-28a1736f845f/init-textfile/0.log"
Aug 01 01:27:26.490780 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.490743    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdqks_3fb050a6-76b9-4a6b-924d-b4b34ddffdee/kube-rbac-proxy-main/0.log"
Aug 01 01:27:26.510548 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.510519    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdqks_3fb050a6-76b9-4a6b-924d-b4b34ddffdee/kube-rbac-proxy-self/0.log"
Aug 01 01:27:26.532291 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.532265    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdqks_3fb050a6-76b9-4a6b-924d-b4b34ddffdee/openshift-state-metrics/0.log"
Aug 01 01:27:26.739987 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.739960    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-v5lf7_830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32/prometheus-operator/0.log"
Aug 01 01:27:26.756638 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.756567    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-v5lf7_830d9c7f-70f3-4dfb-b3cc-c9e8105d6f32/kube-rbac-proxy/0.log"
Aug 01 01:27:26.778864 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:26.778834    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-k4tpk_07736491-4551-4022-90f2-d0de1025a057/prometheus-operator-admission-webhook/0.log"
Aug 01 01:27:28.279782 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:28.279746    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-zcg7s_6e3768ff-b3a0-4c74-ad8e-5e6e86fe1ba1/networking-console-plugin/0.log"
Aug 01 01:27:28.873379 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:28.873344    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/1.log"
Aug 01 01:27:28.880221 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:28.880182    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-855l6_3ade4353-b324-47a7-b522-4e3923b3fee4/console-operator/2.log"
Aug 01 01:27:29.104629 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.104598    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"]
Aug 01 01:27:29.113049 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.113017    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.118629 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.118590    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"]
Aug 01 01:27:29.226099 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.226063    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-podres\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.226269 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.226131    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgpg4\" (UniqueName: \"kubernetes.io/projected/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-kube-api-access-vgpg4\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.226269 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.226257    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-sys\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.226362 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.226323    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-proc\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.226410 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.226386    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-lib-modules\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.327890 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.327853    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-podres\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.328358 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.328060    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-podres\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.328358 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.328244    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgpg4\" (UniqueName: \"kubernetes.io/projected/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-kube-api-access-vgpg4\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.328358 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.328338    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-sys\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.328558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.328396    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-proc\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.328558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.328460    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-lib-modules\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.328558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.328514    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-proc\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.328558 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.328458    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-sys\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.328720 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.328603    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-lib-modules\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.335731 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.335700    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgpg4\" (UniqueName: \"kubernetes.io/projected/1d7f0e8b-9b57-4cbb-840d-b7e81861b86e-kube-api-access-vgpg4\") pod \"perf-node-gather-daemonset-kg27n\" (UID: \"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e\") " pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.428349 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.428313    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.435057 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.435032    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57669c5d78-t8dnt_a19dc22e-204d-4607-af7f-3ac73a366d1e/console/0.log"
Aug 01 01:27:29.485589 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.485435    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-qd5rp_cdcb61b8-e5d8-4b99-bb9a-4cb4454cf7fe/download-server/0.log"
Aug 01 01:27:29.642255 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.640304    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"]
Aug 01 01:27:29.758544 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.757456    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n" event={"ID":"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e","Type":"ContainerStarted","Data":"22d8f6dfcab2333b1df466cd10e36c15ac5a5a52918bdb69d5ac11f0ecb3af4c"}
Aug 01 01:27:29.758544 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.757541    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n" event={"ID":"1d7f0e8b-9b57-4cbb-840d-b7e81861b86e","Type":"ContainerStarted","Data":"6ffba6cae09afbb25815f61259aee920b3ae279df8c68966f007fbdd8eb912f4"}
Aug 01 01:27:29.758544 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.757764    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:29.775205 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:29.775155    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n" podStartSLOduration=0.775141045 podStartE2EDuration="775.141045ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 01:27:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 01:27:29.773994922 +0000 UTC m=+3518.471163985" watchObservedRunningTime="2026-08-01 01:27:29.775141045 +0000 UTC m=+3518.472310110"
Aug 01 01:27:30.152155 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:30.152078    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-78cr7_dbf9d58e-afc2-4130-8f39-23568a253b94/volume-data-source-validator/0.log"
Aug 01 01:27:31.111043 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:31.111010    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d2kr9_53e0c425-c34c-4375-a04e-3b4531220873/dns/0.log"
Aug 01 01:27:31.129877 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:31.129855    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d2kr9_53e0c425-c34c-4375-a04e-3b4531220873/kube-rbac-proxy/0.log"
Aug 01 01:27:31.263350 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:31.263322    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4sf5_9090f9e3-ffe1-4eb1-abaa-6625aba20605/dns-node-resolver/0.log"
Aug 01 01:27:31.810782 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:31.810750    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f75947677-76hxl_af85d939-36a9-40c3-be87-c4359ad5c3c0/registry/0.log"
Aug 01 01:27:31.850263 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:31.850230    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hrxfd_5fa6833a-4696-48a2-8102-849e675d1988/node-ca/0.log"
Aug 01 01:27:32.772187 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:32.772154    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq_cef13b1c-89e2-40cf-ae1f-d2bc88bab124/istio-proxy/0.log"
Aug 01 01:27:32.979990 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:32.979965    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6db59d85d8-vzhv7_ceae8985-d97e-498c-8dfc-0e78377e2701/kube-auth-proxy/0.log"
Aug 01 01:27:33.011734 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:33.011699    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-75b9q_f8bad48f-e139-4854-a20c-dc666e8cef05/istio-proxy/0.log"
Aug 01 01:27:33.020501 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:33.020467    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-75b9q_f8bad48f-e139-4854-a20c-dc666e8cef05/istio-proxy/1.log"
Aug 01 01:27:33.077988 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:33.077922    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cd9b2_c6f1a116-ec4e-49c7-8e92-eec6259c8b20/payload-processing/0.log"
Aug 01 01:27:33.098086 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:33.098061    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df4f94764-jnbqw_21764f3a-5c04-4e8b-bfa9-d29e519ea939/router/0.log"
Aug 01 01:27:33.951804 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:33.951768    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-twdgh_6e27711d-9e58-4e1b-90c4-b39f5c43bf1d/serve-healthcheck-canary/0.log"
Aug 01 01:27:34.489749 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:34.489720    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f2g5z_b94ea98c-7710-4a28-afd6-a8782c08abd4/kube-rbac-proxy/0.log"
Aug 01 01:27:34.510077 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:34.510049    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f2g5z_b94ea98c-7710-4a28-afd6-a8782c08abd4/exporter/0.log"
Aug 01 01:27:34.530337 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:34.530313    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f2g5z_b94ea98c-7710-4a28-afd6-a8782c08abd4/extractor/0.log"
Aug 01 01:27:35.778361 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:35.778334    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bl84r/perf-node-gather-daemonset-kg27n"
Aug 01 01:27:36.641771 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:36.641742    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r2522_9bcba17e-63e7-4dd8-b5e6-72c72275d59f/manager/0.log"
Aug 01 01:27:36.933867 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:36.933777    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4vnbh_98133ebe-7180-4352-8a49-c26879bd13db/manager/0.log"
Aug 01 01:27:37.105969 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:37.105936    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mg8zz_75201471-272a-49d6-9dba-a68a7bec8941/server/0.log"
Aug 01 01:27:37.201434 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:37.201341    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w7qdm_8bddbbdb-9d58-4b4e-937a-1c5ea29cd4cb/manager/0.log"
Aug 01 01:27:37.223447 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:37.223415    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c56689d88-96v6q_20b4a17b-3459-4d57-9721-196dfa0deb3c/manager/0.log"
Aug 01 01:27:37.241879 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:37.241855    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c56689d88-96v6q_20b4a17b-3459-4d57-9721-196dfa0deb3c/copy-manifests/0.log"
Aug 01 01:27:38.838065 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:38.838030    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-g8q8f_477085dd-2dcd-4a8e-bbfa-9f8f299b144b/openshift-lws-operator/0.log"
Aug 01 01:27:39.379603 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:39.379571    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq_cef13b1c-89e2-40cf-ae1f-d2bc88bab124/istio-proxy/0.log"
Aug 01 01:27:39.563451 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:39.563385    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6db59d85d8-vzhv7_ceae8985-d97e-498c-8dfc-0e78377e2701/kube-auth-proxy/0.log"
Aug 01 01:27:39.594972 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:39.594942    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-75b9q_f8bad48f-e139-4854-a20c-dc666e8cef05/istio-proxy/0.log"
Aug 01 01:27:39.603847 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:39.603818    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-75b9q_f8bad48f-e139-4854-a20c-dc666e8cef05/istio-proxy/1.log"
Aug 01 01:27:39.647983 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:39.647952    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cd9b2_c6f1a116-ec4e-49c7-8e92-eec6259c8b20/payload-processing/0.log"
Aug 01 01:27:39.662269 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:39.662238    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df4f94764-jnbqw_21764f3a-5c04-4e8b-bfa9-d29e519ea939/router/0.log"
Aug 01 01:27:41.052386 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:41.052310    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8m9fq_cef13b1c-89e2-40cf-ae1f-d2bc88bab124/istio-proxy/0.log"
Aug 01 01:27:41.251156 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:41.251123    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6db59d85d8-vzhv7_ceae8985-d97e-498c-8dfc-0e78377e2701/kube-auth-proxy/0.log"
Aug 01 01:27:41.272260 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:41.272232    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-75b9q_f8bad48f-e139-4854-a20c-dc666e8cef05/istio-proxy/0.log"
Aug 01 01:27:41.280650 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:41.280627    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-75b9q_f8bad48f-e139-4854-a20c-dc666e8cef05/istio-proxy/1.log"
Aug 01 01:27:41.323437 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:41.323367    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cd9b2_c6f1a116-ec4e-49c7-8e92-eec6259c8b20/payload-processing/0.log"
Aug 01 01:27:41.340023 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:41.339991    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df4f94764-jnbqw_21764f3a-5c04-4e8b-bfa9-d29e519ea939/router/0.log"
Aug 01 01:27:44.098779 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:44.098743    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-54sb2_a2ceeaa9-1cfa-467d-adde-1769ebae2d7e/kube-storage-version-migrator-operator/1.log"
Aug 01 01:27:44.099621 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:44.099601    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-54sb2_a2ceeaa9-1cfa-467d-adde-1769ebae2d7e/kube-storage-version-migrator-operator/0.log"
Aug 01 01:27:45.180390 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.180359    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97dgd_15f4b06c-8a26-4bf9-8cc0-644523ef732c/kube-multus-additional-cni-plugins/0.log"
Aug 01 01:27:45.201080 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.201057    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97dgd_15f4b06c-8a26-4bf9-8cc0-644523ef732c/egress-router-binary-copy/0.log"
Aug 01 01:27:45.223016 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.222996    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97dgd_15f4b06c-8a26-4bf9-8cc0-644523ef732c/cni-plugins/0.log"
Aug 01 01:27:45.275351 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.275313    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97dgd_15f4b06c-8a26-4bf9-8cc0-644523ef732c/bond-cni-plugin/0.log"
Aug 01 01:27:45.295908 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.295880    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97dgd_15f4b06c-8a26-4bf9-8cc0-644523ef732c/routeoverride-cni/0.log"
Aug 01 01:27:45.316212 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.316186    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97dgd_15f4b06c-8a26-4bf9-8cc0-644523ef732c/whereabouts-cni-bincopy/0.log"
Aug 01 01:27:45.335804 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.335776    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-97dgd_15f4b06c-8a26-4bf9-8cc0-644523ef732c/whereabouts-cni/0.log"
Aug 01 01:27:45.709136 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.709109    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vfpdd_2b15bf55-b4d2-480c-8ebc-47ca150cbdc7/kube-multus/0.log"
Aug 01 01:27:45.761716 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.761686    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-677wl_e739675e-0789-44a5-bae6-b67926f611ef/network-metrics-daemon/0.log"
Aug 01 01:27:45.777205 ip-10-0-131-26 kubenswrapper[2547]: I0801 01:27:45.776454    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-677wl_e739675e-0789-44a5-bae6-b67926f611ef/kube-rbac-proxy/0.log"