Jul 27 18:31:40.524487 ip-10-0-131-150 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 18:31:40.934494 ip-10-0-131-150 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:31:40.934494 ip-10-0-131-150 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 18:31:40.934494 ip-10-0-131-150 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:31:40.934494 ip-10-0-131-150 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 18:31:40.934494 ip-10-0-131-150 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:31:40.935166 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.934505    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 18:31:40.938799 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938784    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:40.938799 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938799    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938803    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938808    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938810    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938813    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938816    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938818    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938821    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938823    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938826    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938829    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938831    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938834    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938837    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938840    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938842    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938845    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938851    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938853    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938856    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:40.938862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938858    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938861    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938863    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938866    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938869    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938872    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938875    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938877    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938880    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938883    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938885    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938889    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938892    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938894    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938897    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938902    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938905    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938908    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938911    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:40.939385 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938913    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938916    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938918    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938921    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938923    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938926    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938929    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938931    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938934    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938936    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938938    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938941    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938944    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938946    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938948    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938951    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938954    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938957    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938959    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938962    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:40.939862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938964    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938967    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938969    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938972    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938974    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938976    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938979    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938981    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938984    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938987    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938989    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938993    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938996    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.938998    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939001    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939003    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939006    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939008    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939011    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939013    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:40.940447 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939016    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939018    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939020    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939023    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939027    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939031    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939035    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939038    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939041    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939044    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939046    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939049    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939052    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939054    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939057    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939060    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939062    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939065    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:40.941074 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.939067    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941272    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941284    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941288    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941290    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941293    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941296    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941299    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941302    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941305    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941307    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941310    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941313    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941316    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941318    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941321    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941324    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941326    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941328    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941333    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:40.941580 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941336    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941339    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941342    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941346    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941348    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941357    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941360    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941363    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941366    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941368    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941371    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941373    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941375    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941378    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941381    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941384    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941387    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941389    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941392    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941395    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:40.942069 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941397    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941399    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941402    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941405    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941416    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941419    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941422    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941425    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941427    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941430    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941433    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941435    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941438    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941441    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941444    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941447    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941449    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941452    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941455    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941458    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:40.942675 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941460    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941463    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941465    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941468    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941470    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941473    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941476    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941479    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941481    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941484    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941487    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941489    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941492    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941494    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941497    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941499    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941502    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941504    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941508    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941511    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:40.943160 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941513    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941515    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941518    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941520    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941524    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941527    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941529    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941532    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941534    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941538    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941543    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941547    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941551    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941554    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941557    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941560    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941563    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941566    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941569    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:40.943669 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941571    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941957    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941962    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941965    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941968    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941970    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941973    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941976    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941978    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941982    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941986    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941988    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941991    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941994    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.941997    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942000    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942002    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942005    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942007    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942010    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:40.944123 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942012    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942015    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942017    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942020    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942022    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942026    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942028    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942031    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942033    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942036    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942039    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942042    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942044    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942047    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942050    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942052    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942054    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942057    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942059    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942062    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:40.944615 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942064    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942066    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942069    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942071    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942074    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942077    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942079    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942082    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942084    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942086    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942089    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942093    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942097    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942099    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942103    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942105    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942108    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942113    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942116    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:40.945102 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942119    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942122    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942125    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942128    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942132    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942135    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942137    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942140    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942142    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942145    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942147    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942149    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942152    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942154    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942157    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942159    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942161    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942164    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942166    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:40.945588 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942169    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942171    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942174    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942192    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942194    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942197    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942200    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942202    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942205    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942208    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942210    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942213    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942215    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942218    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942220    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942223    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942225    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942228    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942230    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942233    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:40.946036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942236    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942238    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942317    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942325    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942331    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942336    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942339    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942343    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942347    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942351    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942354    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942358    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942361    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942364    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942367    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942370    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942373    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942376    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942380    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942383    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942388    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942391    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942394    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942397    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 18:31:40.946567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942400    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942410    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942413    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942416    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942419    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942422    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942425    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942428    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942431    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942434    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942437    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942440    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942443    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942446    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942448    2577 flags.go:64] FLAG: --enable-server="true"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942451    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942456    2577 flags.go:64] FLAG: --event-burst="100"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942458    2577 flags.go:64] FLAG: --event-qps="50"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942461    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942464    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942467    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942470    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942473    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942476    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942479    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 27 18:31:40.947167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942481    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942484    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942487    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942491    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942493    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942496    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942499    2577 flags.go:64] FLAG: --feature-gates=""
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942503    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942506    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942510    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942512    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942515    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942518    2577 flags.go:64] FLAG: --help="false"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942521    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-131-150.ec2.internal"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942524    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942527    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942530    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942533    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942536    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942539    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942542    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942544    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942547    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 18:31:40.947793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942550    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942553    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942556    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942558    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942561    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942564    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942566    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942569    2577 flags.go:64] FLAG: --lock-file=""
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942571    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942574    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942577    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942582    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942588    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942591    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942593    2577 flags.go:64] FLAG: --logging-format="text"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942596    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942599    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942602    2577 flags.go:64] FLAG: --manifest-url=""
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942605    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942609    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942612    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942616    2577 flags.go:64] FLAG: --max-pods="110"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942619    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942622    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942624    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 18:31:40.948382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942627    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942630    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942633    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942636    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942643    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942646    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942649    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942651    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942654    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942659    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942662    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942665    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942668    2577 flags.go:64] FLAG: --port="10250"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942670    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942673    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0127df9f407d59bb7"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942676    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942679    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942682    2577 flags.go:64] FLAG: --register-node="true"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942685    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942690    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942694    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942696    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942699    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942703    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942705    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 18:31:40.948996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942708    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942711    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942714    2577 flags.go:64] FLAG: --runonce="false"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942717    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942719    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942722    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942725    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942728    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942731    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942733    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942736    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942739    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942741    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942744    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942747    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942750    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942752    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942755    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942760    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942762    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942765    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942769    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942771    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942774    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942776    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 18:31:40.949648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942779    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942783    2577 flags.go:64] FLAG: --v="2"
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942787    2577 flags.go:64] FLAG: --version="false"
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942792    2577 flags.go:64] FLAG: --vmodule=""
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942795    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.942798    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942909    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942913    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942916    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942919    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942923    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942925    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942928    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942931    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942934    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942936    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942938    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942941    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942943    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942946    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942948    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942951    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:40.950360 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942953    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942955    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942958    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942960    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942963    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942965    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942967    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942970    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942972    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942975    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942977    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942981    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942984    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942986    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942989    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942992    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942994    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.942997    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943001    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943004    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:40.950906 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943007    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943011    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943014    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943017    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943020    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943023    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943026    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943029    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943031    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943034    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943036    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943039    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943041    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943044    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943047    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943049    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943052    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943054    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943057    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:40.951420 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943059    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943061    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943064    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943067    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943070    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943073    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943075    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943078    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943082    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943085    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943088    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943093    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943095    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943098    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943101    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943103    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943106    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943108    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943111    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943113    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:40.951876 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943116    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943118    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943121    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943123    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943126    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943128    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943131    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943134    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943136    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943139    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943141    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943144    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943147    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943149    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943151    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943154    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943157    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943160    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943163    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943165    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:40.952376 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943168    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943172    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943175    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.943196    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.943818    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.950654    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.950671    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.950692    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.950699    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950754    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950759    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950764    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950768    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950771    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:40.952860 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950774    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950777    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950780    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950783    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950785    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950788    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950790    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950793    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950796    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950799    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950801    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950804    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950807    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950809    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950811    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950814    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950816    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950819    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950822    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950824    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:40.953226 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950827    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950829    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950832    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950835    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950838    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950841    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950843    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950846    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950848    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950851    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950853    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950855    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950858    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950860    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950863    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950867    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950870    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950873    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950876    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:40.953710 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950878    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950881    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950883    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950885    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950888    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950890    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950893    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950896    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950898    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950901    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950903    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950906    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950909    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950912    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950914    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950917    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950920    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950923    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950926    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950928    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:40.954193 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950931    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950934    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950936    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950938    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950941    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950943    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950946    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950948    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950951    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950953    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950955    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950958    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950960    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950962    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950965    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950967    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950970    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950972    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950975    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:40.954664 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950978    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950981    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950984    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950987    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950990    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950992    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950995    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.950998    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951001    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951004    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951007    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951009    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951013    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951015    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951017    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:40.955113 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951020    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.951025    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951146    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951150    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951153    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951155    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951158    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951160    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951163    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951165    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951168    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951170    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951173    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951175    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951198    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951201    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:40.955500 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951203    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951206    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951209    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951211    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951214    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951218    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951221    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951224    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951227    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951229    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951232    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951235    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951237    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951240    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951244    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951246    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951249    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951251    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951254    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:40.955888 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951256    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951259    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951261    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951264    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951266    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951268    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951270    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951273    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951275    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951278    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951280    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951282    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951285    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951287    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951290    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951292    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951294    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951297    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951299    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:40.956370 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951302    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951304    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951306    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951309    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951311    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951314    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951318    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951321    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951324    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951327    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951330    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951332    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951334    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951337    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951339    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951341    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951344    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951346    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951349    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951351    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:40.956823 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951353    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951356    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951358    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951360    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951363    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951365    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951368    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951370    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951373    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951375    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951377    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951380    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951382    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951384    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951387    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951389    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951392    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951396    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951400    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:40.957317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951403    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951406    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951408    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951411    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951413    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951416    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951418    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:40.951420    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.951425    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.951533    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.954893    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.956432    2577 server.go:1019] "Starting client certificate rotation"
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.956535    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 18:31:40.957773 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.956576    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 18:31:40.958834 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.958820    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 18:31:40.960026 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.960012    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 18:31:40.967868 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.967847    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 27 18:31:40.970027 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.970011    2577 log.go:25] "Validated CRI v1 image API"
Jul 27 18:31:40.974131 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.974109    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 18:31:40.976384 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.976366    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 eade9362-ea85-4e74-89eb-c75ba67fbb1e:/dev/nvme0n1p4 fe3d3696-969a-4dfc-a0b8-3903d8d1de67:/dev/nvme0n1p3]
Jul 27 18:31:40.976435 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.976385    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 18:31:40.981505 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.981389    2577 manager.go:216] Machine: {Timestamp:2026-07-27 18:31:40.979951542 +0000 UTC m=+0.341479769 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088838 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28b3782fc6ec065bbeadc25e496fc3 SystemUUID:ec28b378-2fc6-ec06-5bbe-adc25e496fc3 BootID:0ab18097-1120-4feb-b80a-5b7fb7c8a186 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:c2:ee:5b:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:c2:ee:5b:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:bf:0d:14:0f:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 18:31:40.981505 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.981504    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 18:31:40.981606 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.981580    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 18:31:40.984700 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.984675    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 18:31:40.984843 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.984705    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-150.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 18:31:40.985455 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.985444    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 18:31:40.985493 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.985466    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 18:31:40.985493 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.985474    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 18:31:40.986148 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.986137    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 18:31:40.987099 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.987089    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 18:31:40.988428 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.988414    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 18:31:40.988943 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.988932    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 18:31:40.989071 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.989061    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 18:31:40.989100 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.989093    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 18:31:40.989127 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.989109    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 18:31:40.989127 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.989122    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 18:31:40.989176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.989131    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 27 18:31:40.989176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.989140    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 18:31:40.989578 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.989565    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 18:31:40.989624 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.989592    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 18:31:40.991565 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.991544    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 18:31:40.993381 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.993368    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 18:31:40.993453 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.993400    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 18:31:40.994845 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994826    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 18:31:40.994845 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994845    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994852    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994858    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994866    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994871    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994879    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994884    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994890    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994895    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994908    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 18:31:40.995020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.994914    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 18:31:40.995608 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.995597    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 18:31:40.995608 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.995608    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 18:31:40.998999 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.998985    2577 server.go:1268] "Started kubelet"
Jul 27 18:31:40.999091 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.999070    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 18:31:40.999669 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.999434    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 18:31:40.999814 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.999784    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-150.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 18:31:40.999866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:40.999813    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 18:31:40.999921 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:40.999873    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 18:31:40.999973 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:40.999939    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 18:31:41.001005 ip-10-0-131-150 systemd[1]: Started Kubernetes Kubelet.
Jul 27 18:31:41.001256 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.001222    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 18:31:41.004457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.003322    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 18:31:41.004457 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.003998    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 18:31:41.007690 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.006000    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-150.ec2.internal.18c6391d763454f9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-150.ec2.internal,UID:ip-10-0-131-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-27 18:31:40.998956281 +0000 UTC m=+0.360484508,LastTimestamp:2026-07-27 18:31:40.998956281 +0000 UTC m=+0.360484508,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 27 18:31:41.008991 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.008978    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 18:31:41.009060 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.008997    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 18:31:41.009105 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.009053    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:41.009543 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.009486    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 18:31:41.009624 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.009591    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 18:31:41.009624 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.009604    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 18:31:41.009727 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.009712    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 18:31:41.009727 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.009726    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 18:31:41.009826 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.009814    2577 factory.go:55] Registering systemd factory
Jul 27 18:31:41.010034 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.009828    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 27 18:31:41.010077 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.010067    2577 factory.go:153] Registering CRI-O factory
Jul 27 18:31:41.010077 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.010078    2577 factory.go:223] Registration of the crio container factory successfully
Jul 27 18:31:41.010157 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.010123    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 18:31:41.010157 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.010146    2577 factory.go:103] Registering Raw factory
Jul 27 18:31:41.010157 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.010156    2577 manager.go:1196] Started watching for new ooms in manager
Jul 27 18:31:41.010485 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.010471    2577 manager.go:349] Starting recovery of all containers
Jul 27 18:31:41.011843 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.011814    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 18:31:41.012016 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.011993    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 18:31:41.018740 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.018582    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6z4d5"
Jul 27 18:31:41.020566 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.020548    2577 manager.go:354] Recovery completed
Jul 27 18:31:41.025473 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.025461    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:41.027323 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.027307    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:41.027384 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.027341    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:41.027384 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.027352    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:41.027869 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.027850    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 18:31:41.027943 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.027869    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 18:31:41.027943 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.027887    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 18:31:41.027943 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.027861    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:41.028773 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.028759    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6z4d5"
Jul 27 18:31:41.029968 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.029955    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:41.030020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.029981    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:41.030020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.029996    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:41.030096 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.030044    2577 policy_none.go:49] "None policy: Start"
Jul 27 18:31:41.030096 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.030063    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 18:31:41.030096 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.030077    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 18:31:41.031319 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.031303    2577 policy_none.go:47] "Start"
Jul 27 18:31:41.068745 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.068727    2577 manager.go:337] "Starting Device Plugin manager"
Jul 27 18:31:41.068836 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.068756    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 18:31:41.068836 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.068765    2577 server.go:87] "Starting device plugin registration server"
Jul 27 18:31:41.069030 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.069019    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 18:31:41.069087 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.069031    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 18:31:41.069539 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.069218    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 18:31:41.069539 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.069300    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 18:31:41.069539 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.069308    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 18:31:41.069760 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.069739    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 18:31:41.069817 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.069792    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:41.169417 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.169385    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:41.170462 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.170344    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:41.170462 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.170372    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:41.170462 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.170382    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:41.170462 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.170407    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.180144 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.180126    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.180263 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.180149    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-150.ec2.internal\": node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:41.195696 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.195652    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:41.224228 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.224196    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 18:31:41.225611 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.225589    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 18:31:41.225676 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.225634    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 18:31:41.225676 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.225663    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 18:31:41.225774 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.225702    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 18:31:41.227925 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.227908    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:41.296599 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.296562    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:41.325978 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.325928    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"]
Jul 27 18:31:41.326116 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.326037    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:41.327610 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.327593    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:41.327714 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.327624    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:41.327714 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.327639    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:41.328808 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.328796    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:41.328955 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.328940    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.328993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.328971    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:41.329544 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.329530    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:41.329618 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.329560    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:41.329618 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.329571    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:41.329618 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.329531    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:41.329726 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.329629    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:41.329726 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.329640    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:41.330862 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.330849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.330929 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.330872    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:41.331586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.331568    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:41.331664 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.331595    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:41.331664 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.331606    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:41.355791 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.355768    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-150.ec2.internal\" not found" node="ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.360062 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.360048    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-150.ec2.internal\" not found" node="ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.397652 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.397632    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:41.411454 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.411429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.411526 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.411463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.411526 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.411483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1188e37e92b4900d2886b98231ddef72-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"1188e37e92b4900d2886b98231ddef72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.498470 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.498382    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:41.511779 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.511746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.511904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.511778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.511904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.511818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1188e37e92b4900d2886b98231ddef72-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"1188e37e92b4900d2886b98231ddef72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.511904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.511841    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.511904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.511848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1188e37e92b4900d2886b98231ddef72-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"1188e37e92b4900d2886b98231ddef72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.511904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.511867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.598949 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.598906    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:41.658411 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.658380    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.665213 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:41.665174    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:41.700049 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:41.700022    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:43.078735 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:43.078709    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:43.179212 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:43.179181    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:43.233649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.233628    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 18:31:43.234185 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.233776    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 18:31:43.279304 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:43.279279    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:43.311662 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.311591    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 18:26:42 +0000 UTC" deadline="2028-03-13 12:45:46.635960986 +0000 UTC"
Jul 27 18:31:43.311662 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.311622    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14274h14m3.324342066s"
Jul 27 18:31:43.379884 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:43.379865    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:43.480370 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:43.480341    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 27 18:31:43.497246 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.497226    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:43.534192 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.534168    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:43.576863 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:43.576834    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8b400053bfa9f9c637aaf70e5d75ea.slice/crio-12012a27dc95acde59e2279254992912c9a1cc5d180f65a83fa30584431eeab0 WatchSource:0}: Error finding container 12012a27dc95acde59e2279254992912c9a1cc5d180f65a83fa30584431eeab0: Status 404 returned error can't find the container with id 12012a27dc95acde59e2279254992912c9a1cc5d180f65a83fa30584431eeab0
Jul 27 18:31:43.580757 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.580734    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:31:43.587996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.587977    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:43.599883 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.599868    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 18:31:43.601726 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.601712    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 27 18:31:43.617608 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.617590    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 18:31:43.690715 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:43.690679    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1188e37e92b4900d2886b98231ddef72.slice/crio-c1858c2b655f91f84302fd4ab91595710f9c07215fef031d7617c169ad01e7cc WatchSource:0}: Error finding container c1858c2b655f91f84302fd4ab91595710f9c07215fef031d7617c169ad01e7cc: Status 404 returned error can't find the container with id c1858c2b655f91f84302fd4ab91595710f9c07215fef031d7617c169ad01e7cc
Jul 27 18:31:43.709843 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:43.709825    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:44.268307 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.268277    2577 apiserver.go:52] "Watching apiserver"
Jul 27 18:31:44.279923 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.279106    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 18:31:44.279923 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.279609    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-qkmnw","kube-system/global-pull-secret-syncer-5ptpt","kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt","openshift-dns/node-resolver-9hsjf","openshift-image-registry/node-ca-g8n6m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-lxqgm","kube-system/konnectivity-agent-st8t2","openshift-cluster-node-tuning-operator/tuned-wkrr8","openshift-multus/multus-additional-cni-plugins-jmwqb","openshift-multus/multus-tnskz","openshift-multus/network-metrics-daemon-qpflx","openshift-network-diagnostics/network-check-target-74v82"]
Jul 27 18:31:44.282362 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.281838    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.283441 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.283402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:44.283541 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.283497    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:31:44.284727 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.284587    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jh7mt\""
Jul 27 18:31:44.284930 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.284830    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:31:44.285023 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.284994    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 18:31:44.285151 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.285138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:44.285211 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.285193    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:44.286210 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.286143    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.289640 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.289030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.289640 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.289107    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 18:31:44.289784 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.289753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.292086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.290461    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:31:44.292086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.291618    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 18:31:44.292086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.291820    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hz5m7\""
Jul 27 18:31:44.292086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.291855    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 18:31:44.292086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.291884    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 18:31:44.292366 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.292286    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 18:31:44.292488 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.292467    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xdwfh\""
Jul 27 18:31:44.294074 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.294011    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 18:31:44.294074 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.294017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99mjx\""
Jul 27 18:31:44.294203 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.294190    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 18:31:44.294203 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.294195    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 18:31:44.294326 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.294311    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 18:31:44.294494 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.294476    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 18:31:44.294730 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.294711    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 18:31:44.294867 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.294772    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8b957\""
Jul 27 18:31:44.295019 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.295001    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.296777 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.296756    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.296861 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.296824    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:31:44.298725 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.298703    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 18:31:44.298895 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.298874    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 18:31:44.299085 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a1260a-8b69-41bf-9987-75c97f0c3bbb-tmp\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299155 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-hosts-file\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.299155 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysctl-d\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299155 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:44.299262 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-sys-fs\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.299262 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-tmp-dir\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.299262 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-host\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.299262 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-systemd\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299375 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-sys\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299375 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-tuned\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299375 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-etc-selinux\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.299375 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-modprobe-d\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299375 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-lib-modules\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299375 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk6n4\" (UniqueName: \"kubernetes.io/projected/7daab18b-6c87-4142-986f-fc177bd358f4-kube-api-access-bk6n4\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-device-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nptbv\" (UniqueName: \"kubernetes.io/projected/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-kube-api-access-nptbv\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-serviceca\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-var-lib-kubelet\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299519    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-host\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-socket-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-kubernetes\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysctl-conf\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcgvr\" (UniqueName: \"kubernetes.io/projected/19a1260a-8b69-41bf-9987-75c97f0c3bbb-kube-api-access-zcgvr\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x5tq\" (UniqueName: \"kubernetes.io/projected/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-kube-api-access-7x5tq\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.299649 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysconfig\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.300161 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.300161 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-registration-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.300161 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsqcx\" (UniqueName: \"kubernetes.io/projected/d175880a-3cb1-4705-93c2-f6d530a7bf98-kube-api-access-lsqcx\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.300161 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.299737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-run\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.300275 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.300211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 18:31:44.300390 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.300377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jwjqh\""
Jul 27 18:31:44.300957 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.300526    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 18:31:44.300957 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.300612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.300957 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.300530    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 18:31:44.300957 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.300617    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 18:31:44.301197 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.300995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.301651 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.301633    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.304286 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.304208    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:31:44.307456 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.307269    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 18:31:44.307766 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.307702    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 18:31:44.308016 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.307958    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 18:31:44.308095 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.308040    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 18:31:44.308266 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.308247    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 18:31:44.308339 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.308309    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 18:31:44.308681 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.308662    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n7qqs\""
Jul 27 18:31:44.308794 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.308775    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 18:31:44.308858 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.308836    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7r7qn\""
Jul 27 18:31:44.308999 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.308983    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 18:31:44.309086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.309070    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8jjp2\""
Jul 27 18:31:44.311549 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.310461    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 18:31:44.331587 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.331565    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:44.332254 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.332230    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9gmtm"
Jul 27 18:31:44.339671 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.339646    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9gmtm"
Jul 27 18:31:44.388916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.388894    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 18:31:44.400357 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-cni-bin\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.400485 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-hostroot\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.400485 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-sys\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.400485 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-etc-selinux\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.400641 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-run-netns\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.400641 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-etc-kubernetes\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.400641 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-modprobe-d\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.400641 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-etc-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.400641 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-device-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.400852 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.400852 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.400852 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-kubelet\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.400852 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp8jv\" (UniqueName: \"kubernetes.io/projected/10448c7c-bc43-4b5e-9903-df965f107fd6-kube-api-access-lp8jv\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.400852 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400785    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-serviceca\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.400852 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-var-lib-kubelet\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.400852 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-log-socket\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-system-cni-dir\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10448c7c-bc43-4b5e-9903-df965f107fd6-cni-binary-copy\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-kubernetes\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcgvr\" (UniqueName: \"kubernetes.io/projected/19a1260a-8b69-41bf-9987-75c97f0c3bbb-kube-api-access-zcgvr\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.400986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovnkube-config\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78395132-dfac-42c9-8879-7eeea71db0d2-iptables-alerter-script\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-cni-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-k8s-cni-cncf-io\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysconfig\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.401142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsqcx\" (UniqueName: \"kubernetes.io/projected/d175880a-3cb1-4705-93c2-f6d530a7bf98-kube-api-access-lsqcx\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-slash\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-ovn\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51c944a0-a2c5-4d5b-b6a7-319785065563-kubelet-config\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lclh4\" (UniqueName: \"kubernetes.io/projected/78395132-dfac-42c9-8879-7eeea71db0d2-kube-api-access-lclh4\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-cni-multus\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-run\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a1260a-8b69-41bf-9987-75c97f0c3bbb-tmp\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-hosts-file\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401484    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-systemd-units\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.401586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-node-log\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.402090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401689    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.402090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-sys\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.402090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401754    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.402090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-etc-selinux\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.402090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-kubernetes\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.402090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp7fg\" (UniqueName: \"kubernetes.io/projected/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-kube-api-access-dp7fg\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.402090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.401932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:44.402653 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-kubelet\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.402727 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-os-release\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.402783 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-system-cni-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.402783 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-socket-dir-parent\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.402880 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-daemon-config\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.402880 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-serviceca\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.402880 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-host\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.403013 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-systemd\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.403013 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-run\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.403013 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.402915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-tuned\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.403013 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovnkube-script-lib\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.403185 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51c944a0-a2c5-4d5b-b6a7-319785065563-dbus\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.403185 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.403185 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-multus-certs\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.403185 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-lib-modules\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.403349 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:44.403349 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403212    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 18:31:44.403457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403349    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-systemd\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.403457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403392    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-hosts-file\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.403457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-lib-modules\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.403590 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-var-lib-kubelet\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.403943 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403918    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-host\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.404000 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.404070 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.404054    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:44.404142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-device-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.404181 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.404157    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs podName:7daab18b-6c87-4142-986f-fc177bd358f4 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:44.904132118 +0000 UTC m=+2.987414961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs") pod "network-metrics-daemon-qpflx" (UID: "7daab18b-6c87-4142-986f-fc177bd358f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:44.404279 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-modprobe-d\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.404383 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.403229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk6n4\" (UniqueName: \"kubernetes.io/projected/7daab18b-6c87-4142-986f-fc177bd358f4-kube-api-access-bk6n4\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:44.404461 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-conf-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.404527 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysconfig\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.404735 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nptbv\" (UniqueName: \"kubernetes.io/projected/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-kube-api-access-nptbv\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.404840 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-var-lib-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.404886 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovn-node-metrics-cert\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.404936 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-host\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.404986 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-socket-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.405031 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.404994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-cni-netd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.405031 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-host\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.405142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pjd\" (UniqueName: \"kubernetes.io/projected/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-kube-api-access-z9pjd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.405142 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-cnibin\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.405203 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-os-release\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.405203 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysctl-conf\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.405281 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-systemd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.405281 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.405342 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-env-overrides\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.405342 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405319    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysctl-conf\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.405342 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78395132-dfac-42c9-8879-7eeea71db0d2-host-slash\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.405342 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-socket-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.405528 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.405528 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-netns\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.405528 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x5tq\" (UniqueName: \"kubernetes.io/projected/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-kube-api-access-7x5tq\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.405528 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-registration-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.405711 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.405711 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-registration-dir\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.405711 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-cni-bin\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.405818 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4-agent-certs\") pod \"konnectivity-agent-st8t2\" (UID: \"b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4\") " pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:31:44.405818 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysctl-d\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.405917 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-sys-fs\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.406189 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.406107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-tmp-dir\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.406189 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.405996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d175880a-3cb1-4705-93c2-f6d530a7bf98-sys-fs\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.406189 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.406157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cnibin\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.406367 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.406078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-sysctl-d\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.406367 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.406252    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4-konnectivity-ca\") pod \"konnectivity-agent-st8t2\" (UID: \"b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4\") " pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:31:44.406504 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.406469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-tmp-dir\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.408734 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.408709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19a1260a-8b69-41bf-9987-75c97f0c3bbb-etc-tuned\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.410317 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.410278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a1260a-8b69-41bf-9987-75c97f0c3bbb-tmp\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.414701 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.414656    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:44.414701 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.414677    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:44.414701 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.414691    2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmzhh for pod openshift-network-diagnostics/network-check-target-74v82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:44.414889 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.414756    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh podName:4526b4d9-da7e-4194-9be5-5e26ead6d730 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:44.914739419 +0000 UTC m=+2.998022264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qmzhh" (UniqueName: "kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh") pod "network-check-target-74v82" (UID: "4526b4d9-da7e-4194-9be5-5e26ead6d730") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:44.419097 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.419074    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x5tq\" (UniqueName: \"kubernetes.io/projected/81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f-kube-api-access-7x5tq\") pod \"node-ca-g8n6m\" (UID: \"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f\") " pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.420312 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.420293    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsqcx\" (UniqueName: \"kubernetes.io/projected/d175880a-3cb1-4705-93c2-f6d530a7bf98-kube-api-access-lsqcx\") pod \"aws-ebs-csi-driver-node-qfkbt\" (UID: \"d175880a-3cb1-4705-93c2-f6d530a7bf98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.421503 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.421481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcgvr\" (UniqueName: \"kubernetes.io/projected/19a1260a-8b69-41bf-9987-75c97f0c3bbb-kube-api-access-zcgvr\") pod \"tuned-wkrr8\" (UID: \"19a1260a-8b69-41bf-9987-75c97f0c3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.423036 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.423014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nptbv\" (UniqueName: \"kubernetes.io/projected/f1f8451a-5cfb-4406-bddf-f5d36e4b02eb-kube-api-access-nptbv\") pod \"node-resolver-9hsjf\" (UID: \"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb\") " pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.425347 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.425321    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk6n4\" (UniqueName: \"kubernetes.io/projected/7daab18b-6c87-4142-986f-fc177bd358f4-kube-api-access-bk6n4\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:44.506991 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.506953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-log-socket\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507160 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.506999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-system-cni-dir\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.507160 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10448c7c-bc43-4b5e-9903-df965f107fd6-cni-binary-copy\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.507160 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovnkube-config\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507160 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78395132-dfac-42c9-8879-7eeea71db0d2-iptables-alerter-script\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.507160 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-log-socket\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507160 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-cni-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.507160 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-k8s-cni-cncf-io\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-slash\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-ovn\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51c944a0-a2c5-4d5b-b6a7-319785065563-kubelet-config\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lclh4\" (UniqueName: \"kubernetes.io/projected/78395132-dfac-42c9-8879-7eeea71db0d2-kube-api-access-lclh4\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-cni-multus\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-systemd-units\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-node-log\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp7fg\" (UniqueName: \"kubernetes.io/projected/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-kube-api-access-dp7fg\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-kubelet\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-os-release\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-system-cni-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.507547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-socket-dir-parent\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-daemon-config\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovnkube-script-lib\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51c944a0-a2c5-4d5b-b6a7-319785065563-dbus\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507700    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-multus-certs\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78395132-dfac-42c9-8879-7eeea71db0d2-iptables-alerter-script\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovnkube-config\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-conf-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10448c7c-bc43-4b5e-9903-df965f107fd6-cni-binary-copy\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-multus-certs\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507103    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-system-cni-dir\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-system-cni-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507861    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51c944a0-a2c5-4d5b-b6a7-319785065563-kubelet-config\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-slash\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-socket-dir-parent\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51c944a0-a2c5-4d5b-b6a7-319785065563-dbus\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507946    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-cni-multus\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-kubelet\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.507990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-cni-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-systemd-units\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-ovn\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-k8s-cni-cncf-io\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508385    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-os-release\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-var-lib-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-daemon-config\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508539    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-var-lib-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovn-node-metrics-cert\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508574    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-cni-netd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovnkube-script-lib\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-multus-conf-dir\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-cni-netd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.508993 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-node-log\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pjd\" (UniqueName: \"kubernetes.io/projected/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-kube-api-access-z9pjd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-cnibin\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-os-release\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-cnibin\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-systemd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-os-release\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508898    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-systemd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.508982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-env-overrides\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78395132-dfac-42c9-8879-7eeea71db0d2-host-slash\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509103    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78395132-dfac-42c9-8879-7eeea71db0d2-host-slash\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-netns\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-cni-bin\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.509987 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4-agent-certs\") pod \"konnectivity-agent-st8t2\" (UID: \"b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4\") " pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cnibin\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4-konnectivity-ca\") pod \"konnectivity-agent-st8t2\" (UID: \"b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4\") " pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-cni-bin\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-hostroot\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-run-netns\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-env-overrides\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cnibin\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509546    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-run-netns\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-cni-bin\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509880    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-hostroot\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-host-cni-bin\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-etc-kubernetes\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-etc-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-etc-kubernetes\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-etc-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.510866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-run-netns\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.509997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.510008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.510021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-kubelet\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.510030    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-run-openvswitch\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.510058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10448c7c-bc43-4b5e-9903-df965f107fd6-host-var-lib-kubelet\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.510060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp8jv\" (UniqueName: \"kubernetes.io/projected/10448c7c-bc43-4b5e-9903-df965f107fd6-kube-api-access-lp8jv\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.510117    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.510178    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret podName:51c944a0-a2c5-4d5b-b6a7-319785065563 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:45.010162757 +0000 UTC m=+3.093445603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret") pod "global-pull-secret-syncer-5ptpt" (UID: "51c944a0-a2c5-4d5b-b6a7-319785065563") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.510737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4-konnectivity-ca\") pod \"konnectivity-agent-st8t2\" (UID: \"b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4\") " pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:31:44.511541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.511368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-ovn-node-metrics-cert\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.512027 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.511892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" event={"ID":"1188e37e92b4900d2886b98231ddef72","Type":"ContainerStarted","Data":"c1858c2b655f91f84302fd4ab91595710f9c07215fef031d7617c169ad01e7cc"}
Jul 27 18:31:44.513156 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.513130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4-agent-certs\") pod \"konnectivity-agent-st8t2\" (UID: \"b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4\") " pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:31:44.513625 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.513602    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"3d8b400053bfa9f9c637aaf70e5d75ea","Type":"ContainerStarted","Data":"12012a27dc95acde59e2279254992912c9a1cc5d180f65a83fa30584431eeab0"}
Jul 27 18:31:44.518013 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.517736    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lclh4\" (UniqueName: \"kubernetes.io/projected/78395132-dfac-42c9-8879-7eeea71db0d2-kube-api-access-lclh4\") pod \"iptables-alerter-qkmnw\" (UID: \"78395132-dfac-42c9-8879-7eeea71db0d2\") " pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.518013 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.517945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pjd\" (UniqueName: \"kubernetes.io/projected/7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8-kube-api-access-z9pjd\") pod \"ovnkube-node-lxqgm\" (UID: \"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.518266 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.518234    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp7fg\" (UniqueName: \"kubernetes.io/projected/8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a-kube-api-access-dp7fg\") pod \"multus-additional-cni-plugins-jmwqb\" (UID: \"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a\") " pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.524791 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.524726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp8jv\" (UniqueName: \"kubernetes.io/projected/10448c7c-bc43-4b5e-9903-df965f107fd6-kube-api-access-lp8jv\") pod \"multus-tnskz\" (UID: \"10448c7c-bc43-4b5e-9903-df965f107fd6\") " pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.597312 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.597275    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkrr8"
Jul 27 18:31:44.606572 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:44.606546    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a1260a_8b69_41bf_9987_75c97f0c3bbb.slice/crio-8b5c5e5320ad70d4f79bc014ae517005f3cf0b23b41c7495725a5849281f60b6 WatchSource:0}: Error finding container 8b5c5e5320ad70d4f79bc014ae517005f3cf0b23b41c7495725a5849281f60b6: Status 404 returned error can't find the container with id 8b5c5e5320ad70d4f79bc014ae517005f3cf0b23b41c7495725a5849281f60b6
Jul 27 18:31:44.608056 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.607993    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt"
Jul 27 18:31:44.615817 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:44.615789    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd175880a_3cb1_4705_93c2_f6d530a7bf98.slice/crio-9ddb4bccc4240c75f23994bf2567d8dfb4932fe0ca4211b87c56113d95cd06d1 WatchSource:0}: Error finding container 9ddb4bccc4240c75f23994bf2567d8dfb4932fe0ca4211b87c56113d95cd06d1: Status 404 returned error can't find the container with id 9ddb4bccc4240c75f23994bf2567d8dfb4932fe0ca4211b87c56113d95cd06d1
Jul 27 18:31:44.619496 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.619375    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmwqb"
Jul 27 18:31:44.625969 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.625946    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hsjf"
Jul 27 18:31:44.628187 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:44.628158    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7c1f68_3933_46d2_8c97_fce3ceb9cf1a.slice/crio-675d6396d72dec0a20413ce1d7458dfb6cee6ad205dc49a3afd6db3abd37fa63 WatchSource:0}: Error finding container 675d6396d72dec0a20413ce1d7458dfb6cee6ad205dc49a3afd6db3abd37fa63: Status 404 returned error can't find the container with id 675d6396d72dec0a20413ce1d7458dfb6cee6ad205dc49a3afd6db3abd37fa63
Jul 27 18:31:44.633733 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.633713    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8n6m"
Jul 27 18:31:44.636714 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:44.636675    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f8451a_5cfb_4406_bddf_f5d36e4b02eb.slice/crio-c97b95317a3ddef317b018927f466bcb8d2d367e302e3591ac5146648778778f WatchSource:0}: Error finding container c97b95317a3ddef317b018927f466bcb8d2d367e302e3591ac5146648778778f: Status 404 returned error can't find the container with id c97b95317a3ddef317b018927f466bcb8d2d367e302e3591ac5146648778778f
Jul 27 18:31:44.642418 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:44.642393    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b20ee1_9827_4fbe_9fa8_c8bc2825eb3f.slice/crio-83d44e319fe9df8d08841fda63cd806c2a66ce4bd1cc796e62f0528821782034 WatchSource:0}: Error finding container 83d44e319fe9df8d08841fda63cd806c2a66ce4bd1cc796e62f0528821782034: Status 404 returned error can't find the container with id 83d44e319fe9df8d08841fda63cd806c2a66ce4bd1cc796e62f0528821782034
Jul 27 18:31:44.645202 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.645180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:31:44.649203 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.649183    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:31:44.655806 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:44.655782    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29c9fff_aeed_4b9f_846d_8f4b8a1c5da4.slice/crio-dcbcce22d969d2858e66ae81637f2ffacabd9c4500a043898eb7e1e9cbcf17ea WatchSource:0}: Error finding container dcbcce22d969d2858e66ae81637f2ffacabd9c4500a043898eb7e1e9cbcf17ea: Status 404 returned error can't find the container with id dcbcce22d969d2858e66ae81637f2ffacabd9c4500a043898eb7e1e9cbcf17ea
Jul 27 18:31:44.657809 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.657787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qkmnw"
Jul 27 18:31:44.663695 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.663675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tnskz"
Jul 27 18:31:44.913168 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:44.913085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:44.913333 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.913234    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:44.913333 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:44.913306    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs podName:7daab18b-6c87-4142-986f-fc177bd358f4 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:45.913287541 +0000 UTC m=+3.996570369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs") pod "network-metrics-daemon-qpflx" (UID: "7daab18b-6c87-4142-986f-fc177bd358f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:45.013870 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.013826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:45.014038 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.013884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:45.014038 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.014012    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:45.014038 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.014033    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:45.014199 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.014055    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:45.014199 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.014068    2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmzhh for pod openshift-network-diagnostics/network-check-target-74v82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:45.014199 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.014082    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret podName:51c944a0-a2c5-4d5b-b6a7-319785065563 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:46.014062885 +0000 UTC m=+4.097345716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret") pod "global-pull-secret-syncer-5ptpt" (UID: "51c944a0-a2c5-4d5b-b6a7-319785065563") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:45.014199 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.014120    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh podName:4526b4d9-da7e-4194-9be5-5e26ead6d730 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:46.01410411 +0000 UTC m=+4.097386941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmzhh" (UniqueName: "kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh") pod "network-check-target-74v82" (UID: "4526b4d9-da7e-4194-9be5-5e26ead6d730") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:45.341555 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.341499    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 18:26:44 +0000 UTC" deadline="2028-01-01 11:01:10.678253963 +0000 UTC"
Jul 27 18:31:45.341555 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.341551    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12544h29m25.336705756s"
Jul 27 18:31:45.504446 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.504361    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:45.504595 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.504499    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:45.504947 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.504922    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:45.505053 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.505023    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:31:45.516968 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.516937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8n6m" event={"ID":"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f","Type":"ContainerStarted","Data":"83d44e319fe9df8d08841fda63cd806c2a66ce4bd1cc796e62f0528821782034"}
Jul 27 18:31:45.518702 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.518669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hsjf" event={"ID":"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb","Type":"ContainerStarted","Data":"c97b95317a3ddef317b018927f466bcb8d2d367e302e3591ac5146648778778f"}
Jul 27 18:31:45.520153 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.520111    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerStarted","Data":"675d6396d72dec0a20413ce1d7458dfb6cee6ad205dc49a3afd6db3abd37fa63"}
Jul 27 18:31:45.523050 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.523023    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt" event={"ID":"d175880a-3cb1-4705-93c2-f6d530a7bf98","Type":"ContainerStarted","Data":"9ddb4bccc4240c75f23994bf2567d8dfb4932fe0ca4211b87c56113d95cd06d1"}
Jul 27 18:31:45.524489 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.524461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkrr8" event={"ID":"19a1260a-8b69-41bf-9987-75c97f0c3bbb","Type":"ContainerStarted","Data":"8b5c5e5320ad70d4f79bc014ae517005f3cf0b23b41c7495725a5849281f60b6"}
Jul 27 18:31:45.526479 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.526456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-st8t2" event={"ID":"b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4","Type":"ContainerStarted","Data":"dcbcce22d969d2858e66ae81637f2ffacabd9c4500a043898eb7e1e9cbcf17ea"}
Jul 27 18:31:45.756788 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:45.756713    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a04b2c4_18c4_4d3d_81fe_662c4a42fbf8.slice/crio-b081ad6f60b17387d05ab91eb6baacc02cbd3b07d0219daf4f83b65a2d45dd83 WatchSource:0}: Error finding container b081ad6f60b17387d05ab91eb6baacc02cbd3b07d0219daf4f83b65a2d45dd83: Status 404 returned error can't find the container with id b081ad6f60b17387d05ab91eb6baacc02cbd3b07d0219daf4f83b65a2d45dd83
Jul 27 18:31:45.771980 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:45.771948    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78395132_dfac_42c9_8879_7eeea71db0d2.slice/crio-1f214d0f906e71036b5a0f0f79636588ce221a00a5f65d66194b0adc995df2cf WatchSource:0}: Error finding container 1f214d0f906e71036b5a0f0f79636588ce221a00a5f65d66194b0adc995df2cf: Status 404 returned error can't find the container with id 1f214d0f906e71036b5a0f0f79636588ce221a00a5f65d66194b0adc995df2cf
Jul 27 18:31:45.774671 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:31:45.774645    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10448c7c_bc43_4b5e_9903_df965f107fd6.slice/crio-1caee63d681e3f7a58448f460d749c090aa9f645f84cf68b684ac487f990bc56 WatchSource:0}: Error finding container 1caee63d681e3f7a58448f460d749c090aa9f645f84cf68b684ac487f990bc56: Status 404 returned error can't find the container with id 1caee63d681e3f7a58448f460d749c090aa9f645f84cf68b684ac487f990bc56
Jul 27 18:31:45.921180 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:45.920789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:45.921180 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.921097    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:45.921180 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:45.921162    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs podName:7daab18b-6c87-4142-986f-fc177bd358f4 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:47.921142185 +0000 UTC m=+6.004425033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs") pod "network-metrics-daemon-qpflx" (UID: "7daab18b-6c87-4142-986f-fc177bd358f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:46.022822 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.021630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:46.022822 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.021699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:46.022822 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:46.021849    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:46.022822 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:46.021875    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:46.022822 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:46.021889    2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmzhh for pod openshift-network-diagnostics/network-check-target-74v82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:46.022822 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:46.021948    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh podName:4526b4d9-da7e-4194-9be5-5e26ead6d730 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:48.021930867 +0000 UTC m=+6.105213701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmzhh" (UniqueName: "kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh") pod "network-check-target-74v82" (UID: "4526b4d9-da7e-4194-9be5-5e26ead6d730") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:46.022822 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:46.022340    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:46.022822 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:46.022390    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret podName:51c944a0-a2c5-4d5b-b6a7-319785065563 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:48.022375618 +0000 UTC m=+6.105658447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret") pod "global-pull-secret-syncer-5ptpt" (UID: "51c944a0-a2c5-4d5b-b6a7-319785065563") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:46.342795 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.342741    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 18:26:44 +0000 UTC" deadline="2028-02-11 07:27:48.056370152 +0000 UTC"
Jul 27 18:31:46.342795 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.342775    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13524h56m1.713599193s"
Jul 27 18:31:46.506612 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.506458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:46.506612 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:46.506581    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:31:46.534819 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.534731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qkmnw" event={"ID":"78395132-dfac-42c9-8879-7eeea71db0d2","Type":"ContainerStarted","Data":"1f214d0f906e71036b5a0f0f79636588ce221a00a5f65d66194b0adc995df2cf"}
Jul 27 18:31:46.539651 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.539514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"b081ad6f60b17387d05ab91eb6baacc02cbd3b07d0219daf4f83b65a2d45dd83"}
Jul 27 18:31:46.550455 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.549586    2577 generic.go:356] "Generic (PLEG): container finished" podID="3d8b400053bfa9f9c637aaf70e5d75ea" containerID="c5f561970a0b59ff36ea07ac6566e1ada21f3e14b12913cac95418d29d094c9d" exitCode=0
Jul 27 18:31:46.550455 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.549672    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"3d8b400053bfa9f9c637aaf70e5d75ea","Type":"ContainerDied","Data":"c5f561970a0b59ff36ea07ac6566e1ada21f3e14b12913cac95418d29d094c9d"}
Jul 27 18:31:46.554816 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.554786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tnskz" event={"ID":"10448c7c-bc43-4b5e-9903-df965f107fd6","Type":"ContainerStarted","Data":"1caee63d681e3f7a58448f460d749c090aa9f645f84cf68b684ac487f990bc56"}
Jul 27 18:31:46.564420 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:46.563952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" event={"ID":"1188e37e92b4900d2886b98231ddef72","Type":"ContainerStarted","Data":"90179a2a940f19ea0310d83e7df904f1b174fe0d115d63b672834efa5a2033f0"}
Jul 27 18:31:47.504830 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:47.504798    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:47.505278 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:47.505006    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:47.505821 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:47.505794    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:47.506049 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:47.505987    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:31:47.940140 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:47.939604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:47.940140 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:47.939751    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:47.940140 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:47.939810    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs podName:7daab18b-6c87-4142-986f-fc177bd358f4 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:51.93979097 +0000 UTC m=+10.023073813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs") pod "network-metrics-daemon-qpflx" (UID: "7daab18b-6c87-4142-986f-fc177bd358f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:48.040734 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:48.040701    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:48.040904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:48.040765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:48.040979 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:48.040940    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:48.040979 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:48.040958    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:48.040979 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:48.040971    2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmzhh for pod openshift-network-diagnostics/network-check-target-74v82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:48.041121 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:48.041027    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh podName:4526b4d9-da7e-4194-9be5-5e26ead6d730 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:52.041009077 +0000 UTC m=+10.124291928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmzhh" (UniqueName: "kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh") pod "network-check-target-74v82" (UID: "4526b4d9-da7e-4194-9be5-5e26ead6d730") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:48.041369 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:48.041285    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:48.041369 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:48.041350    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret podName:51c944a0-a2c5-4d5b-b6a7-319785065563 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:52.041333713 +0000 UTC m=+10.124616560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret") pod "global-pull-secret-syncer-5ptpt" (UID: "51c944a0-a2c5-4d5b-b6a7-319785065563") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:48.506553 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:48.504604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:48.506553 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:48.504736    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:31:49.505011 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:49.504943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:49.505187 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:49.505037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:49.505187 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:49.505162    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:31:49.505417 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:49.505354    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:50.508521 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:50.508443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:50.508951 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:50.508569    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:31:51.504487 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:51.504387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:51.504487 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:51.504443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:51.504700 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:51.504578    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:31:51.504753 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:51.504702    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:51.976003 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:51.975928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:51.976494 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:51.976147    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:51.976494 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:51.976219    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs podName:7daab18b-6c87-4142-986f-fc177bd358f4 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:59.976197779 +0000 UTC m=+18.059480611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs") pod "network-metrics-daemon-qpflx" (UID: "7daab18b-6c87-4142-986f-fc177bd358f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:52.076403 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:52.076358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:52.076584 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:52.076478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:52.076647 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:52.076610    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:52.076701 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:52.076669    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret podName:51c944a0-a2c5-4d5b-b6a7-319785065563 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:00.076651822 +0000 UTC m=+18.159934651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret") pod "global-pull-secret-syncer-5ptpt" (UID: "51c944a0-a2c5-4d5b-b6a7-319785065563") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:52.077116 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:52.077097    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:52.077210 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:52.077123    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:52.077210 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:52.077137    2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmzhh for pod openshift-network-diagnostics/network-check-target-74v82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:52.077210 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:52.077186    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh podName:4526b4d9-da7e-4194-9be5-5e26ead6d730 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:00.077170784 +0000 UTC m=+18.160453619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmzhh" (UniqueName: "kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh") pod "network-check-target-74v82" (UID: "4526b4d9-da7e-4194-9be5-5e26ead6d730") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:52.505813 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:52.505329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:52.505813 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:52.505473    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:31:53.504571 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:53.504541    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:53.504982 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:53.504640    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:53.504982 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:53.504697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:53.504982 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:53.504750    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:31:54.504556 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:54.504520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:54.504722 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:54.504659    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:31:55.504894 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:55.504855    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:55.505273 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:55.504955    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:55.505273 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:55.505005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:55.505273 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:55.505092    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:31:56.504822 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:56.504788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:56.504981 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:56.504914    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:31:57.505097 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:57.505059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:57.505632 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:57.505059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:57.505632 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:57.505183    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:31:57.505632 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:57.505247    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:58.504457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:58.504409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:31:58.504628 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:58.504543    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:31:59.504439 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:59.504390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:31:59.504923 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:59.504530    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:31:59.504996 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:31:59.504941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:31:59.505072 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:31:59.505050    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:00.036507 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:00.036404    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:00.036668 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.036567    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:32:00.036668 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.036639    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs podName:7daab18b-6c87-4142-986f-fc177bd358f4 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:16.036621558 +0000 UTC m=+34.119904402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs") pod "network-metrics-daemon-qpflx" (UID: "7daab18b-6c87-4142-986f-fc177bd358f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:32:00.137538 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:00.137496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:00.137721 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:00.137555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:00.137721 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.137662    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:32:00.137721 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.137681    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:32:00.137721 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.137702    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:32:00.137721 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.137716    2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmzhh for pod openshift-network-diagnostics/network-check-target-74v82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:32:00.137955 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.137739    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret podName:51c944a0-a2c5-4d5b-b6a7-319785065563 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:16.137720694 +0000 UTC m=+34.221003524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret") pod "global-pull-secret-syncer-5ptpt" (UID: "51c944a0-a2c5-4d5b-b6a7-319785065563") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:32:00.137955 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.137761    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh podName:4526b4d9-da7e-4194-9be5-5e26ead6d730 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:16.137745969 +0000 UTC m=+34.221028799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmzhh" (UniqueName: "kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh") pod "network-check-target-74v82" (UID: "4526b4d9-da7e-4194-9be5-5e26ead6d730") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:32:00.504413 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:00.504378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:00.504619 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:00.504528    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:01.504439 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:01.504398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:01.504628 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:01.504398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:01.504628 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:01.504524    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:01.504970 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:01.504627    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:02.507311 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:02.507284    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:02.507791 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:02.507401    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:03.504445 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:03.504396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:03.504603 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:03.504453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:03.504603 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:03.504545    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:03.504708 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:03.504673    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:04.505385 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.505095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:04.505996 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:04.505483    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:04.598964 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.598837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-st8t2" event={"ID":"b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4","Type":"ContainerStarted","Data":"897f89368a5be71bd8271bd8d82c323472d2e02d5074b0726ce8b8804cde58f7"}
Jul 27 18:32:04.600301 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.600275    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hsjf" event={"ID":"f1f8451a-5cfb-4406-bddf-f5d36e4b02eb","Type":"ContainerStarted","Data":"26586643d00b92f58f172ec1d6ec78a8b7e5f44561dc141962ea4dbb7fe5d81e"}
Jul 27 18:32:04.601820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.601788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt" event={"ID":"d175880a-3cb1-4705-93c2-f6d530a7bf98","Type":"ContainerStarted","Data":"608fb647ac2e67735298d8e18d341e0fabafef58cb7fa5b3d5ab361dd02d6e31"}
Jul 27 18:32:04.604501 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.604478    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"072ce9f20239351ef22a74320e357ec5b8a43a02a54e66c5d9385a5addcf81a8"}
Jul 27 18:32:04.604591 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.604538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"a047b3dffd8076a811cd7bd38603ca61ed45a8c1327f7176b0a953cdcdfea5a6"}
Jul 27 18:32:04.604654 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.604589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"bcd76a1183a81dc408561b28717e22c6232f93ebb808b6c6454c540d5699023c"}
Jul 27 18:32:04.604654 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.604624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"59b7fa0935c89d776744fef664949ee1f9d73e0ffd20b9da9b7d1d00481206e0"}
Jul 27 18:32:04.604739 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.604654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"3f6a8ae94d3fca5cf700ef44c5af25597dfd56012b1e08bd2b5698d7e5d78123"}
Jul 27 18:32:04.606003 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.605982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"3d8b400053bfa9f9c637aaf70e5d75ea","Type":"ContainerStarted","Data":"fe7562d80d1f5cdcc2034b45c13f52c51c763a586c0f0685a511c22259b55b21"}
Jul 27 18:32:04.609332 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.609266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8n6m" event={"ID":"81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f","Type":"ContainerStarted","Data":"2a716cde383a103a35b9a34ec76c32780c4ccdd899b01007dee14dec64778016"}
Jul 27 18:32:04.610693 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.610672    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a" containerID="0fea21662bb0640458229a1e9b9a5f6a4371fc86f973f56f7ae23108bbaae166" exitCode=0
Jul 27 18:32:04.610788 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.610738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerDied","Data":"0fea21662bb0640458229a1e9b9a5f6a4371fc86f973f56f7ae23108bbaae166"}
Jul 27 18:32:04.612158 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.612141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkrr8" event={"ID":"19a1260a-8b69-41bf-9987-75c97f0c3bbb","Type":"ContainerStarted","Data":"cfa5316c5630f0b6fecca6e3c49ece97dcf045eb65379e6914bc2da07ab2e081"}
Jul 27 18:32:04.613687 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.613647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tnskz" event={"ID":"10448c7c-bc43-4b5e-9903-df965f107fd6","Type":"ContainerStarted","Data":"65b49422101ec4f686096c31a955595b326e9796c052c839472a5e5b55fbaabd"}
Jul 27 18:32:04.614316 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.614277    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" podStartSLOduration=21.614265746 podStartE2EDuration="21.614265746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:46.581941135 +0000 UTC m=+4.665223987" watchObservedRunningTime="2026-07-27 18:32:04.614265746 +0000 UTC m=+22.697548676"
Jul 27 18:32:04.614617 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.614594    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-st8t2" podStartSLOduration=7.51078209 podStartE2EDuration="22.614588888s" totalImagesPullingTime="15.103806798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:04.613942452 +0000 UTC m=+22.697225313" watchObservedRunningTime="2026-07-27 18:32:04.614588888 +0000 UTC m=+22.697871738"
Jul 27 18:32:04.629239 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.629204    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9hsjf" podStartSLOduration=3.351737567 podStartE2EDuration="22.629193611s" totalImagesPullingTime="19.277456044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:04.629022586 +0000 UTC m=+22.712305437" watchObservedRunningTime="2026-07-27 18:32:04.629193611 +0000 UTC m=+22.712476461"
Jul 27 18:32:04.643732 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.643697    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g8n6m" podStartSLOduration=3.3700055620000002 podStartE2EDuration="22.643684674s" totalImagesPullingTime="19.273679112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:04.643562328 +0000 UTC m=+22.726845180" watchObservedRunningTime="2026-07-27 18:32:04.643684674 +0000 UTC m=+22.726967525"
Jul 27 18:32:04.665995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.665950    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" podStartSLOduration=21.665939186 podStartE2EDuration="21.665939186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:04.665655713 +0000 UTC m=+22.748938565" watchObservedRunningTime="2026-07-27 18:32:04.665939186 +0000 UTC m=+22.749222037"
Jul 27 18:32:04.711509 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.711462    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tnskz" podStartSLOduration=4.507517051 podStartE2EDuration="22.711446839s" totalImagesPullingTime="18.203929788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:04.711289781 +0000 UTC m=+22.794572631" watchObservedRunningTime="2026-07-27 18:32:04.711446839 +0000 UTC m=+22.794729680"
Jul 27 18:32:04.731796 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:04.731748    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wkrr8" podStartSLOduration=3.421694579 podStartE2EDuration="22.731731335s" totalImagesPullingTime="19.310036756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:04.731260366 +0000 UTC m=+22.814543217" watchObservedRunningTime="2026-07-27 18:32:04.731731335 +0000 UTC m=+22.815014185"
Jul 27 18:32:05.504847 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:05.504763    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:05.505048 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:05.504771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:05.505048 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:05.504869    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:05.505048 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:05.504994    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:05.617594 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:05.617554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qkmnw" event={"ID":"78395132-dfac-42c9-8879-7eeea71db0d2","Type":"ContainerStarted","Data":"bf00dda2589b6a43f7b1587dabb9330cf7b4d8055a6fd0d87445001872fb7cc3"}
Jul 27 18:32:05.621204 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:05.621165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"c2fe316db909536d35fa7476b2a5c13d167a9e146b1e21f9ec6fed131e836ee7"}
Jul 27 18:32:05.896815 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:05.896784    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 18:32:06.361212 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:06.361095    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T18:32:05.896812606Z","UUID":"b5ea3db7-d92f-415d-bc96-9a72596c91cc","Handler":null,"Name":"","Endpoint":""}
Jul 27 18:32:06.362736 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:06.362696    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 18:32:06.362736 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:06.362738    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 18:32:06.462691 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:06.462652    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:32:06.506812 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:06.506780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:06.506989 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:06.506915    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:06.627476 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:06.627370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt" event={"ID":"d175880a-3cb1-4705-93c2-f6d530a7bf98","Type":"ContainerStarted","Data":"2226f20b747e266be34e738a298d01f58a236f95be58c575b32a3857f853abff"}
Jul 27 18:32:07.504462 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:07.504414    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:07.504633 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:07.504412    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:07.504633 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:07.504571    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:07.504726 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:07.504671    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:07.633049 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:07.633011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"1406b633850d95afb09b42919d125b6af691508654a53de99f32288ce0c87acf"}
Jul 27 18:32:08.028170 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:08.027998    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:32:08.028668 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:08.028642    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:32:08.045001 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:08.044937    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qkmnw" podStartSLOduration=7.949886272 podStartE2EDuration="26.044918137s" totalImagesPullingTime="18.095031865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:05.634904031 +0000 UTC m=+23.718186887" watchObservedRunningTime="2026-07-27 18:32:08.044918137 +0000 UTC m=+26.128200990"
Jul 27 18:32:08.504365 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:08.504321    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:08.504566 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:08.504471    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:08.635775 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:08.635742    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-st8t2"
Jul 27 18:32:09.505350 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:09.505110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:09.505350 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:09.505161    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:09.505576 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:09.505355    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:09.505576 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:09.505487    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:09.638402 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:09.638361    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a" containerID="80ff687f47acc1fcf2c572e0d00943874469aeb54bc613174ebe0e58b5b003c9" exitCode=0
Jul 27 18:32:09.639203 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:09.638462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerDied","Data":"80ff687f47acc1fcf2c572e0d00943874469aeb54bc613174ebe0e58b5b003c9"}
Jul 27 18:32:09.640584 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:09.640557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt" event={"ID":"d175880a-3cb1-4705-93c2-f6d530a7bf98","Type":"ContainerStarted","Data":"6eea55c9776e386d360fc42d8c7a3aa144d36c72b272308a892e4f92c9648cbe"}
Jul 27 18:32:09.644106 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:09.644083    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" event={"ID":"7a04b2c4-18c4-4d3d-81fe-662c4a42fbf8","Type":"ContainerStarted","Data":"ab85d608c23aa80a0f8dd8f5827346bbeba72cb1babaf51b852b8330ba346d57"}
Jul 27 18:32:09.742024 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:09.739802    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qfkbt" podStartSLOduration=7.947434088 podStartE2EDuration="27.739782387s" totalImagesPullingTime="19.792348299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:09.739516254 +0000 UTC m=+27.822799105" watchObservedRunningTime="2026-07-27 18:32:09.739782387 +0000 UTC m=+27.823065238"
Jul 27 18:32:09.742024 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:09.740233    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm" podStartSLOduration=9.497956457 podStartE2EDuration="27.740219492s" totalImagesPullingTime="18.242263035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:09.711371238 +0000 UTC m=+27.794654089" watchObservedRunningTime="2026-07-27 18:32:09.740219492 +0000 UTC m=+27.823502344"
Jul 27 18:32:10.515457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:10.506235    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:10.515457 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:10.506362    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:10.646981 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:10.646949    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:32:10.647371 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:10.647045    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:32:10.647371 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:10.647089    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:32:10.662669 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:10.662644    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:32:10.662811 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:10.662763    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:32:11.274935 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:11.274713    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5ptpt"]
Jul 27 18:32:11.275086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:11.274995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:11.275133 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:11.275098    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:11.278748 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:11.278719    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qpflx"]
Jul 27 18:32:11.278890 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:11.278855    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:11.278968 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:11.278951    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:11.279374 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:11.279356    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-74v82"]
Jul 27 18:32:11.279472 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:11.279461    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:11.279549 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:11.279534    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:11.651347 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:11.651305    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a" containerID="768e8eb48b35a64065ae671cf08e817924e594e403457a3c8ac925b0532a6190" exitCode=0
Jul 27 18:32:11.651759 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:11.651407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerDied","Data":"768e8eb48b35a64065ae671cf08e817924e594e403457a3c8ac925b0532a6190"}
Jul 27 18:32:12.505054 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:12.505027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:12.505215 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:12.505117    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:13.504615 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:13.504530    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:13.504615 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:13.504576    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:13.505085 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:13.504667    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:13.505085 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:13.504828    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:13.659291 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:13.659261    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a" containerID="6bb9437590f58fe07c5d02790bf3eccc05273abd307d8dad286c6c89d756325d" exitCode=0
Jul 27 18:32:13.659464 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:13.659308    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerDied","Data":"6bb9437590f58fe07c5d02790bf3eccc05273abd307d8dad286c6c89d756325d"}
Jul 27 18:32:14.504693 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:14.504653    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:14.505411 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:14.504812    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:15.504961 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:15.504921    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:15.504961 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:15.504944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:15.505473 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:15.505058    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:15.505473 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:15.505191    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:16.058714 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:16.058159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:16.058714 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.058300    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:32:16.058714 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.058362    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs podName:7daab18b-6c87-4142-986f-fc177bd358f4 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:48.058345183 +0000 UTC m=+66.141628033 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs") pod "network-metrics-daemon-qpflx" (UID: "7daab18b-6c87-4142-986f-fc177bd358f4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:32:16.159113 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:16.159078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:16.159307 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:16.159146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:16.159307 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.159207    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:32:16.159307 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.159282    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret podName:51c944a0-a2c5-4d5b-b6a7-319785065563 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:48.159259177 +0000 UTC m=+66.242542030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret") pod "global-pull-secret-syncer-5ptpt" (UID: "51c944a0-a2c5-4d5b-b6a7-319785065563") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:32:16.159567 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.159308    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:32:16.159567 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.159328    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:32:16.159567 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.159340    2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmzhh for pod openshift-network-diagnostics/network-check-target-74v82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:32:16.159567 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.159389    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh podName:4526b4d9-da7e-4194-9be5-5e26ead6d730 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:48.159374804 +0000 UTC m=+66.242657638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmzhh" (UniqueName: "kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh") pod "network-check-target-74v82" (UID: "4526b4d9-da7e-4194-9be5-5e26ead6d730") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:32:16.505058 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:16.505024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:16.505650 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:16.505172    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qpflx" podUID="7daab18b-6c87-4142-986f-fc177bd358f4"
Jul 27 18:32:17.504755 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.504719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:17.504919 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.504721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:17.504919 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:17.504851    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74v82" podUID="4526b4d9-da7e-4194-9be5-5e26ead6d730"
Jul 27 18:32:17.504919 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:17.504892    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ptpt" podUID="51c944a0-a2c5-4d5b-b6a7-319785065563"
Jul 27 18:32:17.671834 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.671803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerStarted","Data":"45c5ef582de160ca2e1f8c33f1dcf2187cd875ba794da43dab9fd7a8194256c8"}
Jul 27 18:32:17.785476 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.785449    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeReady"
Jul 27 18:32:17.785574 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.785567    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 18:32:17.833548 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.833515    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ss2h2"]
Jul 27 18:32:17.835668 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.835646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:17.838138 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.838120    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 18:32:17.838248 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.838211    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 18:32:17.838378 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.838355    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m8x25\""
Jul 27 18:32:17.839770 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.839754    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j2zlr"]
Jul 27 18:32:17.841417 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.841398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j2zlr"
Jul 27 18:32:17.845416 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.844984    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 18:32:17.846302 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.846121    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 18:32:17.846302 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.846191    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 18:32:17.846302 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.846215    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bghlc\""
Jul 27 18:32:17.848814 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.848794    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ss2h2"]
Jul 27 18:32:17.854220 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.854196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j2zlr"]
Jul 27 18:32:17.970410 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.970311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40cb2b19-a295-4478-982e-b36ff0580035-config-volume\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:17.970410 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.970352    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67da426f-7a87-4387-a1d6-4b7b573e9449-cert\") pod \"ingress-canary-j2zlr\" (UID: \"67da426f-7a87-4387-a1d6-4b7b573e9449\") " pod="openshift-ingress-canary/ingress-canary-j2zlr"
Jul 27 18:32:17.970410 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.970384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfxhr\" (UniqueName: \"kubernetes.io/projected/40cb2b19-a295-4478-982e-b36ff0580035-kube-api-access-dfxhr\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:17.970410 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.970404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg74p\" (UniqueName: \"kubernetes.io/projected/67da426f-7a87-4387-a1d6-4b7b573e9449-kube-api-access-lg74p\") pod \"ingress-canary-j2zlr\" (UID: \"67da426f-7a87-4387-a1d6-4b7b573e9449\") " pod="openshift-ingress-canary/ingress-canary-j2zlr"
Jul 27 18:32:17.970690 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.970490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:17.970690 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:17.970534    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40cb2b19-a295-4478-982e-b36ff0580035-tmp-dir\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.071795 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.071756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40cb2b19-a295-4478-982e-b36ff0580035-config-volume\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.071795 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.071795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67da426f-7a87-4387-a1d6-4b7b573e9449-cert\") pod \"ingress-canary-j2zlr\" (UID: \"67da426f-7a87-4387-a1d6-4b7b573e9449\") " pod="openshift-ingress-canary/ingress-canary-j2zlr"
Jul 27 18:32:18.071938 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.071828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfxhr\" (UniqueName: \"kubernetes.io/projected/40cb2b19-a295-4478-982e-b36ff0580035-kube-api-access-dfxhr\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.071938 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.071846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg74p\" (UniqueName: \"kubernetes.io/projected/67da426f-7a87-4387-a1d6-4b7b573e9449-kube-api-access-lg74p\") pod \"ingress-canary-j2zlr\" (UID: \"67da426f-7a87-4387-a1d6-4b7b573e9449\") " pod="openshift-ingress-canary/ingress-canary-j2zlr"
Jul 27 18:32:18.071938 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.071871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.071938 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.071903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40cb2b19-a295-4478-982e-b36ff0580035-tmp-dir\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.072085 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:18.072023    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:18.072117 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:18.072088    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls podName:40cb2b19-a295-4478-982e-b36ff0580035 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:18.572070524 +0000 UTC m=+36.655353369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls") pod "dns-default-ss2h2" (UID: "40cb2b19-a295-4478-982e-b36ff0580035") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:18.072475 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.072445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40cb2b19-a295-4478-982e-b36ff0580035-config-volume\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.072652 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.072636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40cb2b19-a295-4478-982e-b36ff0580035-tmp-dir\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.076156 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.076035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67da426f-7a87-4387-a1d6-4b7b573e9449-cert\") pod \"ingress-canary-j2zlr\" (UID: \"67da426f-7a87-4387-a1d6-4b7b573e9449\") " pod="openshift-ingress-canary/ingress-canary-j2zlr"
Jul 27 18:32:18.081587 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.081569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfxhr\" (UniqueName: \"kubernetes.io/projected/40cb2b19-a295-4478-982e-b36ff0580035-kube-api-access-dfxhr\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.081840 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.081822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg74p\" (UniqueName: \"kubernetes.io/projected/67da426f-7a87-4387-a1d6-4b7b573e9449-kube-api-access-lg74p\") pod \"ingress-canary-j2zlr\" (UID: \"67da426f-7a87-4387-a1d6-4b7b573e9449\") " pod="openshift-ingress-canary/ingress-canary-j2zlr"
Jul 27 18:32:18.152870 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.152821    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j2zlr"
Jul 27 18:32:18.283106 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.283065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j2zlr"]
Jul 27 18:32:18.286617 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:32:18.286588    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67da426f_7a87_4387_a1d6_4b7b573e9449.slice/crio-ac60958a4916b0d19e65c0acb7b58db8674f4d55c3210c38ac75a9a0652e9363 WatchSource:0}: Error finding container ac60958a4916b0d19e65c0acb7b58db8674f4d55c3210c38ac75a9a0652e9363: Status 404 returned error can't find the container with id ac60958a4916b0d19e65c0acb7b58db8674f4d55c3210c38ac75a9a0652e9363
Jul 27 18:32:18.504237 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.504142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:18.507165 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.507140    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 18:32:18.507321 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.507193    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4wf8\""
Jul 27 18:32:18.574873 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.574817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:18.575036 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:18.574971    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:18.575087 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:18.575038    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls podName:40cb2b19-a295-4478-982e-b36ff0580035 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:19.575019889 +0000 UTC m=+37.658302721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls") pod "dns-default-ss2h2" (UID: "40cb2b19-a295-4478-982e-b36ff0580035") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:18.677446 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.677386    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a" containerID="45c5ef582de160ca2e1f8c33f1dcf2187cd875ba794da43dab9fd7a8194256c8" exitCode=0
Jul 27 18:32:18.677847 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.677468    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerDied","Data":"45c5ef582de160ca2e1f8c33f1dcf2187cd875ba794da43dab9fd7a8194256c8"}
Jul 27 18:32:18.678682 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:18.678665    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j2zlr" event={"ID":"67da426f-7a87-4387-a1d6-4b7b573e9449","Type":"ContainerStarted","Data":"ac60958a4916b0d19e65c0acb7b58db8674f4d55c3210c38ac75a9a0652e9363"}
Jul 27 18:32:19.504745 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.504715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:19.504918 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.504891    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:19.507698 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.507679    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 18:32:19.507698 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.507684    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 18:32:19.508691 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.508671    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv59m\""
Jul 27 18:32:19.508806 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.508702    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 18:32:19.581301 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.581258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:19.581497 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:19.581419    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:19.581559 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:19.581520    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls podName:40cb2b19-a295-4478-982e-b36ff0580035 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:21.581499602 +0000 UTC m=+39.664782445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls") pod "dns-default-ss2h2" (UID: "40cb2b19-a295-4478-982e-b36ff0580035") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:19.686209 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.686177    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a" containerID="b770b73287f0e9197aed3eebe4b9cc44b0fae64666a894852b15fc8b523df561" exitCode=0
Jul 27 18:32:19.686673 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:19.686246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerDied","Data":"b770b73287f0e9197aed3eebe4b9cc44b0fae64666a894852b15fc8b523df561"}
Jul 27 18:32:20.692599 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:20.690990    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j2zlr" event={"ID":"67da426f-7a87-4387-a1d6-4b7b573e9449","Type":"ContainerStarted","Data":"03e494cc7793ab6eceec5ee7c93a5130cfb76484d4efac787cbe4b7f080a5943"}
Jul 27 18:32:20.695527 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:20.695497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" event={"ID":"8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a","Type":"ContainerStarted","Data":"14745b09ad7b5d1485abacd4a26fc409b8ff27231dbb0f3e0a674b77026649b5"}
Jul 27 18:32:20.709353 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:20.709303    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j2zlr" podStartSLOduration=1.438707095 podStartE2EDuration="3.709289211s" totalImagesPullingTime="2.270582116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:20.708258868 +0000 UTC m=+38.791541719" watchObservedRunningTime="2026-07-27 18:32:20.709289211 +0000 UTC m=+38.792572062"
Jul 27 18:32:20.732510 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:20.732460    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jmwqb" podStartSLOduration=8.796398482 podStartE2EDuration="38.732441572s" totalImagesPullingTime="29.93604309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:20.730976873 +0000 UTC m=+38.814259726" watchObservedRunningTime="2026-07-27 18:32:20.732441572 +0000 UTC m=+38.815724415"
Jul 27 18:32:21.594984 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:21.594937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:21.595157 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:21.595059    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:21.595157 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:21.595112    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls podName:40cb2b19-a295-4478-982e-b36ff0580035 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:25.595098868 +0000 UTC m=+43.678381696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls") pod "dns-default-ss2h2" (UID: "40cb2b19-a295-4478-982e-b36ff0580035") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:25.621515 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:25.621474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:25.622004 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:25.621589    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:25.622004 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:25.621642    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls podName:40cb2b19-a295-4478-982e-b36ff0580035 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:33.621627666 +0000 UTC m=+51.704910495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls") pod "dns-default-ss2h2" (UID: "40cb2b19-a295-4478-982e-b36ff0580035") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:33.682221 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:33.682184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:33.682734 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:33.682335    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:33.682734 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:33.682410    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls podName:40cb2b19-a295-4478-982e-b36ff0580035 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:49.682395145 +0000 UTC m=+67.765677974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls") pod "dns-default-ss2h2" (UID: "40cb2b19-a295-4478-982e-b36ff0580035") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:38.381159 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.381116    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"]
Jul 27 18:32:38.383371 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.383352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.389559 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.389533    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 18:32:38.389687 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.389639    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 18:32:38.390272 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.389987    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:32:38.390272 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.390028    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 18:32:38.391538 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.391516    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79d6f6d9bc-nclnf"]
Jul 27 18:32:38.393157 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.393143    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.393971 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.393954    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-z92l9\""
Jul 27 18:32:38.402027 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.402011    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 18:32:38.403203 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.403187    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 18:32:38.403260 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.403206    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 18:32:38.403365 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.403352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7dxfk\""
Jul 27 18:32:38.403440 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.403414    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 18:32:38.403519 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.403503    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 18:32:38.404469 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.404455    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 18:32:38.409560 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.409541    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"]
Jul 27 18:32:38.439161 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.439136    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79d6f6d9bc-nclnf"]
Jul 27 18:32:38.515722 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.515685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37586f43-d6b2-405a-91c3-0fd8d982b653-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.515722 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.515730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-default-certificate\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.515963 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.515749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-stats-auth\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.515963 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.515828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.515963 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.515867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37586f43-d6b2-405a-91c3-0fd8d982b653-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.515963 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.515885    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqcn\" (UniqueName: \"kubernetes.io/projected/cf480830-7a43-4eb4-8af9-f13906b92ece-kube-api-access-7qqcn\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.515963 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.515917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvwzj\" (UniqueName: \"kubernetes.io/projected/37586f43-d6b2-405a-91c3-0fd8d982b653-kube-api-access-zvwzj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.515963 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.515956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.607620 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.607588    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65df9f5ffb-bdcms"]
Jul 27 18:32:38.609355 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.609342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.613093 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.613066    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dvhzg\""
Jul 27 18:32:38.613337 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.613319    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 18:32:38.616325 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.616308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvwzj\" (UniqueName: \"kubernetes.io/projected/37586f43-d6b2-405a-91c3-0fd8d982b653-kube-api-access-zvwzj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.616438 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.616332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.616438 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.616354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37586f43-d6b2-405a-91c3-0fd8d982b653-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.616438 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.616370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-default-certificate\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.616438 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.616386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-stats-auth\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.616628 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:38.616495    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:39.116477872 +0000 UTC m=+57.199760704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : configmap references non-existent config key: service-ca.crt
Jul 27 18:32:38.616628 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.616527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.616628 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.616581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37586f43-d6b2-405a-91c3-0fd8d982b653-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.616628 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.616609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqcn\" (UniqueName: \"kubernetes.io/projected/cf480830-7a43-4eb4-8af9-f13906b92ece-kube-api-access-7qqcn\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.616842 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:38.616727    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 18:32:38.616842 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:38.616795    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:39.116780504 +0000 UTC m=+57.200063335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : secret "router-metrics-certs-default" not found
Jul 27 18:32:38.617219 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.617203    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 18:32:38.617322 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.617232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37586f43-d6b2-405a-91c3-0fd8d982b653-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.620257 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.620232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37586f43-d6b2-405a-91c3-0fd8d982b653-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.620336 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.620275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-default-certificate\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.620577 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.620558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-stats-auth\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.620837 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.620824    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 18:32:38.630584 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.630567    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 18:32:38.637465 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.637391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65df9f5ffb-bdcms"]
Jul 27 18:32:38.644610 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.644588    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqcn\" (UniqueName: \"kubernetes.io/projected/cf480830-7a43-4eb4-8af9-f13906b92ece-kube-api-access-7qqcn\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:38.647557 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.647527    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvwzj\" (UniqueName: \"kubernetes.io/projected/37586f43-d6b2-405a-91c3-0fd8d982b653-kube-api-access-zvwzj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d\" (UID: \"37586f43-d6b2-405a-91c3-0fd8d982b653\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.692861 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.692831    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"
Jul 27 18:32:38.717675 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.717637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-certificates\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.717675 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.717675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-trusted-ca\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.717877 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.717703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-bound-sa-token\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.717877 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.717771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.717877 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.717830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44fcj\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-kube-api-access-44fcj\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.717971 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.717917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-installation-pull-secrets\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.717971 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.717959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8b9941b-19d3-498c-a069-b23d386a6a91-ca-trust-extracted\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.718044 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.717980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-image-registry-private-configuration\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.817791 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.817763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d"]
Jul 27 18:32:38.819084 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.819140 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fcj\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-kube-api-access-44fcj\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.819198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-installation-pull-secrets\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.819248 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8b9941b-19d3-498c-a069-b23d386a6a91-ca-trust-extracted\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.819286 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-image-registry-private-configuration\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.819339 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:38.819222    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:32:38.819339 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:38.819327    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df9f5ffb-bdcms: secret "image-registry-tls" not found
Jul 27 18:32:38.819445 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-certificates\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.819445 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-trusted-ca\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.819445 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:38.819399    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls podName:b8b9941b-19d3-498c-a069-b23d386a6a91 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:39.319377099 +0000 UTC m=+57.402659942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls") pod "image-registry-65df9f5ffb-bdcms" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91") : secret "image-registry-tls" not found
Jul 27 18:32:38.819612 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-bound-sa-token\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.819992 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.819972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-certificates\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.820097 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.820048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8b9941b-19d3-498c-a069-b23d386a6a91-ca-trust-extracted\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.820537 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.820512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-trusted-ca\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.821169 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:32:38.821150    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37586f43_d6b2_405a_91c3_0fd8d982b653.slice/crio-fe37c1c6d1ff500761e5dde6a3a8a1245fc32d43eeb924ae31435e309b4d26b5 WatchSource:0}: Error finding container fe37c1c6d1ff500761e5dde6a3a8a1245fc32d43eeb924ae31435e309b4d26b5: Status 404 returned error can't find the container with id fe37c1c6d1ff500761e5dde6a3a8a1245fc32d43eeb924ae31435e309b4d26b5
Jul 27 18:32:38.822315 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.822294    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-image-registry-private-configuration\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.822400 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.822300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-installation-pull-secrets\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.830492 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.829147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44fcj\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-kube-api-access-44fcj\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:38.830492 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:38.829631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-bound-sa-token\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:39.121717 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:39.121682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:39.121871 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:39.121776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:39.121950 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:39.121878    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 18:32:39.121950 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:39.121904    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:40.121891468 +0000 UTC m=+58.205174298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : configmap references non-existent config key: service-ca.crt
Jul 27 18:32:39.121950 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:39.121946    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:40.121925699 +0000 UTC m=+58.205208546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : secret "router-metrics-certs-default" not found
Jul 27 18:32:39.323402 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:39.323365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:39.323646 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:39.323618    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:32:39.323716 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:39.323648    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df9f5ffb-bdcms: secret "image-registry-tls" not found
Jul 27 18:32:39.323716 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:39.323707    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls podName:b8b9941b-19d3-498c-a069-b23d386a6a91 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:40.323690867 +0000 UTC m=+58.406973696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls") pod "image-registry-65df9f5ffb-bdcms" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91") : secret "image-registry-tls" not found
Jul 27 18:32:39.741001 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:39.740961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d" event={"ID":"37586f43-d6b2-405a-91c3-0fd8d982b653","Type":"ContainerStarted","Data":"fe37c1c6d1ff500761e5dde6a3a8a1245fc32d43eeb924ae31435e309b4d26b5"}
Jul 27 18:32:40.130844 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:40.130799    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:40.131032 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:40.130895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:40.131032 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:40.130969    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 18:32:40.131032 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:40.131022    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:42.131007386 +0000 UTC m=+60.214290216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : configmap references non-existent config key: service-ca.crt
Jul 27 18:32:40.131163 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:40.131048    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:42.131033998 +0000 UTC m=+60.214316827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : secret "router-metrics-certs-default" not found
Jul 27 18:32:40.333215 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:40.333174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:40.333387 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:40.333306    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:32:40.333387 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:40.333326    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df9f5ffb-bdcms: secret "image-registry-tls" not found
Jul 27 18:32:40.333500 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:40.333399    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls podName:b8b9941b-19d3-498c-a069-b23d386a6a91 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:42.333381931 +0000 UTC m=+60.416664764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls") pod "image-registry-65df9f5ffb-bdcms" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91") : secret "image-registry-tls" not found
Jul 27 18:32:40.744683 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:40.744645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d" event={"ID":"37586f43-d6b2-405a-91c3-0fd8d982b653","Type":"ContainerStarted","Data":"25d30a59f848c7037fedbe812552b6824655faf66bdb7cc016967e17817061d4"}
Jul 27 18:32:40.764610 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:40.764563    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d" podStartSLOduration=0.961991278 podStartE2EDuration="2.764549029s" totalImagesPullingTime="1.802557751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:40.763967928 +0000 UTC m=+58.847250780" watchObservedRunningTime="2026-07-27 18:32:40.764549029 +0000 UTC m=+58.847831857"
Jul 27 18:32:42.147707 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:42.147669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:42.148105 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:42.147743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:42.148105 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:42.147818    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 18:32:42.148105 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:42.147881    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:46.147866299 +0000 UTC m=+64.231149128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : configmap references non-existent config key: service-ca.crt
Jul 27 18:32:42.148105 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:42.147901    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:46.147892599 +0000 UTC m=+64.231175434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : secret "router-metrics-certs-default" not found
Jul 27 18:32:42.348820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:42.348794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:42.348965 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:42.348914    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:32:42.348965 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:42.348927    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df9f5ffb-bdcms: secret "image-registry-tls" not found
Jul 27 18:32:42.349042 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:42.348979    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls podName:b8b9941b-19d3-498c-a069-b23d386a6a91 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:46.348964536 +0000 UTC m=+64.432247367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls") pod "image-registry-65df9f5ffb-bdcms" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91") : secret "image-registry-tls" not found
Jul 27 18:32:42.667218 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:42.667190    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lxqgm"
Jul 27 18:32:46.177796 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:46.177759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:46.178261 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:46.177844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:46.178261 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:46.177909    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 18:32:46.178261 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:46.177981    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:54.177964775 +0000 UTC m=+72.261247604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : secret "router-metrics-certs-default" not found
Jul 27 18:32:46.178261 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:46.177996    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:32:54.177989754 +0000 UTC m=+72.261272582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : configmap references non-existent config key: service-ca.crt
Jul 27 18:32:46.384087 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:46.384051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:46.384298 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:46.384171    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:32:46.384298 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:46.384183    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df9f5ffb-bdcms: secret "image-registry-tls" not found
Jul 27 18:32:46.384298 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:46.384235    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls podName:b8b9941b-19d3-498c-a069-b23d386a6a91 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:54.384218793 +0000 UTC m=+72.467501623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls") pod "image-registry-65df9f5ffb-bdcms" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91") : secret "image-registry-tls" not found
Jul 27 18:32:48.096620 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.096562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:32:48.099653 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.099622    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 18:32:48.107071 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:48.107047    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 18:32:48.107167 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:48.107115    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs podName:7daab18b-6c87-4142-986f-fc177bd358f4 nodeName:}" failed. No retries permitted until 2026-07-27 18:33:52.107095854 +0000 UTC m=+130.190378683 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs") pod "network-metrics-daemon-qpflx" (UID: "7daab18b-6c87-4142-986f-fc177bd358f4") : secret "metrics-daemon-secret" not found
Jul 27 18:32:48.197410 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.197374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:48.197614 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.197453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:48.200712 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.200693    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 18:32:48.200786 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.200704    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 18:32:48.210365 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.210344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51c944a0-a2c5-4d5b-b6a7-319785065563-original-pull-secret\") pod \"global-pull-secret-syncer-5ptpt\" (UID: \"51c944a0-a2c5-4d5b-b6a7-319785065563\") " pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:48.210776 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.210762    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 18:32:48.221316 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.221286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmzhh\" (UniqueName: \"kubernetes.io/projected/4526b4d9-da7e-4194-9be5-5e26ead6d730-kube-api-access-qmzhh\") pod \"network-check-target-74v82\" (UID: \"4526b4d9-da7e-4194-9be5-5e26ead6d730\") " pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:48.317923 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.317882    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ptpt"
Jul 27 18:32:48.326772 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.326752    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv59m\""
Jul 27 18:32:48.334221 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.334194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:48.460181 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.460136    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5ptpt"]
Jul 27 18:32:48.463399 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:32:48.463375    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c944a0_a2c5_4d5b_b6a7_319785065563.slice/crio-22a1799d5ec61418c454e80136a7e51a29bb08156b65d0ce380186a56307bad1 WatchSource:0}: Error finding container 22a1799d5ec61418c454e80136a7e51a29bb08156b65d0ce380186a56307bad1: Status 404 returned error can't find the container with id 22a1799d5ec61418c454e80136a7e51a29bb08156b65d0ce380186a56307bad1
Jul 27 18:32:48.478076 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.478049    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-74v82"]
Jul 27 18:32:48.482901 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:32:48.482880    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4526b4d9_da7e_4194_9be5_5e26ead6d730.slice/crio-d01dddb4117622e9c63a17c5f5f0119eee978425a41ed0fd26b56e0a434d186d WatchSource:0}: Error finding container d01dddb4117622e9c63a17c5f5f0119eee978425a41ed0fd26b56e0a434d186d: Status 404 returned error can't find the container with id d01dddb4117622e9c63a17c5f5f0119eee978425a41ed0fd26b56e0a434d186d
Jul 27 18:32:48.533651 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.533618    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hsjf_f1f8451a-5cfb-4406-bddf-f5d36e4b02eb/dns-node-resolver/0.log"
Jul 27 18:32:48.764710 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.764624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-74v82" event={"ID":"4526b4d9-da7e-4194-9be5-5e26ead6d730","Type":"ContainerStarted","Data":"d01dddb4117622e9c63a17c5f5f0119eee978425a41ed0fd26b56e0a434d186d"}
Jul 27 18:32:48.765719 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:48.765696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5ptpt" event={"ID":"51c944a0-a2c5-4d5b-b6a7-319785065563","Type":"ContainerStarted","Data":"22a1799d5ec61418c454e80136a7e51a29bb08156b65d0ce380186a56307bad1"}
Jul 27 18:32:49.342968 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:49.342938    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8n6m_81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f/node-ca/0.log"
Jul 27 18:32:49.711706 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:49.711614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:32:49.711879 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:49.711775    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:49.711879 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:49.711844    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls podName:40cb2b19-a295-4478-982e-b36ff0580035 nodeName:}" failed. No retries permitted until 2026-07-27 18:33:21.711824979 +0000 UTC m=+99.795107831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls") pod "dns-default-ss2h2" (UID: "40cb2b19-a295-4478-982e-b36ff0580035") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:50.333745 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:50.333711    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j2zlr_67da426f-7a87-4387-a1d6-4b7b573e9449/serve-healthcheck-canary/0.log"
Jul 27 18:32:51.135310 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:51.135270    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d_37586f43-d6b2-405a-91c3-0fd8d982b653/kube-storage-version-migrator-operator/0.log"
Jul 27 18:32:53.781481 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:53.781442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-74v82" event={"ID":"4526b4d9-da7e-4194-9be5-5e26ead6d730","Type":"ContainerStarted","Data":"a7ae66d851ad64ae5da1cc94e04a74d0e8d9b6512f743307472fe07597418ac2"}
Jul 27 18:32:53.781933 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:53.781546    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:32:53.782912 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:53.782892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5ptpt" event={"ID":"51c944a0-a2c5-4d5b-b6a7-319785065563","Type":"ContainerStarted","Data":"daf6ca96339153fd9c74dbeb7e9dfb3af225035ce68f424bb4017c5b5a20b88e"}
Jul 27 18:32:53.802268 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:53.802221    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-74v82" podStartSLOduration=67.09125378 podStartE2EDuration="1m11.802206318s" totalImagesPullingTime="4.710952538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:53.801864938 +0000 UTC m=+71.885147789" watchObservedRunningTime="2026-07-27 18:32:53.802206318 +0000 UTC m=+71.885489169"
Jul 27 18:32:53.823421 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:53.823371    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5ptpt" podStartSLOduration=67.089625227 podStartE2EDuration="1m11.823354349s" totalImagesPullingTime="4.733729122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:53.823295457 +0000 UTC m=+71.906578308" watchObservedRunningTime="2026-07-27 18:32:53.823354349 +0000 UTC m=+71.906637195"
Jul 27 18:32:54.249856 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.249815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:54.250030 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.249880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:54.250030 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:32:54.249983    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle podName:cf480830-7a43-4eb4-8af9-f13906b92ece nodeName:}" failed. No retries permitted until 2026-07-27 18:33:10.249966245 +0000 UTC m=+88.333249073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle") pod "router-default-79d6f6d9bc-nclnf" (UID: "cf480830-7a43-4eb4-8af9-f13906b92ece") : configmap references non-existent config key: service-ca.crt
Jul 27 18:32:54.252459 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.252415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf480830-7a43-4eb4-8af9-f13906b92ece-metrics-certs\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:32:54.452221 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.452193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:54.454699 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.454675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"image-registry-65df9f5ffb-bdcms\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") " pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:54.521176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.521096    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dvhzg\""
Jul 27 18:32:54.528599 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.528574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:32:54.656994 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.656957    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65df9f5ffb-bdcms"]
Jul 27 18:32:54.661180 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:32:54.661156    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b9941b_19d3_498c_a069_b23d386a6a91.slice/crio-68a1bafa1d126beb7e1ef4941b82acc867b6393194b50c1f5c73e8f8588ff0a6 WatchSource:0}: Error finding container 68a1bafa1d126beb7e1ef4941b82acc867b6393194b50c1f5c73e8f8588ff0a6: Status 404 returned error can't find the container with id 68a1bafa1d126beb7e1ef4941b82acc867b6393194b50c1f5c73e8f8588ff0a6
Jul 27 18:32:54.787616 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.787519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms" event={"ID":"b8b9941b-19d3-498c-a069-b23d386a6a91","Type":"ContainerStarted","Data":"f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5"}
Jul 27 18:32:54.787616 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.787577    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms" event={"ID":"b8b9941b-19d3-498c-a069-b23d386a6a91","Type":"ContainerStarted","Data":"68a1bafa1d126beb7e1ef4941b82acc867b6393194b50c1f5c73e8f8588ff0a6"}
Jul 27 18:32:54.807478 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:54.807403    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms" podStartSLOduration=16.807383185 podStartE2EDuration="16.807383185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:54.807089235 +0000 UTC m=+72.890372087" watchObservedRunningTime="2026-07-27 18:32:54.807383185 +0000 UTC m=+72.890666038"
Jul 27 18:32:55.790790 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:32:55.790761    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:33:10.277738 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.277601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:33:10.278205 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.278184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf480830-7a43-4eb4-8af9-f13906b92ece-service-ca-bundle\") pod \"router-default-79d6f6d9bc-nclnf\" (UID: \"cf480830-7a43-4eb4-8af9-f13906b92ece\") " pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:33:10.503559 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.503531    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7dxfk\""
Jul 27 18:33:10.511421 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.511400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:33:10.657863 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.654066    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79d6f6d9bc-nclnf"]
Jul 27 18:33:10.659772 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:10.659726    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf480830_7a43_4eb4_8af9_f13906b92ece.slice/crio-c10a48c84b6b6c6c16136537edc13804d10bdcfb1676853e4dfe3418d6ecf14c WatchSource:0}: Error finding container c10a48c84b6b6c6c16136537edc13804d10bdcfb1676853e4dfe3418d6ecf14c: Status 404 returned error can't find the container with id c10a48c84b6b6c6c16136537edc13804d10bdcfb1676853e4dfe3418d6ecf14c
Jul 27 18:33:10.688710 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.688685    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gqfk5"]
Jul 27 18:33:10.690707 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.690691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.696301 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.696274    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 18:33:10.696416 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.696334    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 18:33:10.696416 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.696382    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 18:33:10.696727 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.696706    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 18:33:10.699811 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.699773    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-blrxc\""
Jul 27 18:33:10.712883 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.712861    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gqfk5"]
Jul 27 18:33:10.725950 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.725918    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65df9f5ffb-bdcms"]
Jul 27 18:33:10.731460 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.731401    2577 patch_prober.go:28] interesting pod/image-registry-65df9f5ffb-bdcms container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 18:33:10.731603 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.731467    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms" podUID="b8b9941b-19d3-498c-a069-b23d386a6a91" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:33:10.782289 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.782214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d62bb39d-a949-4a30-9c1c-5319e80934ef-data-volume\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.782476 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.782319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d62bb39d-a949-4a30-9c1c-5319e80934ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.782536 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.782473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll7wh\" (UniqueName: \"kubernetes.io/projected/d62bb39d-a949-4a30-9c1c-5319e80934ef-kube-api-access-ll7wh\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.782536 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.782500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d62bb39d-a949-4a30-9c1c-5319e80934ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.782680 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.782560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d62bb39d-a949-4a30-9c1c-5319e80934ef-crio-socket\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.795291 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.795268    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-784b6d6fd5-kjwfl"]
Jul 27 18:33:10.797132 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.797118    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.828132 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.828064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf" event={"ID":"cf480830-7a43-4eb4-8af9-f13906b92ece","Type":"ContainerStarted","Data":"9e36fc1b5bb647e5ca722d93e912c25f1eb048e27684e37160424a702aa3117e"}
Jul 27 18:33:10.828132 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.828111    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf" event={"ID":"cf480830-7a43-4eb4-8af9-f13906b92ece","Type":"ContainerStarted","Data":"c10a48c84b6b6c6c16136537edc13804d10bdcfb1676853e4dfe3418d6ecf14c"}
Jul 27 18:33:10.838417 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.838394    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-784b6d6fd5-kjwfl"]
Jul 27 18:33:10.883843 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.883814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll7wh\" (UniqueName: \"kubernetes.io/projected/d62bb39d-a949-4a30-9c1c-5319e80934ef-kube-api-access-ll7wh\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.884008 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.883854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-trusted-ca\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.884008 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.883883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d62bb39d-a949-4a30-9c1c-5319e80934ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.884008 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.883939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-registry-tls\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.884008 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.883990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d62bb39d-a949-4a30-9c1c-5319e80934ef-crio-socket\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.884208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-registry-certificates\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.884208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-bound-sa-token\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.884208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d62bb39d-a949-4a30-9c1c-5319e80934ef-crio-socket\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.884208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d62bb39d-a949-4a30-9c1c-5319e80934ef-data-volume\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.884401 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d62bb39d-a949-4a30-9c1c-5319e80934ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.884401 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-image-registry-private-configuration\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.884401 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-ca-trust-extracted\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.884401 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-installation-pull-secrets\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.884401 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26lpd\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-kube-api-access-26lpd\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.884659 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884568    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d62bb39d-a949-4a30-9c1c-5319e80934ef-data-volume\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.884832 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.884813    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d62bb39d-a949-4a30-9c1c-5319e80934ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.886878 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.886859    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d62bb39d-a949-4a30-9c1c-5319e80934ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.922575 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.922527    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf" podStartSLOduration=32.922508741 podStartE2EDuration="32.922508741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:10.922465564 +0000 UTC m=+89.005748405" watchObservedRunningTime="2026-07-27 18:33:10.922508741 +0000 UTC m=+89.005791592"
Jul 27 18:33:10.923551 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.923534    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll7wh\" (UniqueName: \"kubernetes.io/projected/d62bb39d-a949-4a30-9c1c-5319e80934ef-kube-api-access-ll7wh\") pod \"insights-runtime-extractor-gqfk5\" (UID: \"d62bb39d-a949-4a30-9c1c-5319e80934ef\") " pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:10.984888 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.984851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-registry-certificates\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985062 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.984908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-bound-sa-token\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985062 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.984945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-image-registry-private-configuration\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985062 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.985000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-ca-trust-extracted\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985062 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.985045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-installation-pull-secrets\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985256 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.985069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26lpd\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-kube-api-access-26lpd\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985256 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.985121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-trusted-ca\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985256 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.985144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-registry-tls\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985835 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.985803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-registry-certificates\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.985937 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.985816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-ca-trust-extracted\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.986643 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.986616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-trusted-ca\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.987779 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.987762    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-installation-pull-secrets\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.987846 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.987778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-registry-tls\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:10.987915 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:10.987899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-image-registry-private-configuration\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:11.002911 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.002892    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gqfk5"
Jul 27 18:33:11.005240 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.005218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-bound-sa-token\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:11.005328 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.005258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26lpd\" (UniqueName: \"kubernetes.io/projected/5dad04e5-18b9-41ae-9e93-b0f73b0f760c-kube-api-access-26lpd\") pod \"image-registry-784b6d6fd5-kjwfl\" (UID: \"5dad04e5-18b9-41ae-9e93-b0f73b0f760c\") " pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:11.105958 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.105933    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:11.172627 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.172596    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gqfk5"]
Jul 27 18:33:11.177217 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:11.177191    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62bb39d_a949_4a30_9c1c_5319e80934ef.slice/crio-8bbd79b2f54b93794f6f101f7043cd0af8e516c69d1050f0101b9923e8ee9a1d WatchSource:0}: Error finding container 8bbd79b2f54b93794f6f101f7043cd0af8e516c69d1050f0101b9923e8ee9a1d: Status 404 returned error can't find the container with id 8bbd79b2f54b93794f6f101f7043cd0af8e516c69d1050f0101b9923e8ee9a1d
Jul 27 18:33:11.252272 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.252243    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-784b6d6fd5-kjwfl"]
Jul 27 18:33:11.255933 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:11.255904    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dad04e5_18b9_41ae_9e93_b0f73b0f760c.slice/crio-f9dd40997f29ce7b980b8461f3c6799fb724a3d5d3bfdba6e4c80b6f9f2f5eab WatchSource:0}: Error finding container f9dd40997f29ce7b980b8461f3c6799fb724a3d5d3bfdba6e4c80b6f9f2f5eab: Status 404 returned error can't find the container with id f9dd40997f29ce7b980b8461f3c6799fb724a3d5d3bfdba6e4c80b6f9f2f5eab
Jul 27 18:33:11.511669 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.511629    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:33:11.514075 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.514052    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:33:11.837253 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.837218    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl" event={"ID":"5dad04e5-18b9-41ae-9e93-b0f73b0f760c","Type":"ContainerStarted","Data":"f25ca561ebc2c0945a1ba0e3a72a344c555f9a111b01aead804f3511ddf95ec8"}
Jul 27 18:33:11.837451 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.837287    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl" event={"ID":"5dad04e5-18b9-41ae-9e93-b0f73b0f760c","Type":"ContainerStarted","Data":"f9dd40997f29ce7b980b8461f3c6799fb724a3d5d3bfdba6e4c80b6f9f2f5eab"}
Jul 27 18:33:11.837451 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.837339    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:11.838399 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.838376    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gqfk5" event={"ID":"d62bb39d-a949-4a30-9c1c-5319e80934ef","Type":"ContainerStarted","Data":"8bbd79b2f54b93794f6f101f7043cd0af8e516c69d1050f0101b9923e8ee9a1d"}
Jul 27 18:33:11.838538 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.838526    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:33:11.839921 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.839904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79d6f6d9bc-nclnf"
Jul 27 18:33:11.889286 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:11.889247    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl" podStartSLOduration=1.889236376 podStartE2EDuration="1.889236376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:11.883200015 +0000 UTC m=+89.966482866" watchObservedRunningTime="2026-07-27 18:33:11.889236376 +0000 UTC m=+89.972519226"
Jul 27 18:33:17.868342 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:17.868297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gqfk5" event={"ID":"d62bb39d-a949-4a30-9c1c-5319e80934ef","Type":"ContainerStarted","Data":"6bbf747abfdc25af027e1b72fdca19e2c2128c724180d093f1653b92ce475233"}
Jul 27 18:33:20.146934 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.146904    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"]
Jul 27 18:33:20.174104 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.174080    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"]
Jul 27 18:33:20.174246 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.174174    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.176846 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.176826    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 18:33:20.176846 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.176842    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 27 18:33:20.178042 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.178024    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 18:33:20.178135 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.178024    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-92stq\""
Jul 27 18:33:20.178204 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.178189    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 18:33:20.178263 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.178189    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 27 18:33:20.268102 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.268062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.268261 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.268155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0affa3e2-2ab7-410d-921c-f7caedbd11d7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.268261 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.268189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7qgz\" (UniqueName: \"kubernetes.io/projected/0affa3e2-2ab7-410d-921c-f7caedbd11d7-kube-api-access-z7qgz\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.268261 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.268259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.369600 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.369562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.369782 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.369616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0affa3e2-2ab7-410d-921c-f7caedbd11d7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.369782 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.369641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7qgz\" (UniqueName: \"kubernetes.io/projected/0affa3e2-2ab7-410d-921c-f7caedbd11d7-kube-api-access-z7qgz\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.369782 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.369697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.369956 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:33:20.369837    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 27 18:33:20.369956 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:33:20.369906    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-tls podName:0affa3e2-2ab7-410d-921c-f7caedbd11d7 nodeName:}" failed. No retries permitted until 2026-07-27 18:33:20.86988915 +0000 UTC m=+98.953171985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-6h7sd" (UID: "0affa3e2-2ab7-410d-921c-f7caedbd11d7") : secret "prometheus-operator-tls" not found
Jul 27 18:33:20.370495 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.370463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0affa3e2-2ab7-410d-921c-f7caedbd11d7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.372466 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.372420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.381413 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.381384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7qgz\" (UniqueName: \"kubernetes.io/projected/0affa3e2-2ab7-410d-921c-f7caedbd11d7-kube-api-access-z7qgz\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.731687 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.731660    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:33:20.875120 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.875080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:20.878098 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:20.878075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0affa3e2-2ab7-410d-921c-f7caedbd11d7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6h7sd\" (UID: \"0affa3e2-2ab7-410d-921c-f7caedbd11d7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:21.084025 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:21.083993    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"
Jul 27 18:33:21.223504 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:21.223475    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6h7sd"]
Jul 27 18:33:21.226642 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:21.226620    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0affa3e2_2ab7_410d_921c_f7caedbd11d7.slice/crio-91746987f3453abf19ec60a84f5e3d3d2417a9938a41bdfc2f5c20a00c3aa6e2 WatchSource:0}: Error finding container 91746987f3453abf19ec60a84f5e3d3d2417a9938a41bdfc2f5c20a00c3aa6e2: Status 404 returned error can't find the container with id 91746987f3453abf19ec60a84f5e3d3d2417a9938a41bdfc2f5c20a00c3aa6e2
Jul 27 18:33:21.783249 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:21.783214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:33:21.786152 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:21.786123    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40cb2b19-a295-4478-982e-b36ff0580035-metrics-tls\") pod \"dns-default-ss2h2\" (UID: \"40cb2b19-a295-4478-982e-b36ff0580035\") " pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:33:21.885588 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:21.885548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd" event={"ID":"0affa3e2-2ab7-410d-921c-f7caedbd11d7","Type":"ContainerStarted","Data":"91746987f3453abf19ec60a84f5e3d3d2417a9938a41bdfc2f5c20a00c3aa6e2"}
Jul 27 18:33:21.887571 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:21.887540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gqfk5" event={"ID":"d62bb39d-a949-4a30-9c1c-5319e80934ef","Type":"ContainerStarted","Data":"7d6e4e31c5efdbcfd4fff8d665141d511c1e8b915e4ad2fac6092b49ce40dae8"}
Jul 27 18:33:22.051471 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:22.051379    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m8x25\""
Jul 27 18:33:22.057331 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:22.057305    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:33:22.228096 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:22.227998    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ss2h2"]
Jul 27 18:33:22.233722 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:22.233695    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cb2b19_a295_4478_982e_b36ff0580035.slice/crio-14ea3671c71ed1c24e741c16c69bdd1848f4e40e576b4c9c1b7336955db23a55 WatchSource:0}: Error finding container 14ea3671c71ed1c24e741c16c69bdd1848f4e40e576b4c9c1b7336955db23a55: Status 404 returned error can't find the container with id 14ea3671c71ed1c24e741c16c69bdd1848f4e40e576b4c9c1b7336955db23a55
Jul 27 18:33:22.896121 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:22.895843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd" event={"ID":"0affa3e2-2ab7-410d-921c-f7caedbd11d7","Type":"ContainerStarted","Data":"039f3a9edf14f5c96eb6a2f5ed8afd5f826880dcaf885205cf8776b9530cb0b8"}
Jul 27 18:33:22.896121 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:22.895912    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd" event={"ID":"0affa3e2-2ab7-410d-921c-f7caedbd11d7","Type":"ContainerStarted","Data":"57bbb3a062c1dc5a63f2a673589c79923f14cfba934a997545913a2a027ec44d"}
Jul 27 18:33:22.898632 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:22.898553    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ss2h2" event={"ID":"40cb2b19-a295-4478-982e-b36ff0580035","Type":"ContainerStarted","Data":"14ea3671c71ed1c24e741c16c69bdd1848f4e40e576b4c9c1b7336955db23a55"}
Jul 27 18:33:22.919707 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:22.919598    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-6h7sd" podStartSLOduration=1.490203604 podStartE2EDuration="2.919578989s" totalImagesPullingTime="1.429375385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:22.917717003 +0000 UTC m=+101.000999865" watchObservedRunningTime="2026-07-27 18:33:22.919578989 +0000 UTC m=+101.002861841"
Jul 27 18:33:24.648644 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.648606    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"]
Jul 27 18:33:24.799756 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.799715    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"]
Jul 27 18:33:24.799900 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.799840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:24.803885 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.803589    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 18:33:24.804022 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.803926    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rp7fk\""
Jul 27 18:33:24.804086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.804074    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 18:33:24.806210 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.805375    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 18:33:24.829913 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.829888    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"]
Jul 27 18:33:24.829988 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.829969    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-74v82"
Jul 27 18:33:24.830036 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.829997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"]
Jul 27 18:33:24.830036 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.830019    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-97j9d"]
Jul 27 18:33:24.830096 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.830016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:24.836219 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.836205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ggchm\""
Jul 27 18:33:24.836525 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.836509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 18:33:24.836587 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.836509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 18:33:24.854291 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.854270    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:24.857569 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.857535    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 18:33:24.857897 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.857787    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 18:33:24.857897 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.857858    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 18:33:24.858167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.858148    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4q95x\""
Jul 27 18:33:24.908949 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.908882    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:24.909090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.908963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7f73a47f-ed0f-4737-93d9-37d68157e388-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:24.909090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.909001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f73a47f-ed0f-4737-93d9-37d68157e388-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:24.909090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.909026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:24.909090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.909062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:24.909323 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:24.909131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6rd4\" (UniqueName: \"kubernetes.io/projected/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-api-access-k6rd4\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.010515 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.010515 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-textfile\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.010730 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-root\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.010730 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msz65\" (UniqueName: \"kubernetes.io/projected/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-kube-api-access-msz65\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.010730 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-sys\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.010730 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-wtmp\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.010970 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.010970 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7f73a47f-ed0f-4737-93d9-37d68157e388-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.010970 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f73a47f-ed0f-4737-93d9-37d68157e388-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.010970 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.010970 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.010970 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-tls\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.010970 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.010970 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.011212 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.010993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d22adf8f-5aa5-4c9b-a87f-48c601238259-metrics-client-ca\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.011212 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.011042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6rd4\" (UniqueName: \"kubernetes.io/projected/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-api-access-k6rd4\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.011212 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.011061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-accelerators-collector-config\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.011212 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.011082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.011212 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.011098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5fbc\" (UniqueName: \"kubernetes.io/projected/d22adf8f-5aa5-4c9b-a87f-48c601238259-kube-api-access-d5fbc\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.011402 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.011224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7f73a47f-ed0f-4737-93d9-37d68157e388-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.011622 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.011597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f73a47f-ed0f-4737-93d9-37d68157e388-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.012018 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.011976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.013841 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.013818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.013930 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.013820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.021444 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.021409    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6rd4\" (UniqueName: \"kubernetes.io/projected/7f73a47f-ed0f-4737-93d9-37d68157e388-kube-api-access-k6rd4\") pod \"kube-state-metrics-56d9f944b4-v9rm8\" (UID: \"7f73a47f-ed0f-4737-93d9-37d68157e388\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.111325 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"
Jul 27 18:33:25.111528 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-accelerators-collector-config\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111528 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5fbc\" (UniqueName: \"kubernetes.io/projected/d22adf8f-5aa5-4c9b-a87f-48c601238259-kube-api-access-d5fbc\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111528 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.111692 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-textfile\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111692 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-root\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111692 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msz65\" (UniqueName: \"kubernetes.io/projected/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-kube-api-access-msz65\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.111692 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-sys\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111692 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-wtmp\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111692 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111960 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.111960 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-tls\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111960 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.111960 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d22adf8f-5aa5-4c9b-a87f-48c601238259-metrics-client-ca\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.111960 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.111916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-textfile\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.112191 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.112055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-accelerators-collector-config\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.112191 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:33:25.112134    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 18:33:25.112191 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.112145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-root\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.112338 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:33:25.112199    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-tls podName:d22adf8f-5aa5-4c9b-a87f-48c601238259 nodeName:}" failed. No retries permitted until 2026-07-27 18:33:25.612176598 +0000 UTC m=+103.695459438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-tls") pod "node-exporter-97j9d" (UID: "d22adf8f-5aa5-4c9b-a87f-48c601238259") : secret "node-exporter-tls" not found
Jul 27 18:33:25.112403 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.112341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d22adf8f-5aa5-4c9b-a87f-48c601238259-metrics-client-ca\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.112403 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.112359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-sys\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.112714 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.112684    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-wtmp\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.112815 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.112724    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.115085 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.115062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.115224 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.115204    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.115732 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.115700    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.121544 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.121522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5fbc\" (UniqueName: \"kubernetes.io/projected/d22adf8f-5aa5-4c9b-a87f-48c601238259-kube-api-access-d5fbc\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.122015 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.121991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msz65\" (UniqueName: \"kubernetes.io/projected/fcb13f38-24d7-4bdb-9f87-a1034c642ddc-kube-api-access-msz65\") pod \"openshift-state-metrics-b8f49f5c6-fsjhr\" (UID: \"fcb13f38-24d7-4bdb-9f87-a1034c642ddc\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.137926 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.137906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"
Jul 27 18:33:25.616218 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.616181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-tls\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.618522 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.618500    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d22adf8f-5aa5-4c9b-a87f-48c601238259-node-exporter-tls\") pod \"node-exporter-97j9d\" (UID: \"d22adf8f-5aa5-4c9b-a87f-48c601238259\") " pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.763899 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.763864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-97j9d"
Jul 27 18:33:25.792522 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:25.792479    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22adf8f_5aa5_4c9b_a87f_48c601238259.slice/crio-5aad0f55e7837dd824499fbf036455d91daaeaafd9e4bcffc616bd7475e22e9d WatchSource:0}: Error finding container 5aad0f55e7837dd824499fbf036455d91daaeaafd9e4bcffc616bd7475e22e9d: Status 404 returned error can't find the container with id 5aad0f55e7837dd824499fbf036455d91daaeaafd9e4bcffc616bd7475e22e9d
Jul 27 18:33:25.914408 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.914376    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97j9d" event={"ID":"d22adf8f-5aa5-4c9b-a87f-48c601238259","Type":"ContainerStarted","Data":"5aad0f55e7837dd824499fbf036455d91daaeaafd9e4bcffc616bd7475e22e9d"}
Jul 27 18:33:25.981816 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.981789    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr"]
Jul 27 18:33:25.982373 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:25.982339    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb13f38_24d7_4bdb_9f87_a1034c642ddc.slice/crio-e803f3d0410255cb538fb31884f3edd653bd90561f8a9fe58dd790747c5ea827 WatchSource:0}: Error finding container e803f3d0410255cb538fb31884f3edd653bd90561f8a9fe58dd790747c5ea827: Status 404 returned error can't find the container with id e803f3d0410255cb538fb31884f3edd653bd90561f8a9fe58dd790747c5ea827
Jul 27 18:33:25.988413 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:25.988391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8"]
Jul 27 18:33:25.991121 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:25.991097    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f73a47f_ed0f_4737_93d9_37d68157e388.slice/crio-a6a2c3f98ca045ec6f649f34304b2eedd19fd738dbfac29ab8a29fc5d81f2eba WatchSource:0}: Error finding container a6a2c3f98ca045ec6f649f34304b2eedd19fd738dbfac29ab8a29fc5d81f2eba: Status 404 returned error can't find the container with id a6a2c3f98ca045ec6f649f34304b2eedd19fd738dbfac29ab8a29fc5d81f2eba
Jul 27 18:33:26.751163 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.751121    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"]
Jul 27 18:33:26.754671 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.754640    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.758275 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.758248    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 18:33:26.758394 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.758345    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9skl3oc5so3ak\""
Jul 27 18:33:26.758504 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.758491    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 18:33:26.758563 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.758258    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 18:33:26.758922 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.758902    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 18:33:26.760482 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.759625    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 18:33:26.760482 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.759763    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2lsfl\""
Jul 27 18:33:26.772866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.772838    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"]
Jul 27 18:33:26.920877 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.920849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr" event={"ID":"fcb13f38-24d7-4bdb-9f87-a1034c642ddc","Type":"ContainerStarted","Data":"2d7e2bdd1122addec3f17fda5cd5facd7fde8bdf9f6a67782f8043513a80169e"}
Jul 27 18:33:26.920966 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.920910    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr" event={"ID":"fcb13f38-24d7-4bdb-9f87-a1034c642ddc","Type":"ContainerStarted","Data":"68a2356dabb2f214dfe15b69f4eb8fda2f29bfd0f980995f4dfca8bae529ef50"}
Jul 27 18:33:26.920966 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.920941    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr" event={"ID":"fcb13f38-24d7-4bdb-9f87-a1034c642ddc","Type":"ContainerStarted","Data":"e803f3d0410255cb538fb31884f3edd653bd90561f8a9fe58dd790747c5ea827"}
Jul 27 18:33:26.922046 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.922017    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8" event={"ID":"7f73a47f-ed0f-4737-93d9-37d68157e388","Type":"ContainerStarted","Data":"a6a2c3f98ca045ec6f649f34304b2eedd19fd738dbfac29ab8a29fc5d81f2eba"}
Jul 27 18:33:26.923854 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.923830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gqfk5" event={"ID":"d62bb39d-a949-4a30-9c1c-5319e80934ef","Type":"ContainerStarted","Data":"0395fb637c21188126975f95f7651027ab38e15536827f04e8650c281373be88"}
Jul 27 18:33:26.926017 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.925989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ss2h2" event={"ID":"40cb2b19-a295-4478-982e-b36ff0580035","Type":"ContainerStarted","Data":"465145df7ce92d12825b4c25d957714c4103092ffcaf10dbbdf70e68460c0343"}
Jul 27 18:33:26.926089 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.926037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ss2h2" event={"ID":"40cb2b19-a295-4478-982e-b36ff0580035","Type":"ContainerStarted","Data":"1fef5d61eba3ba4e5b7aedd743df936086cc3558eca001bf4071d21605f60a57"}
Jul 27 18:33:26.926089 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.926065    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:33:26.927687 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.927657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97j9d" event={"ID":"d22adf8f-5aa5-4c9b-a87f-48c601238259","Type":"ContainerStarted","Data":"d4868817a3d475d2e08469f40f51c04c77fcb794464af8ec6412b3a1686cfba8"}
Jul 27 18:33:26.927957 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.927940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.928004 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.927966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-grpc-tls\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.928004 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.927987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.928102 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.928004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46ff\" (UniqueName: \"kubernetes.io/projected/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-kube-api-access-s46ff\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.928102 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.928027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.928102 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.928070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.928264 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.928109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-tls\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.928264 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.928173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-metrics-client-ca\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:26.945832 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.945794    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gqfk5" podStartSLOduration=2.456625557 podStartE2EDuration="16.94578106s" totalImagesPullingTime="14.489155503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:33:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:26.94506404 +0000 UTC m=+105.028346892" watchObservedRunningTime="2026-07-27 18:33:26.94578106 +0000 UTC m=+105.029063915"
Jul 27 18:33:26.966400 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:26.966341    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ss2h2" podStartSLOduration=66.421693401 podStartE2EDuration="1m9.966320574s" totalImagesPullingTime="3.544627173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:26.964585373 +0000 UTC m=+105.047868227" watchObservedRunningTime="2026-07-27 18:33:26.966320574 +0000 UTC m=+105.049603427"
Jul 27 18:33:27.029634 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.029567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-metrics-client-ca\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.029760 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.029735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.029800 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.029774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-grpc-tls\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.029857 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.029824    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.029971 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.029885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s46ff\" (UniqueName: \"kubernetes.io/projected/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-kube-api-access-s46ff\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.029971 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.029924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.029971 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.029960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.030123 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.029992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-tls\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.030861 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.030833    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-metrics-client-ca\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.033131 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.033106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.033242 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.033180    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.033283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.033237    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.033318 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.033302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.033499 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.033479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-grpc-tls\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.033545 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.033479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-secret-thanos-querier-tls\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.046777 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.046754    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46ff\" (UniqueName: \"kubernetes.io/projected/7104f9d5-f368-48fe-aa8e-4a7b9d626f3b-kube-api-access-s46ff\") pod \"thanos-querier-7794d7dd9f-7qzfb\" (UID: \"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b\") " pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.067643 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.067623    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:27.212284 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.212139    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"]
Jul 27 18:33:27.504277 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:27.504241    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7104f9d5_f368_48fe_aa8e_4a7b9d626f3b.slice/crio-421c08f1354b289f1d69c190a197b217a482992a1e5279b2f2ede293af61ff0f WatchSource:0}: Error finding container 421c08f1354b289f1d69c190a197b217a482992a1e5279b2f2ede293af61ff0f: Status 404 returned error can't find the container with id 421c08f1354b289f1d69c190a197b217a482992a1e5279b2f2ede293af61ff0f
Jul 27 18:33:27.933948 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.933912    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8" event={"ID":"7f73a47f-ed0f-4737-93d9-37d68157e388","Type":"ContainerStarted","Data":"b2d89a7436f4cd66bfeed9e400f102134a7fe3adf9e90099bdd5776d3bb75cd7"}
Jul 27 18:33:27.934510 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.933987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8" event={"ID":"7f73a47f-ed0f-4737-93d9-37d68157e388","Type":"ContainerStarted","Data":"307ad27377ae96b7aa1a696df6ee6a6374b95bd0f5225d9f5dba9c8deced3ddd"}
Jul 27 18:33:27.934510 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.934017    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8" event={"ID":"7f73a47f-ed0f-4737-93d9-37d68157e388","Type":"ContainerStarted","Data":"ae731db6dda9888c2ddca420a5b3f59869d51f5ff6c11707f0a3d9e72ae9b96d"}
Jul 27 18:33:27.935677 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.935648    2577 generic.go:356] "Generic (PLEG): container finished" podID="d22adf8f-5aa5-4c9b-a87f-48c601238259" containerID="d4868817a3d475d2e08469f40f51c04c77fcb794464af8ec6412b3a1686cfba8" exitCode=0
Jul 27 18:33:27.935805 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.935734    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97j9d" event={"ID":"d22adf8f-5aa5-4c9b-a87f-48c601238259","Type":"ContainerDied","Data":"d4868817a3d475d2e08469f40f51c04c77fcb794464af8ec6412b3a1686cfba8"}
Jul 27 18:33:27.937014 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:27.936990    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb" event={"ID":"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b","Type":"ContainerStarted","Data":"421c08f1354b289f1d69c190a197b217a482992a1e5279b2f2ede293af61ff0f"}
Jul 27 18:33:28.020809 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:28.019864    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-v9rm8" podStartSLOduration=2.485112387 podStartE2EDuration="4.019843286s" totalImagesPullingTime="1.534730899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:27.976856775 +0000 UTC m=+106.060139638" watchObservedRunningTime="2026-07-27 18:33:28.019843286 +0000 UTC m=+106.103126138"
Jul 27 18:33:28.942490 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:28.942446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr" event={"ID":"fcb13f38-24d7-4bdb-9f87-a1034c642ddc","Type":"ContainerStarted","Data":"bb8beea7403e18a1e2d7a00d094ffa0963067744b43cdc20b5675dc52cca5f25"}
Jul 27 18:33:28.944722 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:28.944696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97j9d" event={"ID":"d22adf8f-5aa5-4c9b-a87f-48c601238259","Type":"ContainerStarted","Data":"fc98e793c542952e9bad9dad5ca0b052544a73d15c0dd97e588aaefcf285c9b1"}
Jul 27 18:33:28.944840 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:28.944737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97j9d" event={"ID":"d22adf8f-5aa5-4c9b-a87f-48c601238259","Type":"ContainerStarted","Data":"bdbeecfd5856fd87d007fc744576b11c96c6b425901286579decb6cede6ff912"}
Jul 27 18:33:29.019712 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.019658    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-97j9d" podStartSLOduration=3.895377364 podStartE2EDuration="5.019642189s" totalImagesPullingTime="1.048914336s" totalInitContainerRuntime="75.350489ms" isStatefulPod=true podCreationTimestamp="2026-07-27 18:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:29.01957736 +0000 UTC m=+107.102860224" watchObservedRunningTime="2026-07-27 18:33:29.019642189 +0000 UTC m=+107.102925032"
Jul 27 18:33:29.020391 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.020354    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fsjhr" podStartSLOduration=3.077703101 podStartE2EDuration="5.020342013s" totalImagesPullingTime="1.942638912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:28.976977651 +0000 UTC m=+107.060260503" watchObservedRunningTime="2026-07-27 18:33:29.020342013 +0000 UTC m=+107.103624864"
Jul 27 18:33:29.182745 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.182707    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"]
Jul 27 18:33:29.185966 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.185944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.189491 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.189466    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-nl8377psnrqc\""
Jul 27 18:33:29.189595 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.189509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 18:33:29.189851 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.189834    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 18:33:29.189928 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.189860    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 18:33:29.190557 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.190535    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x5wq9\""
Jul 27 18:33:29.193251 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.193018    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 18:33:29.202319 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.202293    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"]
Jul 27 18:33:29.335269 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.335240    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"]
Jul 27 18:33:29.338074 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.338052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:29.341208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.341187    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 18:33:29.341770 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.341748    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wmxvs\""
Jul 27 18:33:29.349570 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.349547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e000bdef-a886-4bc8-b199-aecf7928a518-metrics-server-audit-profiles\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.349693 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.349620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e000bdef-a886-4bc8-b199-aecf7928a518-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.349756 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.349700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj9jg\" (UniqueName: \"kubernetes.io/projected/e000bdef-a886-4bc8-b199-aecf7928a518-kube-api-access-lj9jg\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.349756 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.349736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-secret-metrics-server-tls\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.349866 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.349834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-secret-metrics-server-client-certs\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.349915 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.349875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e000bdef-a886-4bc8-b199-aecf7928a518-audit-log\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.349964 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.349914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-client-ca-bundle\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.349964 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.349924    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"]
Jul 27 18:33:29.450931 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.450837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e000bdef-a886-4bc8-b199-aecf7928a518-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.450931 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.450921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj9jg\" (UniqueName: \"kubernetes.io/projected/e000bdef-a886-4bc8-b199-aecf7928a518-kube-api-access-lj9jg\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.451149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.450973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8a3d052-a123-4927-828a-13a89de61c9b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xpl9g\" (UID: \"e8a3d052-a123-4927-828a-13a89de61c9b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:29.451149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.451007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-secret-metrics-server-tls\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.451149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.451061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7xnf\" (UniqueName: \"kubernetes.io/projected/e8a3d052-a123-4927-828a-13a89de61c9b-kube-api-access-v7xnf\") pod \"monitoring-plugin-68b7fc9574-xpl9g\" (UID: \"e8a3d052-a123-4927-828a-13a89de61c9b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:29.451149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.451080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-secret-metrics-server-client-certs\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.451149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.451097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e000bdef-a886-4bc8-b199-aecf7928a518-audit-log\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.451149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.451121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-client-ca-bundle\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.451336 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.451153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e000bdef-a886-4bc8-b199-aecf7928a518-metrics-server-audit-profiles\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.451948 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.451913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e000bdef-a886-4bc8-b199-aecf7928a518-audit-log\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.452218 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.452196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e000bdef-a886-4bc8-b199-aecf7928a518-metrics-server-audit-profiles\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.452316 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.452257    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e000bdef-a886-4bc8-b199-aecf7928a518-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.454473 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.454451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-secret-metrics-server-client-certs\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.454738 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.454716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-secret-metrics-server-tls\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.454789 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.454720    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e000bdef-a886-4bc8-b199-aecf7928a518-client-ca-bundle\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.464792 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.464768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj9jg\" (UniqueName: \"kubernetes.io/projected/e000bdef-a886-4bc8-b199-aecf7928a518-kube-api-access-lj9jg\") pod \"metrics-server-5bbcd8d5bd-pq9vh\" (UID: \"e000bdef-a886-4bc8-b199-aecf7928a518\") " pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.497120 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.497089    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:29.552544 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.552257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7xnf\" (UniqueName: \"kubernetes.io/projected/e8a3d052-a123-4927-828a-13a89de61c9b-kube-api-access-v7xnf\") pod \"monitoring-plugin-68b7fc9574-xpl9g\" (UID: \"e8a3d052-a123-4927-828a-13a89de61c9b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:29.552544 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.552385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8a3d052-a123-4927-828a-13a89de61c9b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xpl9g\" (UID: \"e8a3d052-a123-4927-828a-13a89de61c9b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:29.552731 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:33:29.552559    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 18:33:29.552731 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:33:29.552631    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a3d052-a123-4927-828a-13a89de61c9b-monitoring-plugin-cert podName:e8a3d052-a123-4927-828a-13a89de61c9b nodeName:}" failed. No retries permitted until 2026-07-27 18:33:30.052609737 +0000 UTC m=+108.135892567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e8a3d052-a123-4927-828a-13a89de61c9b-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-xpl9g" (UID: "e8a3d052-a123-4927-828a-13a89de61c9b") : secret "monitoring-plugin-cert" not found
Jul 27 18:33:29.562900 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.562842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7xnf\" (UniqueName: \"kubernetes.io/projected/e8a3d052-a123-4927-828a-13a89de61c9b-kube-api-access-v7xnf\") pod \"monitoring-plugin-68b7fc9574-xpl9g\" (UID: \"e8a3d052-a123-4927-828a-13a89de61c9b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:29.668317 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.668231    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"]
Jul 27 18:33:29.669914 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:29.669891    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode000bdef_a886_4bc8_b199_aecf7928a518.slice/crio-b89498487bf3bc45d1f8ad2912e112fdca4b78d1fa1cf3b94ea42112808b1aa0 WatchSource:0}: Error finding container b89498487bf3bc45d1f8ad2912e112fdca4b78d1fa1cf3b94ea42112808b1aa0: Status 404 returned error can't find the container with id b89498487bf3bc45d1f8ad2912e112fdca4b78d1fa1cf3b94ea42112808b1aa0
Jul 27 18:33:29.918723 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.918687    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"]
Jul 27 18:33:29.921058 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.921042    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:29.927721 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.927699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 18:33:29.927721 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.927720    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 18:33:29.928545 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.928528    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 18:33:29.928733 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.928716    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f897g\""
Jul 27 18:33:29.928829 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.928719    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 18:33:29.929094 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.929077    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 18:33:29.933749 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.933731    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 18:33:29.951393 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.951362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb" event={"ID":"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b","Type":"ContainerStarted","Data":"82b3def6e0b68405c2deb368ba418e12a098d1f759fd62c5ec2351540992db29"}
Jul 27 18:33:29.951774 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.951440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb" event={"ID":"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b","Type":"ContainerStarted","Data":"9789466a7e6b58dbb96bce9dad456ff9cbaf70db8bb74331795222ab65c75183"}
Jul 27 18:33:29.951774 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.951472    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb" event={"ID":"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b","Type":"ContainerStarted","Data":"d9501cd80f12856f1a9e40ac1732ca5234c91dc693f6615f09f90307bb7becf8"}
Jul 27 18:33:29.952685 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.952663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh" event={"ID":"e000bdef-a886-4bc8-b199-aecf7928a518","Type":"ContainerStarted","Data":"b89498487bf3bc45d1f8ad2912e112fdca4b78d1fa1cf3b94ea42112808b1aa0"}
Jul 27 18:33:29.955867 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.955843    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"]
Jul 27 18:33:29.956595 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.956575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-secret-telemeter-client\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:29.956595 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.956600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-metrics-client-ca\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:29.956771 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.956756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:29.956831 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.956778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdtqf\" (UniqueName: \"kubernetes.io/projected/d1a8189e-45ea-4862-8689-320bea1297b2-kube-api-access-zdtqf\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:29.956880 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.956836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-serving-certs-ca-bundle\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:29.956880 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.956865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-federate-client-tls\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:29.956979 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.956924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-telemeter-client-tls\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:29.957054 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:29.957027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.057576 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8a3d052-a123-4927-828a-13a89de61c9b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xpl9g\" (UID: \"e8a3d052-a123-4927-828a-13a89de61c9b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:30.057576 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-secret-telemeter-client\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.057576 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-metrics-client-ca\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.057855 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.057855 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdtqf\" (UniqueName: \"kubernetes.io/projected/d1a8189e-45ea-4862-8689-320bea1297b2-kube-api-access-zdtqf\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.057855 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-serving-certs-ca-bundle\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.057855 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-federate-client-tls\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.057855 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-telemeter-client-tls\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.057855 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.057746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.058495 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.058446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-metrics-client-ca\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.058607 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.058532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-serving-certs-ca-bundle\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.059131 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.059106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a8189e-45ea-4862-8689-320bea1297b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.060466 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.060414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.060770 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.060750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8a3d052-a123-4927-828a-13a89de61c9b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-xpl9g\" (UID: \"e8a3d052-a123-4927-828a-13a89de61c9b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:30.060853 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.060832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-telemeter-client-tls\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.060889 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.060873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-secret-telemeter-client\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.060932 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.060924    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d1a8189e-45ea-4862-8689-320bea1297b2-federate-client-tls\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.068688 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.068670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdtqf\" (UniqueName: \"kubernetes.io/projected/d1a8189e-45ea-4862-8689-320bea1297b2-kube-api-access-zdtqf\") pod \"telemeter-client-d4978cbd5-zgw9g\" (UID: \"d1a8189e-45ea-4862-8689-320bea1297b2\") " pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.229684 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.229648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"
Jul 27 18:33:30.248947 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.248872    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:30.388729 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.388708    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"]
Jul 27 18:33:30.391631 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:30.391599    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a3d052_a123_4927_828a_13a89de61c9b.slice/crio-fd64d2fbec1f59e347f665e6d3f5e1634aa7f4f9544eee85083a4da7e63fbd2b WatchSource:0}: Error finding container fd64d2fbec1f59e347f665e6d3f5e1634aa7f4f9544eee85083a4da7e63fbd2b: Status 404 returned error can't find the container with id fd64d2fbec1f59e347f665e6d3f5e1634aa7f4f9544eee85083a4da7e63fbd2b
Jul 27 18:33:30.391818 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.391797    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d4978cbd5-zgw9g"]
Jul 27 18:33:30.394942 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:30.394925    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a8189e_45ea_4862_8689_320bea1297b2.slice/crio-af16b5a38900478f9472a9e336b02075830258b446c31eb51e98eabf5c3868f1 WatchSource:0}: Error finding container af16b5a38900478f9472a9e336b02075830258b446c31eb51e98eabf5c3868f1: Status 404 returned error can't find the container with id af16b5a38900478f9472a9e336b02075830258b446c31eb51e98eabf5c3868f1
Jul 27 18:33:30.961956 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.961524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb" event={"ID":"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b","Type":"ContainerStarted","Data":"007856b67f522a13fc60e17b15b3ccdea9b320c8dd564750e0483c89f7a21a5a"}
Jul 27 18:33:30.963024 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.962973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g" event={"ID":"e8a3d052-a123-4927-828a-13a89de61c9b","Type":"ContainerStarted","Data":"fd64d2fbec1f59e347f665e6d3f5e1634aa7f4f9544eee85083a4da7e63fbd2b"}
Jul 27 18:33:30.966639 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:30.966610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g" event={"ID":"d1a8189e-45ea-4862-8689-320bea1297b2","Type":"ContainerStarted","Data":"af16b5a38900478f9472a9e336b02075830258b446c31eb51e98eabf5c3868f1"}
Jul 27 18:33:31.976495 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:31.975813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb" event={"ID":"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b","Type":"ContainerStarted","Data":"4cb6b7f453eee8fa48954f5ca4590cc24a242c169a20f4e926f1bfe8d552b037"}
Jul 27 18:33:31.976495 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:31.975895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb" event={"ID":"7104f9d5-f368-48fe-aa8e-4a7b9d626f3b","Type":"ContainerStarted","Data":"be75e85e8b9032b4214c2ae5c051ce4dd48de33f6e6f17c32eb9e67651c84476"}
Jul 27 18:33:31.976495 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:31.975976    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:31.977827 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:31.977795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh" event={"ID":"e000bdef-a886-4bc8-b199-aecf7928a518","Type":"ContainerStarted","Data":"8ca33368e550f272c9d7c4aadd73c1a07cba6a1af5cd397d857630ee979705b5"}
Jul 27 18:33:32.004789 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:32.004728    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb" podStartSLOduration=2.895510116 podStartE2EDuration="6.004706736s" totalImagesPullingTime="3.10919662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:32.002059508 +0000 UTC m=+110.085342395" watchObservedRunningTime="2026-07-27 18:33:32.004706736 +0000 UTC m=+110.087989590"
Jul 27 18:33:32.022858 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:32.021670    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh" podStartSLOduration=0.988249136 podStartE2EDuration="3.02164945s" totalImagesPullingTime="2.033400314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:32.021273931 +0000 UTC m=+110.104556782" watchObservedRunningTime="2026-07-27 18:33:32.02164945 +0000 UTC m=+110.104932303"
Jul 27 18:33:32.848765 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:32.848732    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-784b6d6fd5-kjwfl"
Jul 27 18:33:32.983460 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:32.983358    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g" event={"ID":"e8a3d052-a123-4927-828a-13a89de61c9b","Type":"ContainerStarted","Data":"f419f466ea9031a1c7062d97d9b14e7a6d18024386b73938a40cf96d6fdd445b"}
Jul 27 18:33:32.983875 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:32.983642    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:32.985206 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:32.985176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g" event={"ID":"d1a8189e-45ea-4862-8689-320bea1297b2","Type":"ContainerStarted","Data":"30649ab27e5e0342bb70eb383410a07baf12f8a8e0d9eedf3651a9f7278758ed"}
Jul 27 18:33:32.988687 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:32.988661    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g"
Jul 27 18:33:33.002345 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:33.002308    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-xpl9g" podStartSLOduration=1.771189699 podStartE2EDuration="4.002295311s" totalImagesPullingTime="2.231105612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:33.000672175 +0000 UTC m=+111.083955046" watchObservedRunningTime="2026-07-27 18:33:33.002295311 +0000 UTC m=+111.085578153"
Jul 27 18:33:33.991410 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:33.991371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g" event={"ID":"d1a8189e-45ea-4862-8689-320bea1297b2","Type":"ContainerStarted","Data":"3429f1dc8412a6cdcd4595db5f3e97f53c027eade604e4192df1b0c9f6764b1a"}
Jul 27 18:33:33.991784 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:33.991458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g" event={"ID":"d1a8189e-45ea-4862-8689-320bea1297b2","Type":"ContainerStarted","Data":"77afa3d41f3a9e4cd8250a9d57492734bdd750d897fa5eda62eaba6d217799e5"}
Jul 27 18:33:34.020169 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:34.020112    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d4978cbd5-zgw9g" podStartSLOduration=1.893380745 podStartE2EDuration="5.020094826s" totalImagesPullingTime="3.126714081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:34.014547619 +0000 UTC m=+112.097830471" watchObservedRunningTime="2026-07-27 18:33:34.020094826 +0000 UTC m=+112.103377677"
Jul 27 18:33:35.746532 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:35.746490    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms" podUID="b8b9941b-19d3-498c-a069-b23d386a6a91" containerName="registry" containerID="cri-o://f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5" gracePeriod=30
Jul 27 18:33:35.999085 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:35.999032    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:33:36.001107 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.001080    2577 generic.go:356] "Generic (PLEG): container finished" podID="b8b9941b-19d3-498c-a069-b23d386a6a91" containerID="f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5" exitCode=0
Jul 27 18:33:36.001209 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.001115    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms"
Jul 27 18:33:36.001209 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.001128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms" event={"ID":"b8b9941b-19d3-498c-a069-b23d386a6a91","Type":"ContainerDied","Data":"f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5"}
Jul 27 18:33:36.001209 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.001174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65df9f5ffb-bdcms" event={"ID":"b8b9941b-19d3-498c-a069-b23d386a6a91","Type":"ContainerDied","Data":"68a1bafa1d126beb7e1ef4941b82acc867b6393194b50c1f5c73e8f8588ff0a6"}
Jul 27 18:33:36.001209 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.001198    2577 scope.go:117] "RemoveContainer" containerID="f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5"
Jul 27 18:33:36.009273 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.009253    2577 scope.go:117] "RemoveContainer" containerID="f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5"
Jul 27 18:33:36.010167 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:33:36.010122    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5\": container with ID starting with f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5 not found: ID does not exist" containerID="f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5"
Jul 27 18:33:36.010369 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.010304    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5"} err="failed to get container status \"f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5\": rpc error: code = NotFound desc = could not find container \"f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5\": container with ID starting with f24c670cfe4741c6486510a9e20b22cf9b28afe86ab361e60804e6123f70f9d5 not found: ID does not exist"
Jul 27 18:33:36.013797 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.013779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44fcj\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-kube-api-access-44fcj\") pod \"b8b9941b-19d3-498c-a069-b23d386a6a91\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") "
Jul 27 18:33:36.013891 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.013809    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-image-registry-private-configuration\") pod \"b8b9941b-19d3-498c-a069-b23d386a6a91\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") "
Jul 27 18:33:36.013891 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.013830    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-trusted-ca\") pod \"b8b9941b-19d3-498c-a069-b23d386a6a91\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") "
Jul 27 18:33:36.013891 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.013873    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-certificates\") pod \"b8b9941b-19d3-498c-a069-b23d386a6a91\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") "
Jul 27 18:33:36.013891 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.013893    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") pod \"b8b9941b-19d3-498c-a069-b23d386a6a91\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") "
Jul 27 18:33:36.014101 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.014065    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8b9941b-19d3-498c-a069-b23d386a6a91-ca-trust-extracted\") pod \"b8b9941b-19d3-498c-a069-b23d386a6a91\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") "
Jul 27 18:33:36.014159 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.014123    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-installation-pull-secrets\") pod \"b8b9941b-19d3-498c-a069-b23d386a6a91\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") "
Jul 27 18:33:36.014207 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.014166    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-bound-sa-token\") pod \"b8b9941b-19d3-498c-a069-b23d386a6a91\" (UID: \"b8b9941b-19d3-498c-a069-b23d386a6a91\") "
Jul 27 18:33:36.014440 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.014400    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b8b9941b-19d3-498c-a069-b23d386a6a91" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:33:36.014732 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.014453    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b8b9941b-19d3-498c-a069-b23d386a6a91" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:33:36.018473 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.018401    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b8b9941b-19d3-498c-a069-b23d386a6a91" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:33:36.018754 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.018721    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b8b9941b-19d3-498c-a069-b23d386a6a91" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:33:36.018999 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.018963    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-kube-api-access-44fcj" (OuterVolumeSpecName: "kube-api-access-44fcj") pod "b8b9941b-19d3-498c-a069-b23d386a6a91" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91"). InnerVolumeSpecName "kube-api-access-44fcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:33:36.019220 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.019195    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b8b9941b-19d3-498c-a069-b23d386a6a91" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:33:36.020037 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.020012    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b8b9941b-19d3-498c-a069-b23d386a6a91" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:33:36.044900 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.044861    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8b9941b-19d3-498c-a069-b23d386a6a91-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b8b9941b-19d3-498c-a069-b23d386a6a91" (UID: "b8b9941b-19d3-498c-a069-b23d386a6a91"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:33:36.115103 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.115059    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8b9941b-19d3-498c-a069-b23d386a6a91-ca-trust-extracted\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:33:36.115103 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.115096    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-installation-pull-secrets\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:33:36.115103 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.115110    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-bound-sa-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:33:36.115346 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.115122    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44fcj\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-kube-api-access-44fcj\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:33:36.115346 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.115137    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8b9941b-19d3-498c-a069-b23d386a6a91-image-registry-private-configuration\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:33:36.115346 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.115150    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-trusted-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:33:36.115346 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.115162    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-certificates\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:33:36.115346 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.115173    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8b9941b-19d3-498c-a069-b23d386a6a91-registry-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:33:36.323651 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.323619    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65df9f5ffb-bdcms"]
Jul 27 18:33:36.330770 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.330743    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65df9f5ffb-bdcms"]
Jul 27 18:33:36.509778 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.509746    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8b9941b-19d3-498c-a069-b23d386a6a91" path="/var/lib/kubelet/pods/b8b9941b-19d3-498c-a069-b23d386a6a91/volumes"
Jul 27 18:33:36.939266 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:36.939240    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ss2h2"
Jul 27 18:33:37.990961 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:37.990932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7794d7dd9f-7qzfb"
Jul 27 18:33:38.706858 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.706824    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-s6rc7"]
Jul 27 18:33:38.707127 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.707116    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b9941b-19d3-498c-a069-b23d386a6a91" containerName="registry"
Jul 27 18:33:38.707166 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.707130    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b9941b-19d3-498c-a069-b23d386a6a91" containerName="registry"
Jul 27 18:33:38.707213 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.707184    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8b9941b-19d3-498c-a069-b23d386a6a91" containerName="registry"
Jul 27 18:33:38.710520 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.710499    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-s6rc7"
Jul 27 18:33:38.713141 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.713124    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 18:33:38.713252 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.713130    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-55gw8\""
Jul 27 18:33:38.713252 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.713231    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 18:33:38.725456 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.725412    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-s6rc7"]
Jul 27 18:33:38.735937 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.735918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqztl\" (UniqueName: \"kubernetes.io/projected/df32777f-f9f3-4b31-9bc4-3a69cec6047f-kube-api-access-gqztl\") pod \"downloads-7c97dc4555-s6rc7\" (UID: \"df32777f-f9f3-4b31-9bc4-3a69cec6047f\") " pod="openshift-console/downloads-7c97dc4555-s6rc7"
Jul 27 18:33:38.836904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.836870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqztl\" (UniqueName: \"kubernetes.io/projected/df32777f-f9f3-4b31-9bc4-3a69cec6047f-kube-api-access-gqztl\") pod \"downloads-7c97dc4555-s6rc7\" (UID: \"df32777f-f9f3-4b31-9bc4-3a69cec6047f\") " pod="openshift-console/downloads-7c97dc4555-s6rc7"
Jul 27 18:33:38.846559 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:38.846502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqztl\" (UniqueName: \"kubernetes.io/projected/df32777f-f9f3-4b31-9bc4-3a69cec6047f-kube-api-access-gqztl\") pod \"downloads-7c97dc4555-s6rc7\" (UID: \"df32777f-f9f3-4b31-9bc4-3a69cec6047f\") " pod="openshift-console/downloads-7c97dc4555-s6rc7"
Jul 27 18:33:39.018909 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:39.018832    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-s6rc7"
Jul 27 18:33:39.166180 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:39.166103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-s6rc7"]
Jul 27 18:33:39.169583 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:39.169557    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf32777f_f9f3_4b31_9bc4_3a69cec6047f.slice/crio-fc21e51d7f186eae9b427c20eb4c25a2d2e0ec9b5690cd562361350c088b56dd WatchSource:0}: Error finding container fc21e51d7f186eae9b427c20eb4c25a2d2e0ec9b5690cd562361350c088b56dd: Status 404 returned error can't find the container with id fc21e51d7f186eae9b427c20eb4c25a2d2e0ec9b5690cd562361350c088b56dd
Jul 27 18:33:40.018584 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:40.018546    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-s6rc7" event={"ID":"df32777f-f9f3-4b31-9bc4-3a69cec6047f","Type":"ContainerStarted","Data":"fc21e51d7f186eae9b427c20eb4c25a2d2e0ec9b5690cd562361350c088b56dd"}
Jul 27 18:33:44.430471 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.430439    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59878b89b8-ttb5n"]
Jul 27 18:33:44.433586 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.433566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.442949 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.442930    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 18:33:44.443078 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.442994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 18:33:44.444341 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.444323    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 18:33:44.444606 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.444576    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cxrts\""
Jul 27 18:33:44.444714 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.444613    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 18:33:44.444714 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.444644    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 18:33:44.457090 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.456550    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59878b89b8-ttb5n"]
Jul 27 18:33:44.485928 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.485895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-oauth-config\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.486070 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.485943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-service-ca\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.486070 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.485971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgndv\" (UniqueName: \"kubernetes.io/projected/d2cca902-a9f2-49ae-bee9-9291335bf38d-kube-api-access-xgndv\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.486189 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.486090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-serving-cert\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.486189 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.486142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-oauth-serving-cert\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.486270 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.486216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-config\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.586937 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.586902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-serving-cert\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.586937 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.586945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-oauth-serving-cert\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.587167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.586996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-config\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.587167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.587027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-oauth-config\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.587167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.587052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-service-ca\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.587167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.587078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgndv\" (UniqueName: \"kubernetes.io/projected/d2cca902-a9f2-49ae-bee9-9291335bf38d-kube-api-access-xgndv\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.587928 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.587876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-service-ca\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.588039 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.588020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-oauth-serving-cert\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.588107 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.588059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-config\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.589662 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.589642    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-oauth-config\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.589894 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.589873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-serving-cert\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.595865 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.595846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgndv\" (UniqueName: \"kubernetes.io/projected/d2cca902-a9f2-49ae-bee9-9291335bf38d-kube-api-access-xgndv\") pod \"console-59878b89b8-ttb5n\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") " pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.744744 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.744650    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:44.886774 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:44.886748    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59878b89b8-ttb5n"]
Jul 27 18:33:44.889626 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:44.889592    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cca902_a9f2_49ae_bee9_9291335bf38d.slice/crio-e757f429df68e44f7e8e2097d64bb119d78b9c7c19607f1857d5f735805cccae WatchSource:0}: Error finding container e757f429df68e44f7e8e2097d64bb119d78b9c7c19607f1857d5f735805cccae: Status 404 returned error can't find the container with id e757f429df68e44f7e8e2097d64bb119d78b9c7c19607f1857d5f735805cccae
Jul 27 18:33:45.041516 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:45.041414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59878b89b8-ttb5n" event={"ID":"d2cca902-a9f2-49ae-bee9-9291335bf38d","Type":"ContainerStarted","Data":"e757f429df68e44f7e8e2097d64bb119d78b9c7c19607f1857d5f735805cccae"}
Jul 27 18:33:49.064377 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:49.064324    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59878b89b8-ttb5n" event={"ID":"d2cca902-a9f2-49ae-bee9-9291335bf38d","Type":"ContainerStarted","Data":"3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e"}
Jul 27 18:33:49.084820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:49.084760    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59878b89b8-ttb5n" podStartSLOduration=1.781938507 podStartE2EDuration="5.08474318s" totalImagesPullingTime="3.302804673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:49.083820748 +0000 UTC m=+127.167103600" watchObservedRunningTime="2026-07-27 18:33:49.08474318 +0000 UTC m=+127.168026085"
Jul 27 18:33:49.497810 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:49.497770    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:49.497999 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:49.497867    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:33:52.163036 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.162988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:33:52.165771 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.165744    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7daab18b-6c87-4142-986f-fc177bd358f4-metrics-certs\") pod \"network-metrics-daemon-qpflx\" (UID: \"7daab18b-6c87-4142-986f-fc177bd358f4\") " pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:33:52.415714 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.415636    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4wf8\""
Jul 27 18:33:52.423210 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.423182    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qpflx"
Jul 27 18:33:52.799897 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.799824    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8649f7944-5tcc7"]
Jul 27 18:33:52.802514 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.802484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.811378 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.811354    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 18:33:52.816820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.816790    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8649f7944-5tcc7"]
Jul 27 18:33:52.870267 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.870223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-oauth-serving-cert\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.870457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.870284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-serving-cert\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.870457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.870317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d9qb\" (UniqueName: \"kubernetes.io/projected/02e3330e-42b6-452a-b777-fb170f152186-kube-api-access-7d9qb\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.870457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.870377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-console-config\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.870606 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.870467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-oauth-config\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.870606 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.870539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-trusted-ca-bundle\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.870606 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.870589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-service-ca\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.971720 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.971677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-trusted-ca-bundle\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.971720 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.971724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-service-ca\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.971959 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.971745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-oauth-serving-cert\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.971959 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.971775    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-serving-cert\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.971959 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.971806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d9qb\" (UniqueName: \"kubernetes.io/projected/02e3330e-42b6-452a-b777-fb170f152186-kube-api-access-7d9qb\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.971959 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.971838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-console-config\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.971959 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.971893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-oauth-config\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.972530 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.972479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-service-ca\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.972670 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.972583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-oauth-serving-cert\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.972670 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.972630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-trusted-ca-bundle\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.972765 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.972675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-console-config\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.974675 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.974655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-oauth-config\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.974884 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.974864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-serving-cert\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:52.980457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:52.980418    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d9qb\" (UniqueName: \"kubernetes.io/projected/02e3330e-42b6-452a-b777-fb170f152186-kube-api-access-7d9qb\") pod \"console-8649f7944-5tcc7\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") " pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:53.116081 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:53.116049    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:33:54.745340 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:54.745303    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:54.745788 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:54.745377    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:54.751882 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:54.751849    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:55.094873 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:55.094843    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:33:57.083877 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:57.083849    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qpflx"]
Jul 27 18:33:57.087317 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:57.087294    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7daab18b_6c87_4142_986f_fc177bd358f4.slice/crio-3efc7fa6ea66fe4df65eedd82aa4f39e53a52b031b9e91f36c57643603d786fb WatchSource:0}: Error finding container 3efc7fa6ea66fe4df65eedd82aa4f39e53a52b031b9e91f36c57643603d786fb: Status 404 returned error can't find the container with id 3efc7fa6ea66fe4df65eedd82aa4f39e53a52b031b9e91f36c57643603d786fb
Jul 27 18:33:57.099331 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:57.099304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpflx" event={"ID":"7daab18b-6c87-4142-986f-fc177bd358f4","Type":"ContainerStarted","Data":"3efc7fa6ea66fe4df65eedd82aa4f39e53a52b031b9e91f36c57643603d786fb"}
Jul 27 18:33:57.100779 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:57.100758    2577 generic.go:356] "Generic (PLEG): container finished" podID="37586f43-d6b2-405a-91c3-0fd8d982b653" containerID="25d30a59f848c7037fedbe812552b6824655faf66bdb7cc016967e17817061d4" exitCode=0
Jul 27 18:33:57.100846 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:57.100827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d" event={"ID":"37586f43-d6b2-405a-91c3-0fd8d982b653","Type":"ContainerDied","Data":"25d30a59f848c7037fedbe812552b6824655faf66bdb7cc016967e17817061d4"}
Jul 27 18:33:57.101246 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:57.101231    2577 scope.go:117] "RemoveContainer" containerID="25d30a59f848c7037fedbe812552b6824655faf66bdb7cc016967e17817061d4"
Jul 27 18:33:57.108887 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:57.108872    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8649f7944-5tcc7"]
Jul 27 18:33:57.114348 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:33:57.114323    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e3330e_42b6_452a_b777_fb170f152186.slice/crio-19bd8f52040d2166448e79ce659059ac6fae1685b77dff15f9d3c5c16cecae6d WatchSource:0}: Error finding container 19bd8f52040d2166448e79ce659059ac6fae1685b77dff15f9d3c5c16cecae6d: Status 404 returned error can't find the container with id 19bd8f52040d2166448e79ce659059ac6fae1685b77dff15f9d3c5c16cecae6d
Jul 27 18:33:58.107955 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:58.107507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-s6rc7" event={"ID":"df32777f-f9f3-4b31-9bc4-3a69cec6047f","Type":"ContainerStarted","Data":"12966143463e64b725446dba965a4cde2851f8b6cf56c9dceff01210946f8d79"}
Jul 27 18:33:58.107955 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:58.107613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-s6rc7"
Jul 27 18:33:58.111161 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:58.111126    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d" event={"ID":"37586f43-d6b2-405a-91c3-0fd8d982b653","Type":"ContainerStarted","Data":"04365cc18a530625316bcef3c2b6bee44f0111cffe674a16bc270d321525f7c0"}
Jul 27 18:33:58.112947 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:58.112909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649f7944-5tcc7" event={"ID":"02e3330e-42b6-452a-b777-fb170f152186","Type":"ContainerStarted","Data":"2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60"}
Jul 27 18:33:58.113064 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:58.112963    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649f7944-5tcc7" event={"ID":"02e3330e-42b6-452a-b777-fb170f152186","Type":"ContainerStarted","Data":"19bd8f52040d2166448e79ce659059ac6fae1685b77dff15f9d3c5c16cecae6d"}
Jul 27 18:33:58.124662 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:58.124637    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-s6rc7"
Jul 27 18:33:58.144747 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:58.144687    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-s6rc7" podStartSLOduration=2.009295424 podStartE2EDuration="20.144670808s" totalImagesPullingTime="18.135375384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:58.126794125 +0000 UTC m=+136.210076976" watchObservedRunningTime="2026-07-27 18:33:58.144670808 +0000 UTC m=+136.227953658"
Jul 27 18:33:58.191598 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:58.191540    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8649f7944-5tcc7" podStartSLOduration=6.191522735 podStartE2EDuration="6.191522735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:58.191082336 +0000 UTC m=+136.274365197" watchObservedRunningTime="2026-07-27 18:33:58.191522735 +0000 UTC m=+136.274805586"
Jul 27 18:33:59.119943 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:59.119904    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpflx" event={"ID":"7daab18b-6c87-4142-986f-fc177bd358f4","Type":"ContainerStarted","Data":"fbd964418e573083b62df79ba5bc003d71fd001c5e93f38211f513ced48215bd"}
Jul 27 18:33:59.120408 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:59.119967    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qpflx" event={"ID":"7daab18b-6c87-4142-986f-fc177bd358f4","Type":"ContainerStarted","Data":"59fb1edaf31fcdb12f4c20fc49113fce108ac4a285d81d9a56ba9b0b75fcbe8d"}
Jul 27 18:33:59.136814 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:33:59.136757    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qpflx" podStartSLOduration=135.850206775 podStartE2EDuration="2m17.136742465s" totalImagesPullingTime="1.28653569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:59.135624769 +0000 UTC m=+137.218907623" watchObservedRunningTime="2026-07-27 18:33:59.136742465 +0000 UTC m=+137.220025316"
Jul 27 18:34:03.116593 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:03.116554    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:34:03.117166 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:03.116628    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:34:03.122147 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:03.122120    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:34:03.148758 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:03.148726    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:34:03.199376 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:03.199344    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59878b89b8-ttb5n"]
Jul 27 18:34:09.502780 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:09.502752    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:34:09.506613 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:09.506583    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bbcd8d5bd-pq9vh"
Jul 27 18:34:28.224599 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.224539    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59878b89b8-ttb5n" podUID="d2cca902-a9f2-49ae-bee9-9291335bf38d" containerName="console" containerID="cri-o://3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e" gracePeriod=15
Jul 27 18:34:28.508350 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.508323    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:34:28.586859 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.586829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-service-ca\") pod \"d2cca902-a9f2-49ae-bee9-9291335bf38d\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") "
Jul 27 18:34:28.587031 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.586868    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-config\") pod \"d2cca902-a9f2-49ae-bee9-9291335bf38d\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") "
Jul 27 18:34:28.587031 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.586929    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-oauth-serving-cert\") pod \"d2cca902-a9f2-49ae-bee9-9291335bf38d\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") "
Jul 27 18:34:28.587031 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.586948    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgndv\" (UniqueName: \"kubernetes.io/projected/d2cca902-a9f2-49ae-bee9-9291335bf38d-kube-api-access-xgndv\") pod \"d2cca902-a9f2-49ae-bee9-9291335bf38d\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") "
Jul 27 18:34:28.587031 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.586964    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-serving-cert\") pod \"d2cca902-a9f2-49ae-bee9-9291335bf38d\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") "
Jul 27 18:34:28.587031 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.587001    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-oauth-config\") pod \"d2cca902-a9f2-49ae-bee9-9291335bf38d\" (UID: \"d2cca902-a9f2-49ae-bee9-9291335bf38d\") "
Jul 27 18:34:28.587318 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.587293    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2cca902-a9f2-49ae-bee9-9291335bf38d" (UID: "d2cca902-a9f2-49ae-bee9-9291335bf38d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:28.587383 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.587332    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2cca902-a9f2-49ae-bee9-9291335bf38d" (UID: "d2cca902-a9f2-49ae-bee9-9291335bf38d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:28.587460 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.587414    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-config" (OuterVolumeSpecName: "console-config") pod "d2cca902-a9f2-49ae-bee9-9291335bf38d" (UID: "d2cca902-a9f2-49ae-bee9-9291335bf38d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:28.589553 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.589527    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2cca902-a9f2-49ae-bee9-9291335bf38d" (UID: "d2cca902-a9f2-49ae-bee9-9291335bf38d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:28.589553 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.589538    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2cca902-a9f2-49ae-bee9-9291335bf38d-kube-api-access-xgndv" (OuterVolumeSpecName: "kube-api-access-xgndv") pod "d2cca902-a9f2-49ae-bee9-9291335bf38d" (UID: "d2cca902-a9f2-49ae-bee9-9291335bf38d"). InnerVolumeSpecName "kube-api-access-xgndv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:34:28.589678 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.589626    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2cca902-a9f2-49ae-bee9-9291335bf38d" (UID: "d2cca902-a9f2-49ae-bee9-9291335bf38d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:28.687798 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.687761    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-oauth-serving-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:34:28.687798 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.687786    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgndv\" (UniqueName: \"kubernetes.io/projected/d2cca902-a9f2-49ae-bee9-9291335bf38d-kube-api-access-xgndv\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:34:28.687798 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.687804    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-serving-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:34:28.687998 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.687813    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-oauth-config\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:34:28.687998 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.687822    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:34:28.687998 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:28.687832    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cca902-a9f2-49ae-bee9-9291335bf38d-console-config\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:34:29.254450 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.254398    2577 generic.go:356] "Generic (PLEG): container finished" podID="d2cca902-a9f2-49ae-bee9-9291335bf38d" containerID="3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e" exitCode=0
Jul 27 18:34:29.254915 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.254466    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59878b89b8-ttb5n"
Jul 27 18:34:29.254915 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.254477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59878b89b8-ttb5n" event={"ID":"d2cca902-a9f2-49ae-bee9-9291335bf38d","Type":"ContainerDied","Data":"3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e"}
Jul 27 18:34:29.254915 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.254529    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59878b89b8-ttb5n" event={"ID":"d2cca902-a9f2-49ae-bee9-9291335bf38d","Type":"ContainerDied","Data":"e757f429df68e44f7e8e2097d64bb119d78b9c7c19607f1857d5f735805cccae"}
Jul 27 18:34:29.254915 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.254549    2577 scope.go:117] "RemoveContainer" containerID="3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e"
Jul 27 18:34:29.263688 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.263669    2577 scope.go:117] "RemoveContainer" containerID="3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e"
Jul 27 18:34:29.263966 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:34:29.263947    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e\": container with ID starting with 3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e not found: ID does not exist" containerID="3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e"
Jul 27 18:34:29.264012 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.263975    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e"} err="failed to get container status \"3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e\": rpc error: code = NotFound desc = could not find container \"3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e\": container with ID starting with 3b347e6972b7a65ea8338d9071f6306d973894d0a278689f829bbe688086891e not found: ID does not exist"
Jul 27 18:34:29.276139 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.276119    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59878b89b8-ttb5n"]
Jul 27 18:34:29.281039 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:29.281014    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59878b89b8-ttb5n"]
Jul 27 18:34:30.508991 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:30.508960    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2cca902-a9f2-49ae-bee9-9291335bf38d" path="/var/lib/kubelet/pods/d2cca902-a9f2-49ae-bee9-9291335bf38d/volumes"
Jul 27 18:34:46.722167 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.722130    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5668b6665-cwb65"]
Jul 27 18:34:46.722667 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.722625    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cca902-a9f2-49ae-bee9-9291335bf38d" containerName="console"
Jul 27 18:34:46.722667 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.722647    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cca902-a9f2-49ae-bee9-9291335bf38d" containerName="console"
Jul 27 18:34:46.722877 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.722734    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2cca902-a9f2-49ae-bee9-9291335bf38d" containerName="console"
Jul 27 18:34:46.745297 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.745276    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5668b6665-cwb65"]
Jul 27 18:34:46.745410 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.745365    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.847823 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.847777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-config\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.847823 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.847822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzdr5\" (UniqueName: \"kubernetes.io/projected/f34cc544-be0e-44a0-8854-de893a8fdc3f-kube-api-access-qzdr5\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.848143 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.847857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-serving-cert\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.848143 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.847883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-service-ca\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.848143 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.847955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-trusted-ca-bundle\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.848143 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.848001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-oauth-serving-cert\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.848143 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.848022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-oauth-config\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.948721 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.948686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzdr5\" (UniqueName: \"kubernetes.io/projected/f34cc544-be0e-44a0-8854-de893a8fdc3f-kube-api-access-qzdr5\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.948721 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.948729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-serving-cert\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.948973 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.948745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-service-ca\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.948973 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.948764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-trusted-ca-bundle\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.948973 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.948800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-oauth-serving-cert\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.948973 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.948822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-oauth-config\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.948973 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.948880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-config\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.949703 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.949650    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-service-ca\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.949703 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.949668    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-config\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.949890 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.949800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-trusted-ca-bundle\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.949890 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.949869    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-oauth-serving-cert\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.951386 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.951366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-serving-cert\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.951646 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.951506    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-oauth-config\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:46.957813 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:46.957793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzdr5\" (UniqueName: \"kubernetes.io/projected/f34cc544-be0e-44a0-8854-de893a8fdc3f-kube-api-access-qzdr5\") pod \"console-5668b6665-cwb65\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") " pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:47.054865 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:47.054785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:47.187031 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:47.187010    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5668b6665-cwb65"]
Jul 27 18:34:47.189298 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:34:47.189272    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34cc544_be0e_44a0_8854_de893a8fdc3f.slice/crio-cf9ec20d8df51018a6d5d0a862e8cc36b9b2e423372d0ef12e867be9030245af WatchSource:0}: Error finding container cf9ec20d8df51018a6d5d0a862e8cc36b9b2e423372d0ef12e867be9030245af: Status 404 returned error can't find the container with id cf9ec20d8df51018a6d5d0a862e8cc36b9b2e423372d0ef12e867be9030245af
Jul 27 18:34:47.325646 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:47.325565    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668b6665-cwb65" event={"ID":"f34cc544-be0e-44a0-8854-de893a8fdc3f","Type":"ContainerStarted","Data":"9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa"}
Jul 27 18:34:47.325646 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:47.325613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668b6665-cwb65" event={"ID":"f34cc544-be0e-44a0-8854-de893a8fdc3f","Type":"ContainerStarted","Data":"cf9ec20d8df51018a6d5d0a862e8cc36b9b2e423372d0ef12e867be9030245af"}
Jul 27 18:34:47.346465 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:47.346408    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5668b6665-cwb65" podStartSLOduration=1.346393618 podStartE2EDuration="1.346393618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:34:47.344825095 +0000 UTC m=+185.428107986" watchObservedRunningTime="2026-07-27 18:34:47.346393618 +0000 UTC m=+185.429676469"
Jul 27 18:34:57.055270 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:57.055212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:57.055270 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:57.055289    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:57.060262 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:57.060245    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:57.368697 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:57.368670    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:34:57.420694 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:34:57.420660    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8649f7944-5tcc7"]
Jul 27 18:35:22.445510 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.445472    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8649f7944-5tcc7" podUID="02e3330e-42b6-452a-b777-fb170f152186" containerName="console" containerID="cri-o://2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60" gracePeriod=15
Jul 27 18:35:22.692027 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.692003    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:35:22.764476 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.764380    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-oauth-config\") pod \"02e3330e-42b6-452a-b777-fb170f152186\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") "
Jul 27 18:35:22.764476 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.764414    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-service-ca\") pod \"02e3330e-42b6-452a-b777-fb170f152186\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") "
Jul 27 18:35:22.764476 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.764452    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-serving-cert\") pod \"02e3330e-42b6-452a-b777-fb170f152186\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") "
Jul 27 18:35:22.764476 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.764470    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d9qb\" (UniqueName: \"kubernetes.io/projected/02e3330e-42b6-452a-b777-fb170f152186-kube-api-access-7d9qb\") pod \"02e3330e-42b6-452a-b777-fb170f152186\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") "
Jul 27 18:35:22.764750 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.764498    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-oauth-serving-cert\") pod \"02e3330e-42b6-452a-b777-fb170f152186\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") "
Jul 27 18:35:22.764750 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.764533    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-trusted-ca-bundle\") pod \"02e3330e-42b6-452a-b777-fb170f152186\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") "
Jul 27 18:35:22.764750 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.764560    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-console-config\") pod \"02e3330e-42b6-452a-b777-fb170f152186\" (UID: \"02e3330e-42b6-452a-b777-fb170f152186\") "
Jul 27 18:35:22.764901 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.764863    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-service-ca" (OuterVolumeSpecName: "service-ca") pod "02e3330e-42b6-452a-b777-fb170f152186" (UID: "02e3330e-42b6-452a-b777-fb170f152186"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:35:22.765103 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.765028    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02e3330e-42b6-452a-b777-fb170f152186" (UID: "02e3330e-42b6-452a-b777-fb170f152186"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:35:22.765103 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.765089    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02e3330e-42b6-452a-b777-fb170f152186" (UID: "02e3330e-42b6-452a-b777-fb170f152186"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:35:22.765103 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.765127    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-console-config" (OuterVolumeSpecName: "console-config") pod "02e3330e-42b6-452a-b777-fb170f152186" (UID: "02e3330e-42b6-452a-b777-fb170f152186"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:35:22.766714 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.766677    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02e3330e-42b6-452a-b777-fb170f152186" (UID: "02e3330e-42b6-452a-b777-fb170f152186"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:35:22.766829 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.766754    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02e3330e-42b6-452a-b777-fb170f152186" (UID: "02e3330e-42b6-452a-b777-fb170f152186"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:35:22.766829 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.766801    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e3330e-42b6-452a-b777-fb170f152186-kube-api-access-7d9qb" (OuterVolumeSpecName: "kube-api-access-7d9qb") pod "02e3330e-42b6-452a-b777-fb170f152186" (UID: "02e3330e-42b6-452a-b777-fb170f152186"). InnerVolumeSpecName "kube-api-access-7d9qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:35:22.866168 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.866130    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-trusted-ca-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:35:22.866168 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.866159    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-console-config\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:35:22.866351 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.866200    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-oauth-config\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:35:22.866351 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.866216    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:35:22.866351 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.866229    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02e3330e-42b6-452a-b777-fb170f152186-console-serving-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:35:22.866351 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.866243    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d9qb\" (UniqueName: \"kubernetes.io/projected/02e3330e-42b6-452a-b777-fb170f152186-kube-api-access-7d9qb\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:35:22.866351 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:22.866255    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02e3330e-42b6-452a-b777-fb170f152186-oauth-serving-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:35:23.466181 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.466144    2577 generic.go:356] "Generic (PLEG): container finished" podID="02e3330e-42b6-452a-b777-fb170f152186" containerID="2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60" exitCode=0
Jul 27 18:35:23.466655 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.466193    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649f7944-5tcc7"
Jul 27 18:35:23.466655 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.466238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649f7944-5tcc7" event={"ID":"02e3330e-42b6-452a-b777-fb170f152186","Type":"ContainerDied","Data":"2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60"}
Jul 27 18:35:23.466655 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.466306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649f7944-5tcc7" event={"ID":"02e3330e-42b6-452a-b777-fb170f152186","Type":"ContainerDied","Data":"19bd8f52040d2166448e79ce659059ac6fae1685b77dff15f9d3c5c16cecae6d"}
Jul 27 18:35:23.466655 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.466341    2577 scope.go:117] "RemoveContainer" containerID="2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60"
Jul 27 18:35:23.474935 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.474917    2577 scope.go:117] "RemoveContainer" containerID="2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60"
Jul 27 18:35:23.475158 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:35:23.475139    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60\": container with ID starting with 2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60 not found: ID does not exist" containerID="2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60"
Jul 27 18:35:23.475208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.475167    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60"} err="failed to get container status \"2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60\": rpc error: code = NotFound desc = could not find container \"2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60\": container with ID starting with 2316786e4d16843fb315449ac6de36e3f4b23fb6d50b6a399a8360d237139a60 not found: ID does not exist"
Jul 27 18:35:23.491121 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.491095    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8649f7944-5tcc7"]
Jul 27 18:35:23.492370 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:23.492350    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8649f7944-5tcc7"]
Jul 27 18:35:24.509277 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:24.509244    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e3330e-42b6-452a-b777-fb170f152186" path="/var/lib/kubelet/pods/02e3330e-42b6-452a-b777-fb170f152186/volumes"
Jul 27 18:35:54.522858 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.522817    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"]
Jul 27 18:35:54.523300 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.523131    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e3330e-42b6-452a-b777-fb170f152186" containerName="console"
Jul 27 18:35:54.523300 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.523142    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e3330e-42b6-452a-b777-fb170f152186" containerName="console"
Jul 27 18:35:54.523300 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.523194    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e3330e-42b6-452a-b777-fb170f152186" containerName="console"
Jul 27 18:35:54.525726 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.525711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.529402 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.529381    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qrprj\""
Jul 27 18:35:54.529590 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.529572    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 18:35:54.530525 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.530497    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 18:35:54.539387 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.539348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.539387 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.539387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.539568 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.539442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6kqm\" (UniqueName: \"kubernetes.io/projected/36a436bb-f804-4102-953d-cdd194b0b836-kube-api-access-w6kqm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.541057 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.541028    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"]
Jul 27 18:35:54.640744 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.640705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.640744 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.640745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.640965 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.640766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6kqm\" (UniqueName: \"kubernetes.io/projected/36a436bb-f804-4102-953d-cdd194b0b836-kube-api-access-w6kqm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.641094 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.641074    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.641147 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.641102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.649762 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.649732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6kqm\" (UniqueName: \"kubernetes.io/projected/36a436bb-f804-4102-953d-cdd194b0b836-kube-api-access-w6kqm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.835048 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.835022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:35:54.965027 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:54.965001    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"]
Jul 27 18:35:54.967545 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:35:54.967523    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a436bb_f804_4102_953d_cdd194b0b836.slice/crio-e4a4aa4ca9f652b988b82f92621cec337996b7cda353e4b4b18fd99e74175a4b WatchSource:0}: Error finding container e4a4aa4ca9f652b988b82f92621cec337996b7cda353e4b4b18fd99e74175a4b: Status 404 returned error can't find the container with id e4a4aa4ca9f652b988b82f92621cec337996b7cda353e4b4b18fd99e74175a4b
Jul 27 18:35:55.587481 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:35:55.587442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs" event={"ID":"36a436bb-f804-4102-953d-cdd194b0b836","Type":"ContainerStarted","Data":"e4a4aa4ca9f652b988b82f92621cec337996b7cda353e4b4b18fd99e74175a4b"}
Jul 27 18:36:02.620101 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:02.620015    2577 generic.go:356] "Generic (PLEG): container finished" podID="36a436bb-f804-4102-953d-cdd194b0b836" containerID="4814b286b08b6ab8f9d7de628e00b98f08a9efb5fb62741653892190db1048d1" exitCode=0
Jul 27 18:36:02.620101 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:02.620066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs" event={"ID":"36a436bb-f804-4102-953d-cdd194b0b836","Type":"ContainerDied","Data":"4814b286b08b6ab8f9d7de628e00b98f08a9efb5fb62741653892190db1048d1"}
Jul 27 18:36:05.635077 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:05.635040    2577 generic.go:356] "Generic (PLEG): container finished" podID="36a436bb-f804-4102-953d-cdd194b0b836" containerID="32c83cf4ae2fd6f095db9495b9263c43104381ea692a53293e517cae8da07f6f" exitCode=0
Jul 27 18:36:05.635484 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:05.635106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs" event={"ID":"36a436bb-f804-4102-953d-cdd194b0b836","Type":"ContainerDied","Data":"32c83cf4ae2fd6f095db9495b9263c43104381ea692a53293e517cae8da07f6f"}
Jul 27 18:36:13.674380 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:13.674343    2577 generic.go:356] "Generic (PLEG): container finished" podID="36a436bb-f804-4102-953d-cdd194b0b836" containerID="6799adec5b9ff917f4834ec22a64b85649b78013bb591b0a70a820174d5f8e11" exitCode=0
Jul 27 18:36:13.674778 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:13.674418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs" event={"ID":"36a436bb-f804-4102-953d-cdd194b0b836","Type":"ContainerDied","Data":"6799adec5b9ff917f4834ec22a64b85649b78013bb591b0a70a820174d5f8e11"}
Jul 27 18:36:14.852634 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:14.852610    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:36:14.909292 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:14.909258    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6kqm\" (UniqueName: \"kubernetes.io/projected/36a436bb-f804-4102-953d-cdd194b0b836-kube-api-access-w6kqm\") pod \"36a436bb-f804-4102-953d-cdd194b0b836\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") "
Jul 27 18:36:14.909460 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:14.909310    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-bundle\") pod \"36a436bb-f804-4102-953d-cdd194b0b836\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") "
Jul 27 18:36:14.909460 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:14.909345    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-util\") pod \"36a436bb-f804-4102-953d-cdd194b0b836\" (UID: \"36a436bb-f804-4102-953d-cdd194b0b836\") "
Jul 27 18:36:14.910178 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:14.910144    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-bundle" (OuterVolumeSpecName: "bundle") pod "36a436bb-f804-4102-953d-cdd194b0b836" (UID: "36a436bb-f804-4102-953d-cdd194b0b836"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:36:14.911570 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:14.911545    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a436bb-f804-4102-953d-cdd194b0b836-kube-api-access-w6kqm" (OuterVolumeSpecName: "kube-api-access-w6kqm") pod "36a436bb-f804-4102-953d-cdd194b0b836" (UID: "36a436bb-f804-4102-953d-cdd194b0b836"). InnerVolumeSpecName "kube-api-access-w6kqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:36:14.914107 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:14.914086    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-util" (OuterVolumeSpecName: "util") pod "36a436bb-f804-4102-953d-cdd194b0b836" (UID: "36a436bb-f804-4102-953d-cdd194b0b836"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:36:15.010115 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:15.010048    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6kqm\" (UniqueName: \"kubernetes.io/projected/36a436bb-f804-4102-953d-cdd194b0b836-kube-api-access-w6kqm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:15.010115 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:15.010077    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:15.010115 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:15.010087    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36a436bb-f804-4102-953d-cdd194b0b836-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:15.684192 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:15.684165    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs"
Jul 27 18:36:15.684192 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:15.684192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frwgs" event={"ID":"36a436bb-f804-4102-953d-cdd194b0b836","Type":"ContainerDied","Data":"e4a4aa4ca9f652b988b82f92621cec337996b7cda353e4b4b18fd99e74175a4b"}
Jul 27 18:36:15.684396 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:15.684230    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4a4aa4ca9f652b988b82f92621cec337996b7cda353e4b4b18fd99e74175a4b"
Jul 27 18:36:24.031381 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.031342    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"]
Jul 27 18:36:24.031913 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.031800    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a436bb-f804-4102-953d-cdd194b0b836" containerName="util"
Jul 27 18:36:24.031913 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.031817    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a436bb-f804-4102-953d-cdd194b0b836" containerName="util"
Jul 27 18:36:24.031913 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.031851    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a436bb-f804-4102-953d-cdd194b0b836" containerName="pull"
Jul 27 18:36:24.031913 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.031859    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a436bb-f804-4102-953d-cdd194b0b836" containerName="pull"
Jul 27 18:36:24.031913 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.031869    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a436bb-f804-4102-953d-cdd194b0b836" containerName="extract"
Jul 27 18:36:24.031913 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.031878    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a436bb-f804-4102-953d-cdd194b0b836" containerName="extract"
Jul 27 18:36:24.032203 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.031955    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36a436bb-f804-4102-953d-cdd194b0b836" containerName="extract"
Jul 27 18:36:24.034046 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.034027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"
Jul 27 18:36:24.037169 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.037143    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-frttj\""
Jul 27 18:36:24.037169 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.037163    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:36:24.037338 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.037227    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 18:36:24.054751 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.054729    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"]
Jul 27 18:36:24.190198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.190166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1719a8d1-bd59-4456-9ccf-5b78afed4897-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpnkx\" (UID: \"1719a8d1-bd59-4456-9ccf-5b78afed4897\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"
Jul 27 18:36:24.190369 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.190226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qwc6\" (UniqueName: \"kubernetes.io/projected/1719a8d1-bd59-4456-9ccf-5b78afed4897-kube-api-access-7qwc6\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpnkx\" (UID: \"1719a8d1-bd59-4456-9ccf-5b78afed4897\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"
Jul 27 18:36:24.290925 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.290840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qwc6\" (UniqueName: \"kubernetes.io/projected/1719a8d1-bd59-4456-9ccf-5b78afed4897-kube-api-access-7qwc6\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpnkx\" (UID: \"1719a8d1-bd59-4456-9ccf-5b78afed4897\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"
Jul 27 18:36:24.290925 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.290921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1719a8d1-bd59-4456-9ccf-5b78afed4897-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpnkx\" (UID: \"1719a8d1-bd59-4456-9ccf-5b78afed4897\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"
Jul 27 18:36:24.291307 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.291288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1719a8d1-bd59-4456-9ccf-5b78afed4897-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpnkx\" (UID: \"1719a8d1-bd59-4456-9ccf-5b78afed4897\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"
Jul 27 18:36:24.300732 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.300706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qwc6\" (UniqueName: \"kubernetes.io/projected/1719a8d1-bd59-4456-9ccf-5b78afed4897-kube-api-access-7qwc6\") pod \"cert-manager-operator-controller-manager-55c444bf86-xpnkx\" (UID: \"1719a8d1-bd59-4456-9ccf-5b78afed4897\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"
Jul 27 18:36:24.342653 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.342617    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"
Jul 27 18:36:24.480653 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.480628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx"]
Jul 27 18:36:24.482895 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:36:24.482871    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1719a8d1_bd59_4456_9ccf_5b78afed4897.slice/crio-a2ece0afae4132ba847eaf97e2093d0ef9232857a62d6cba5c2b57f0361d1a5c WatchSource:0}: Error finding container a2ece0afae4132ba847eaf97e2093d0ef9232857a62d6cba5c2b57f0361d1a5c: Status 404 returned error can't find the container with id a2ece0afae4132ba847eaf97e2093d0ef9232857a62d6cba5c2b57f0361d1a5c
Jul 27 18:36:24.719815 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:24.719775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx" event={"ID":"1719a8d1-bd59-4456-9ccf-5b78afed4897","Type":"ContainerStarted","Data":"a2ece0afae4132ba847eaf97e2093d0ef9232857a62d6cba5c2b57f0361d1a5c"}
Jul 27 18:36:26.731525 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:26.731480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx" event={"ID":"1719a8d1-bd59-4456-9ccf-5b78afed4897","Type":"ContainerStarted","Data":"0aaef5b5370bc827aebaed6e2858bc59095e452612eec42223bc4cd633cf0832"}
Jul 27 18:36:26.756177 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:26.756119    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xpnkx" podStartSLOduration=1.008767996 podStartE2EDuration="2.7561032s" totalImagesPullingTime="1.747335204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:36:26.754118781 +0000 UTC m=+284.837401632" watchObservedRunningTime="2026-07-27 18:36:26.7561032 +0000 UTC m=+284.839386051"
Jul 27 18:36:27.563238 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.563195    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"]
Jul 27 18:36:27.565775 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.565753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.569208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.569185    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qrprj\""
Jul 27 18:36:27.569438 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.569399    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 18:36:27.570202 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.570188    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 18:36:27.582442 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.582398    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"]
Jul 27 18:36:27.725734 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.725701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.725904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.725742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.725904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.725774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b52jz\" (UniqueName: \"kubernetes.io/projected/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-kube-api-access-b52jz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.826548 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.826478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.826548 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.826530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.826926 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.826588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b52jz\" (UniqueName: \"kubernetes.io/projected/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-kube-api-access-b52jz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.826926 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.826899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.826992 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.826925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.835877 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.835849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b52jz\" (UniqueName: \"kubernetes.io/projected/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-kube-api-access-b52jz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:27.875311 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:27.875277    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:28.024582 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:28.024554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"]
Jul 27 18:36:28.026207 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:36:28.026172    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6eb8fa_f4f9_48c4_bc5a_d085638aafe9.slice/crio-83cbc89c856d1dbf881d845508d013c3683dc6c2c22fa019526597abc1920081 WatchSource:0}: Error finding container 83cbc89c856d1dbf881d845508d013c3683dc6c2c22fa019526597abc1920081: Status 404 returned error can't find the container with id 83cbc89c856d1dbf881d845508d013c3683dc6c2c22fa019526597abc1920081
Jul 27 18:36:28.742402 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:28.742370    2577 generic.go:356] "Generic (PLEG): container finished" podID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerID="d7a743233eb9a69e161516a8308ecc3f851f65c86a50152f75a1a754724e7c08" exitCode=0
Jul 27 18:36:28.742570 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:28.742464    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q" event={"ID":"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9","Type":"ContainerDied","Data":"d7a743233eb9a69e161516a8308ecc3f851f65c86a50152f75a1a754724e7c08"}
Jul 27 18:36:28.742570 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:28.742512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q" event={"ID":"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9","Type":"ContainerStarted","Data":"83cbc89c856d1dbf881d845508d013c3683dc6c2c22fa019526597abc1920081"}
Jul 27 18:36:30.756296 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:30.756265    2577 generic.go:356] "Generic (PLEG): container finished" podID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerID="dceede9ea26e4292f87c962d7f72409a34a19615a537158120d7204b44f1eaf8" exitCode=0
Jul 27 18:36:30.756673 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:30.756361    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q" event={"ID":"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9","Type":"ContainerDied","Data":"dceede9ea26e4292f87c962d7f72409a34a19615a537158120d7204b44f1eaf8"}
Jul 27 18:36:31.762510 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:31.762477    2577 generic.go:356] "Generic (PLEG): container finished" podID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerID="1ceefba5e773a6da32ac13d3c77fa42bef9adff45c895837d9aa632b8d174654" exitCode=0
Jul 27 18:36:31.762947 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:31.762566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q" event={"ID":"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9","Type":"ContainerDied","Data":"1ceefba5e773a6da32ac13d3c77fa42bef9adff45c895837d9aa632b8d174654"}
Jul 27 18:36:32.895414 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:32.895388    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:33.073789 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.073710    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-util\") pod \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") "
Jul 27 18:36:33.073789 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.073779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b52jz\" (UniqueName: \"kubernetes.io/projected/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-kube-api-access-b52jz\") pod \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") "
Jul 27 18:36:33.073976 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.073835    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-bundle\") pod \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\" (UID: \"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9\") "
Jul 27 18:36:33.074273 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.074246    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-bundle" (OuterVolumeSpecName: "bundle") pod "4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" (UID: "4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:36:33.076080 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.076049    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-kube-api-access-b52jz" (OuterVolumeSpecName: "kube-api-access-b52jz") pod "4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" (UID: "4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9"). InnerVolumeSpecName "kube-api-access-b52jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:36:33.079101 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.079079    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-util" (OuterVolumeSpecName: "util") pod "4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" (UID: "4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:36:33.174688 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.174652    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:33.174688 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.174680    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b52jz\" (UniqueName: \"kubernetes.io/projected/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-kube-api-access-b52jz\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:33.174688 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.174691    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:33.773581 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.773547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q" event={"ID":"4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9","Type":"ContainerDied","Data":"83cbc89c856d1dbf881d845508d013c3683dc6c2c22fa019526597abc1920081"}
Jul 27 18:36:33.773754 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.773593    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83cbc89c856d1dbf881d845508d013c3683dc6c2c22fa019526597abc1920081"
Jul 27 18:36:33.773754 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:33.773560    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flqj5q"
Jul 27 18:36:37.429623 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.429592    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"]
Jul 27 18:36:37.429995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.429896    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerName="pull"
Jul 27 18:36:37.429995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.429906    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerName="pull"
Jul 27 18:36:37.429995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.429913    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerName="util"
Jul 27 18:36:37.429995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.429918    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerName="util"
Jul 27 18:36:37.429995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.429925    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerName="extract"
Jul 27 18:36:37.429995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.429931    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerName="extract"
Jul 27 18:36:37.429995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.429982    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6eb8fa-f4f9-48c4-bc5a-d085638aafe9" containerName="extract"
Jul 27 18:36:37.432820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.432804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"
Jul 27 18:36:37.435939 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.435920    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 18:36:37.436059 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.435922    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:36:37.437002 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.436983    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xwx7g\""
Jul 27 18:36:37.442585 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.442565    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"]
Jul 27 18:36:37.611355 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.611321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7883ccb-ed50-4d4e-b19c-bb9353fb19ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gmjxl\" (UID: \"d7883ccb-ed50-4d4e-b19c-bb9353fb19ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"
Jul 27 18:36:37.611541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.611393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clm9g\" (UniqueName: \"kubernetes.io/projected/d7883ccb-ed50-4d4e-b19c-bb9353fb19ed-kube-api-access-clm9g\") pod \"openshift-lws-operator-fd8ccff4c-gmjxl\" (UID: \"d7883ccb-ed50-4d4e-b19c-bb9353fb19ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"
Jul 27 18:36:37.712757 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.712677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clm9g\" (UniqueName: \"kubernetes.io/projected/d7883ccb-ed50-4d4e-b19c-bb9353fb19ed-kube-api-access-clm9g\") pod \"openshift-lws-operator-fd8ccff4c-gmjxl\" (UID: \"d7883ccb-ed50-4d4e-b19c-bb9353fb19ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"
Jul 27 18:36:37.712757 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.712733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7883ccb-ed50-4d4e-b19c-bb9353fb19ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gmjxl\" (UID: \"d7883ccb-ed50-4d4e-b19c-bb9353fb19ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"
Jul 27 18:36:37.713086 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.713070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7883ccb-ed50-4d4e-b19c-bb9353fb19ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gmjxl\" (UID: \"d7883ccb-ed50-4d4e-b19c-bb9353fb19ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"
Jul 27 18:36:37.721330 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.721309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clm9g\" (UniqueName: \"kubernetes.io/projected/d7883ccb-ed50-4d4e-b19c-bb9353fb19ed-kube-api-access-clm9g\") pod \"openshift-lws-operator-fd8ccff4c-gmjxl\" (UID: \"d7883ccb-ed50-4d4e-b19c-bb9353fb19ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"
Jul 27 18:36:37.754969 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.754943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"
Jul 27 18:36:37.883299 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:37.883273    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl"]
Jul 27 18:36:37.885357 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:36:37.885330    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7883ccb_ed50_4d4e_b19c_bb9353fb19ed.slice/crio-2c68041e027c00697a9f4f873fb9ca4b456a358230a15ab788e6ee582253c652 WatchSource:0}: Error finding container 2c68041e027c00697a9f4f873fb9ca4b456a358230a15ab788e6ee582253c652: Status 404 returned error can't find the container with id 2c68041e027c00697a9f4f873fb9ca4b456a358230a15ab788e6ee582253c652
Jul 27 18:36:38.797639 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:38.797607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl" event={"ID":"d7883ccb-ed50-4d4e-b19c-bb9353fb19ed","Type":"ContainerStarted","Data":"2c68041e027c00697a9f4f873fb9ca4b456a358230a15ab788e6ee582253c652"}
Jul 27 18:36:39.196581 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.196555    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-szk9z"]
Jul 27 18:36:39.200489 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.200469    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-szk9z"
Jul 27 18:36:39.203501 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.203480    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 18:36:39.203626 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.203520    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 18:36:39.203721 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.203640    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qlfvn\""
Jul 27 18:36:39.213330 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.213302    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-szk9z"]
Jul 27 18:36:39.225655 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.225633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbs6r\" (UniqueName: \"kubernetes.io/projected/c9c5e731-c599-4e24-8215-ff261781a029-kube-api-access-jbs6r\") pod \"cert-manager-55b4d954d5-szk9z\" (UID: \"c9c5e731-c599-4e24-8215-ff261781a029\") " pod="cert-manager/cert-manager-55b4d954d5-szk9z"
Jul 27 18:36:39.226089 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.225738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9c5e731-c599-4e24-8215-ff261781a029-bound-sa-token\") pod \"cert-manager-55b4d954d5-szk9z\" (UID: \"c9c5e731-c599-4e24-8215-ff261781a029\") " pod="cert-manager/cert-manager-55b4d954d5-szk9z"
Jul 27 18:36:39.326523 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.326488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbs6r\" (UniqueName: \"kubernetes.io/projected/c9c5e731-c599-4e24-8215-ff261781a029-kube-api-access-jbs6r\") pod \"cert-manager-55b4d954d5-szk9z\" (UID: \"c9c5e731-c599-4e24-8215-ff261781a029\") " pod="cert-manager/cert-manager-55b4d954d5-szk9z"
Jul 27 18:36:39.326711 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.326573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9c5e731-c599-4e24-8215-ff261781a029-bound-sa-token\") pod \"cert-manager-55b4d954d5-szk9z\" (UID: \"c9c5e731-c599-4e24-8215-ff261781a029\") " pod="cert-manager/cert-manager-55b4d954d5-szk9z"
Jul 27 18:36:39.336614 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.336589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbs6r\" (UniqueName: \"kubernetes.io/projected/c9c5e731-c599-4e24-8215-ff261781a029-kube-api-access-jbs6r\") pod \"cert-manager-55b4d954d5-szk9z\" (UID: \"c9c5e731-c599-4e24-8215-ff261781a029\") " pod="cert-manager/cert-manager-55b4d954d5-szk9z"
Jul 27 18:36:39.336743 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.336597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9c5e731-c599-4e24-8215-ff261781a029-bound-sa-token\") pod \"cert-manager-55b4d954d5-szk9z\" (UID: \"c9c5e731-c599-4e24-8215-ff261781a029\") " pod="cert-manager/cert-manager-55b4d954d5-szk9z"
Jul 27 18:36:39.513342 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.513246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-szk9z"
Jul 27 18:36:39.746751 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.746729    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-szk9z"]
Jul 27 18:36:39.748697 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:36:39.748668    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9c5e731_c599_4e24_8215_ff261781a029.slice/crio-41778079c3a654a1e97911c09d07b0617cdba6a89cfe261b434bfe5e313d4c35 WatchSource:0}: Error finding container 41778079c3a654a1e97911c09d07b0617cdba6a89cfe261b434bfe5e313d4c35: Status 404 returned error can't find the container with id 41778079c3a654a1e97911c09d07b0617cdba6a89cfe261b434bfe5e313d4c35
Jul 27 18:36:39.804049 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.803956    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-szk9z" event={"ID":"c9c5e731-c599-4e24-8215-ff261781a029","Type":"ContainerStarted","Data":"41778079c3a654a1e97911c09d07b0617cdba6a89cfe261b434bfe5e313d4c35"}
Jul 27 18:36:39.805688 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.805668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl" event={"ID":"d7883ccb-ed50-4d4e-b19c-bb9353fb19ed","Type":"ContainerStarted","Data":"ec4c94ccfcd658b31bf1691a221640cd2bf32adb035ab39815259f1c8990bd5c"}
Jul 27 18:36:39.830556 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:39.830030    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gmjxl" podStartSLOduration=1.070068909 podStartE2EDuration="2.830008948s" totalImagesPullingTime="1.759940039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:36:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:36:39.829597443 +0000 UTC m=+297.912880295" watchObservedRunningTime="2026-07-27 18:36:39.830008948 +0000 UTC m=+297.913291801"
Jul 27 18:36:42.322092 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.321664    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 18:36:42.532383 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.532223    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"]
Jul 27 18:36:42.538584 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.535618    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.539459 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.539410    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 18:36:42.539572 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.539410    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 18:36:42.539572 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.539411    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qrprj\""
Jul 27 18:36:42.553856 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.553830    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"]
Jul 27 18:36:42.555318 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.555292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.555482 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.555322    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5wjq\" (UniqueName: \"kubernetes.io/projected/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-kube-api-access-w5wjq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.555482 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.555443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.656272 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.656236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.656272 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.656275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5wjq\" (UniqueName: \"kubernetes.io/projected/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-kube-api-access-w5wjq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.656510 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.656321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.656747 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.656728    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.656790 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.656734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.665348 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.665322    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5wjq\" (UniqueName: \"kubernetes.io/projected/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-kube-api-access-w5wjq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.821288 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.821200    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-szk9z" event={"ID":"c9c5e731-c599-4e24-8215-ff261781a029","Type":"ContainerStarted","Data":"e319d530ddbf8b408ca3d3149871ffe8794bdd73e9f8a0445d3b0b0d5251ff84"}
Jul 27 18:36:42.837542 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.837489    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-szk9z" podStartSLOduration=1.299878093 podStartE2EDuration="3.837472501s" totalImagesPullingTime="2.537594408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:36:42.836706142 +0000 UTC m=+300.919988996" watchObservedRunningTime="2026-07-27 18:36:42.837472501 +0000 UTC m=+300.920755351"
Jul 27 18:36:42.845004 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.844959    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:42.990972 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:42.990944    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"]
Jul 27 18:36:42.993202 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:36:42.993174    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e98d09_7ae6_4b1a_a64b_d34b9fc79a46.slice/crio-02fa928e95723544404c53ebcf9c488ef82cbb2ced0ec42a56e3ab3f40939786 WatchSource:0}: Error finding container 02fa928e95723544404c53ebcf9c488ef82cbb2ced0ec42a56e3ab3f40939786: Status 404 returned error can't find the container with id 02fa928e95723544404c53ebcf9c488ef82cbb2ced0ec42a56e3ab3f40939786
Jul 27 18:36:43.827567 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:43.827532    2577 generic.go:356] "Generic (PLEG): container finished" podID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerID="046d7dce2de85c79aa0d45f4306efcc0700f113be798fde5c899ea98ccdb851b" exitCode=0
Jul 27 18:36:43.828018 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:43.827620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx" event={"ID":"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46","Type":"ContainerDied","Data":"046d7dce2de85c79aa0d45f4306efcc0700f113be798fde5c899ea98ccdb851b"}
Jul 27 18:36:43.828018 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:43.827675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx" event={"ID":"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46","Type":"ContainerStarted","Data":"02fa928e95723544404c53ebcf9c488ef82cbb2ced0ec42a56e3ab3f40939786"}
Jul 27 18:36:43.828134 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:43.828093    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:36:45.838477 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:45.838413    2577 generic.go:356] "Generic (PLEG): container finished" podID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerID="cb9ce74b36c4529c44ff2334426da8c35a1d7ffdd9b58c18e0ef5da1c93ef094" exitCode=0
Jul 27 18:36:45.838841 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:45.838496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx" event={"ID":"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46","Type":"ContainerDied","Data":"cb9ce74b36c4529c44ff2334426da8c35a1d7ffdd9b58c18e0ef5da1c93ef094"}
Jul 27 18:36:46.845258 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:46.845224    2577 generic.go:356] "Generic (PLEG): container finished" podID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerID="e3ed12559c875612d46567f337ac549f57fa485fac88e9d7d34e36f785c4cf49" exitCode=0
Jul 27 18:36:46.845644 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:46.845307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx" event={"ID":"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46","Type":"ContainerDied","Data":"e3ed12559c875612d46567f337ac549f57fa485fac88e9d7d34e36f785c4cf49"}
Jul 27 18:36:47.981320 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:47.981297    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:48.005196 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.005170    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5wjq\" (UniqueName: \"kubernetes.io/projected/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-kube-api-access-w5wjq\") pod \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") "
Jul 27 18:36:48.005358 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.005203    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-util\") pod \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") "
Jul 27 18:36:48.005358 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.005270    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-bundle\") pod \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\" (UID: \"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46\") "
Jul 27 18:36:48.006019 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.005993    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-bundle" (OuterVolumeSpecName: "bundle") pod "16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" (UID: "16e98d09-7ae6-4b1a-a64b-d34b9fc79a46"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:36:48.007385 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.007357    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-kube-api-access-w5wjq" (OuterVolumeSpecName: "kube-api-access-w5wjq") pod "16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" (UID: "16e98d09-7ae6-4b1a-a64b-d34b9fc79a46"). InnerVolumeSpecName "kube-api-access-w5wjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:36:48.014754 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.014711    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-util" (OuterVolumeSpecName: "util") pod "16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" (UID: "16e98d09-7ae6-4b1a-a64b-d34b9fc79a46"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:36:48.106670 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.106590    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:48.106670 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.106619    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5wjq\" (UniqueName: \"kubernetes.io/projected/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-kube-api-access-w5wjq\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:48.106670 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.106628    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16e98d09-7ae6-4b1a-a64b-d34b9fc79a46-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:36:48.855939 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.855913    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx"
Jul 27 18:36:48.855939 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.855924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflp9dx" event={"ID":"16e98d09-7ae6-4b1a-a64b-d34b9fc79a46","Type":"ContainerDied","Data":"02fa928e95723544404c53ebcf9c488ef82cbb2ced0ec42a56e3ab3f40939786"}
Jul 27 18:36:48.856147 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:48.855962    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02fa928e95723544404c53ebcf9c488ef82cbb2ced0ec42a56e3ab3f40939786"
Jul 27 18:36:59.606228 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.606185    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"]
Jul 27 18:36:59.606820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.606703    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerName="util"
Jul 27 18:36:59.606820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.606722    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerName="util"
Jul 27 18:36:59.606820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.606740    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerName="pull"
Jul 27 18:36:59.606820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.606750    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerName="pull"
Jul 27 18:36:59.606820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.606765    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerName="extract"
Jul 27 18:36:59.606820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.606774    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerName="extract"
Jul 27 18:36:59.607118 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.606853    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e98d09-7ae6-4b1a-a64b-d34b9fc79a46" containerName="extract"
Jul 27 18:36:59.611299 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.611279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.617182 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.617156    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 18:36:59.617311 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.617239    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 18:36:59.617311 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.617275    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 18:36:59.617485 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.617473    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 18:36:59.617552 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.617504    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d46ft\""
Jul 27 18:36:59.630092 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.630065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"]
Jul 27 18:36:59.707346 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.707311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.707346 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.707345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-tmp\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.707574 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.707384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-manifests\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.707574 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.707439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcsm5\" (UniqueName: \"kubernetes.io/projected/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-kube-api-access-kcsm5\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.707574 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.707491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.807892 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.807859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsm5\" (UniqueName: \"kubernetes.io/projected/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-kube-api-access-kcsm5\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.808080 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.807906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.808080 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.807934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.808080 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.807951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-tmp\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.808080 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.807978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-manifests\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.808368 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.808352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-manifests\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.810367 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.810347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-tmp\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.810602 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.810582    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.810677 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.810640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.819581 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.819557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcsm5\" (UniqueName: \"kubernetes.io/projected/12cd2737-eef3-4d00-b0ed-ecb9c112a8bb-kube-api-access-kcsm5\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-5d2px\" (UID: \"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:36:59.921609 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:36:59.921530    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:37:00.064870 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:00.064838    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"]
Jul 27 18:37:00.068059 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:37:00.068033    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cd2737_eef3_4d00_b0ed_ecb9c112a8bb.slice/crio-4bf2a5e130883e811522f4a395a7a05a1b337163e72f526aca70134f791f8a82 WatchSource:0}: Error finding container 4bf2a5e130883e811522f4a395a7a05a1b337163e72f526aca70134f791f8a82: Status 404 returned error can't find the container with id 4bf2a5e130883e811522f4a395a7a05a1b337163e72f526aca70134f791f8a82
Jul 27 18:37:00.913753 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:00.913718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px" event={"ID":"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb","Type":"ContainerStarted","Data":"4bf2a5e130883e811522f4a395a7a05a1b337163e72f526aca70134f791f8a82"}
Jul 27 18:37:03.932392 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:03.932350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px" event={"ID":"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb","Type":"ContainerStarted","Data":"fc054cacffad9729b6bb42f7a3ec2c44149cf4b193d54a3cc031a520fa1ac1b6"}
Jul 27 18:37:04.938281 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:04.938248    2577 generic.go:356] "Generic (PLEG): container finished" podID="12cd2737-eef3-4d00-b0ed-ecb9c112a8bb" containerID="fc054cacffad9729b6bb42f7a3ec2c44149cf4b193d54a3cc031a520fa1ac1b6" exitCode=0
Jul 27 18:37:04.938789 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:04.938304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px" event={"ID":"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb","Type":"ContainerDied","Data":"fc054cacffad9729b6bb42f7a3ec2c44149cf4b193d54a3cc031a520fa1ac1b6"}
Jul 27 18:37:05.946136 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:05.946101    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px" event={"ID":"12cd2737-eef3-4d00-b0ed-ecb9c112a8bb","Type":"ContainerStarted","Data":"8d9bbc009f4608cd1ce0fa0ed8ad80b05b5392ed2ea9eab16edbd8ecb4dd0a84"}
Jul 27 18:37:05.946632 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:05.946229    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:37:05.999333 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:05.999283    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px" podStartSLOduration=2.135596188 podStartE2EDuration="6.999268244s" totalImagesPullingTime="3.768735528s" totalInitContainerRuntime="1.094936528s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:36:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:05.998004964 +0000 UTC m=+324.081287814" watchObservedRunningTime="2026-07-27 18:37:05.999268244 +0000 UTC m=+324.082551094"
Jul 27 18:37:16.953326 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:16.953296    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-5d2px"
Jul 27 18:37:19.815155 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.815117    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"]
Jul 27 18:37:19.820295 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.820274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:19.829446 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.829408    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gng6z\""
Jul 27 18:37:19.829574 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.829504    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 18:37:19.829646 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.829408    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 18:37:19.842008 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.841984    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"]
Jul 27 18:37:19.996531 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.996493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca57049-13b6-438e-844f-65197e11a830-tls-certs\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:19.996687 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.996549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ca57049-13b6-438e-844f-65197e11a830-tmp\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:19.996687 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:19.996622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwklv\" (UniqueName: \"kubernetes.io/projected/6ca57049-13b6-438e-844f-65197e11a830-kube-api-access-jwklv\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:20.097974 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.097940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca57049-13b6-438e-844f-65197e11a830-tls-certs\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:20.098135 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.097986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ca57049-13b6-438e-844f-65197e11a830-tmp\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:20.098135 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.098013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwklv\" (UniqueName: \"kubernetes.io/projected/6ca57049-13b6-438e-844f-65197e11a830-kube-api-access-jwklv\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:20.100630 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.100599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ca57049-13b6-438e-844f-65197e11a830-tmp\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:20.100774 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.100755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca57049-13b6-438e-844f-65197e11a830-tls-certs\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:20.108414 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.108377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwklv\" (UniqueName: \"kubernetes.io/projected/6ca57049-13b6-438e-844f-65197e11a830-kube-api-access-jwklv\") pod \"kube-auth-proxy-55894cd494-6gdh8\" (UID: \"6ca57049-13b6-438e-844f-65197e11a830\") " pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:20.132205 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.132178    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"
Jul 27 18:37:20.303202 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.303171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55894cd494-6gdh8"]
Jul 27 18:37:20.305026 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:37:20.304994    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca57049_13b6_438e_844f_65197e11a830.slice/crio-e1375e70af750b68d5147b6cfcbbced9d1784cbb935ef4144d71dbea499115ca WatchSource:0}: Error finding container e1375e70af750b68d5147b6cfcbbced9d1784cbb935ef4144d71dbea499115ca: Status 404 returned error can't find the container with id e1375e70af750b68d5147b6cfcbbced9d1784cbb935ef4144d71dbea499115ca
Jul 27 18:37:20.479974 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.479899    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dcjwm"]
Jul 27 18:37:20.482888 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.482870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:20.504780 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.504753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bbdfbcc-06eb-4f89-8070-74804ce88da8-cert\") pod \"odh-model-controller-7998c67dc4-dcjwm\" (UID: \"4bbdfbcc-06eb-4f89-8070-74804ce88da8\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:20.504906 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.504865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmqlp\" (UniqueName: \"kubernetes.io/projected/4bbdfbcc-06eb-4f89-8070-74804ce88da8-kube-api-access-rmqlp\") pod \"odh-model-controller-7998c67dc4-dcjwm\" (UID: \"4bbdfbcc-06eb-4f89-8070-74804ce88da8\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:20.522178 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.522155    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lrrjf\""
Jul 27 18:37:20.522303 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.522200    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 18:37:20.605978 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.605940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmqlp\" (UniqueName: \"kubernetes.io/projected/4bbdfbcc-06eb-4f89-8070-74804ce88da8-kube-api-access-rmqlp\") pod \"odh-model-controller-7998c67dc4-dcjwm\" (UID: \"4bbdfbcc-06eb-4f89-8070-74804ce88da8\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:20.606181 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.605993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bbdfbcc-06eb-4f89-8070-74804ce88da8-cert\") pod \"odh-model-controller-7998c67dc4-dcjwm\" (UID: \"4bbdfbcc-06eb-4f89-8070-74804ce88da8\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:20.606181 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:37:20.606102    2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 27 18:37:20.606181 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:37:20.606167    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbdfbcc-06eb-4f89-8070-74804ce88da8-cert podName:4bbdfbcc-06eb-4f89-8070-74804ce88da8 nodeName:}" failed. No retries permitted until 2026-07-27 18:37:21.106147838 +0000 UTC m=+339.189430667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bbdfbcc-06eb-4f89-8070-74804ce88da8-cert") pod "odh-model-controller-7998c67dc4-dcjwm" (UID: "4bbdfbcc-06eb-4f89-8070-74804ce88da8") : secret "odh-model-controller-webhook-cert" not found
Jul 27 18:37:20.625386 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.625355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dcjwm"]
Jul 27 18:37:20.697303 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:20.697272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmqlp\" (UniqueName: \"kubernetes.io/projected/4bbdfbcc-06eb-4f89-8070-74804ce88da8-kube-api-access-rmqlp\") pod \"odh-model-controller-7998c67dc4-dcjwm\" (UID: \"4bbdfbcc-06eb-4f89-8070-74804ce88da8\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:21.021022 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:21.020976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8" event={"ID":"6ca57049-13b6-438e-844f-65197e11a830","Type":"ContainerStarted","Data":"e1375e70af750b68d5147b6cfcbbced9d1784cbb935ef4144d71dbea499115ca"}
Jul 27 18:37:21.109000 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:21.108910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bbdfbcc-06eb-4f89-8070-74804ce88da8-cert\") pod \"odh-model-controller-7998c67dc4-dcjwm\" (UID: \"4bbdfbcc-06eb-4f89-8070-74804ce88da8\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:21.111899 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:21.111870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bbdfbcc-06eb-4f89-8070-74804ce88da8-cert\") pod \"odh-model-controller-7998c67dc4-dcjwm\" (UID: \"4bbdfbcc-06eb-4f89-8070-74804ce88da8\") " pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:21.393753 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:21.393660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:21.577286 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:21.577246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dcjwm"]
Jul 27 18:37:21.579619 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:37:21.579589    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbdfbcc_06eb_4f89_8070_74804ce88da8.slice/crio-95b235612552b16e30aee89fe8c8fc8a8d6510363256dc8f981a571e2357ad58 WatchSource:0}: Error finding container 95b235612552b16e30aee89fe8c8fc8a8d6510363256dc8f981a571e2357ad58: Status 404 returned error can't find the container with id 95b235612552b16e30aee89fe8c8fc8a8d6510363256dc8f981a571e2357ad58
Jul 27 18:37:22.029502 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.029461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm" event={"ID":"4bbdfbcc-06eb-4f89-8070-74804ce88da8","Type":"ContainerStarted","Data":"95b235612552b16e30aee89fe8c8fc8a8d6510363256dc8f981a571e2357ad58"}
Jul 27 18:37:22.558781 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.558744    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7bdv9"]
Jul 27 18:37:22.562947 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.562922    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:22.567408 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.567385    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6nlt6\""
Jul 27 18:37:22.567609 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.567594    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 18:37:22.589633 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.589565    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7bdv9"]
Jul 27 18:37:22.618749 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.618703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bdv9\" (UID: \"46a35022-86b5-480d-aea1-f208711a62e2\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:22.618749 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.618748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84bcf\" (UniqueName: \"kubernetes.io/projected/46a35022-86b5-480d-aea1-f208711a62e2-kube-api-access-84bcf\") pod \"model-serving-api-54d89bd5fc-7bdv9\" (UID: \"46a35022-86b5-480d-aea1-f208711a62e2\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:22.720120 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.720079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bdv9\" (UID: \"46a35022-86b5-480d-aea1-f208711a62e2\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:22.720306 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.720129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84bcf\" (UniqueName: \"kubernetes.io/projected/46a35022-86b5-480d-aea1-f208711a62e2-kube-api-access-84bcf\") pod \"model-serving-api-54d89bd5fc-7bdv9\" (UID: \"46a35022-86b5-480d-aea1-f208711a62e2\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:22.720306 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:37:22.720252    2577 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 27 18:37:22.720460 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:37:22.720324    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs podName:46a35022-86b5-480d-aea1-f208711a62e2 nodeName:}" failed. No retries permitted until 2026-07-27 18:37:23.220302413 +0000 UTC m=+341.303585257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs") pod "model-serving-api-54d89bd5fc-7bdv9" (UID: "46a35022-86b5-480d-aea1-f208711a62e2") : secret "model-serving-api-tls" not found
Jul 27 18:37:22.741442 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.741335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84bcf\" (UniqueName: \"kubernetes.io/projected/46a35022-86b5-480d-aea1-f208711a62e2-kube-api-access-84bcf\") pod \"model-serving-api-54d89bd5fc-7bdv9\" (UID: \"46a35022-86b5-480d-aea1-f208711a62e2\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:22.988527 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.988286    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"]
Jul 27 18:37:22.991225 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.991200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:22.995694 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.994685    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sns6q\""
Jul 27 18:37:22.995694 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.994954    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 18:37:22.995694 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.995132    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 18:37:22.995694 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.995389    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 18:37:22.995694 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:22.995389    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 18:37:23.020141 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.020102    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"]
Jul 27 18:37:23.022913 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.022875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.023073 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.023052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4cq\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-kube-api-access-kj4cq\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.023148 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.023109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.023250 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.023211    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f2e3d-c55a-402e-97fe-e1da9fe3c402-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.023319 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.023268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.023379 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.023340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.023458 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.023412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.126176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.124827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.126176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.124877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4cq\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-kube-api-access-kj4cq\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.126176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.124915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.126176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.124989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f2e3d-c55a-402e-97fe-e1da9fe3c402-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.126176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.125015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.126176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.125052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.126176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.125093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.128371 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.127801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.130454 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.128631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.135815 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.134136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.138658 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.138551    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4cq\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-kube-api-access-kj4cq\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.139208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.139184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.139602 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.139577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f2e3d-c55a-402e-97fe-e1da9fe3c402-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.142870 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.142847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w9t8c\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:23.226675 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.226502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bdv9\" (UID: \"46a35022-86b5-480d-aea1-f208711a62e2\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:23.226865 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:37:23.226680    2577 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 27 18:37:23.226865 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:37:23.226760    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs podName:46a35022-86b5-480d-aea1-f208711a62e2 nodeName:}" failed. No retries permitted until 2026-07-27 18:37:24.226740193 +0000 UTC m=+342.310023036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs") pod "model-serving-api-54d89bd5fc-7bdv9" (UID: "46a35022-86b5-480d-aea1-f208711a62e2") : secret "model-serving-api-tls" not found
Jul 27 18:37:23.303781 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:23.303689    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:24.236333 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:24.236292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bdv9\" (UID: \"46a35022-86b5-480d-aea1-f208711a62e2\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:24.239394 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:24.239368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a35022-86b5-480d-aea1-f208711a62e2-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bdv9\" (UID: \"46a35022-86b5-480d-aea1-f208711a62e2\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:24.381502 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:24.381403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:24.920115 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:24.920081    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"]
Jul 27 18:37:24.925877 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:37:24.925838    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485f2e3d_c55a_402e_97fe_e1da9fe3c402.slice/crio-eff860c3fae6884e73907a88d2f964d101a418440cc7f97e882bb3e7298eabe5 WatchSource:0}: Error finding container eff860c3fae6884e73907a88d2f964d101a418440cc7f97e882bb3e7298eabe5: Status 404 returned error can't find the container with id eff860c3fae6884e73907a88d2f964d101a418440cc7f97e882bb3e7298eabe5
Jul 27 18:37:24.963483 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:24.963454    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7bdv9"]
Jul 27 18:37:24.966072 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:37:24.966031    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a35022_86b5_480d_aea1_f208711a62e2.slice/crio-4eac491e32dd6cad45ca295d794ef0a9f944d06f7199c302b4f6fd3232289472 WatchSource:0}: Error finding container 4eac491e32dd6cad45ca295d794ef0a9f944d06f7199c302b4f6fd3232289472: Status 404 returned error can't find the container with id 4eac491e32dd6cad45ca295d794ef0a9f944d06f7199c302b4f6fd3232289472
Jul 27 18:37:25.053542 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:25.053421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm" event={"ID":"4bbdfbcc-06eb-4f89-8070-74804ce88da8","Type":"ContainerStarted","Data":"02855619d0be670c62429038345f0848eaac58c266cebafa8a568ed75c66f1ef"}
Jul 27 18:37:25.053698 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:25.053544    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:25.054812 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:25.054791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c" event={"ID":"485f2e3d-c55a-402e-97fe-e1da9fe3c402","Type":"ContainerStarted","Data":"eff860c3fae6884e73907a88d2f964d101a418440cc7f97e882bb3e7298eabe5"}
Jul 27 18:37:25.056199 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:25.056170    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8" event={"ID":"6ca57049-13b6-438e-844f-65197e11a830","Type":"ContainerStarted","Data":"6a1c0f3584dc8252539be4a871bc11957ec0afab222246cd5e7af3855ba2039c"}
Jul 27 18:37:25.057419 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:25.057397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9" event={"ID":"46a35022-86b5-480d-aea1-f208711a62e2","Type":"ContainerStarted","Data":"4eac491e32dd6cad45ca295d794ef0a9f944d06f7199c302b4f6fd3232289472"}
Jul 27 18:37:25.078833 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:25.078784    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm" podStartSLOduration=1.8705193599999999 podStartE2EDuration="5.07876455s" totalImagesPullingTime="3.20824519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:25.076592787 +0000 UTC m=+343.159875643" watchObservedRunningTime="2026-07-27 18:37:25.07876455 +0000 UTC m=+343.162047402"
Jul 27 18:37:25.096821 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:25.096778    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55894cd494-6gdh8" podStartSLOduration=1.637839267 podStartE2EDuration="6.096764831s" totalImagesPullingTime="4.458925564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:25.094983876 +0000 UTC m=+343.178266727" watchObservedRunningTime="2026-07-27 18:37:25.096764831 +0000 UTC m=+343.180047683"
Jul 27 18:37:28.092372 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:28.092332    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 18:37:28.092785 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:28.092412    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 18:37:29.082881 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.082840    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c" event={"ID":"485f2e3d-c55a-402e-97fe-e1da9fe3c402","Type":"ContainerStarted","Data":"b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3"}
Jul 27 18:37:29.083074 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.083011    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:29.084569 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.084539    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9" event={"ID":"46a35022-86b5-480d-aea1-f208711a62e2","Type":"ContainerStarted","Data":"42a7f950feea2d7eaff53d6463f8d54aece318d0eefd08a019096da0c4b6ae5c"}
Jul 27 18:37:29.084680 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.084642    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:37:29.084961 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.084941    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-w9t8c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:37:29.085022 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.084991    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c" podUID="485f2e3d-c55a-402e-97fe-e1da9fe3c402" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:37:29.120263 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.120219    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c" podStartSLOduration=3.956676846 podStartE2EDuration="7.120203398s" totalImagesPullingTime="3.163526552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:29.118550818 +0000 UTC m=+347.201833670" watchObservedRunningTime="2026-07-27 18:37:29.120203398 +0000 UTC m=+347.203486249"
Jul 27 18:37:29.143961 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.143910    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9" podStartSLOduration=4.033444593 podStartE2EDuration="7.143896738s" totalImagesPullingTime="3.110452145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:29.142050319 +0000 UTC m=+347.225333171" watchObservedRunningTime="2026-07-27 18:37:29.143896738 +0000 UTC m=+347.227179588"
Jul 27 18:37:29.640604 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.640557    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"]
Jul 27 18:37:29.645713 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.645689    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.649019 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.649000    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nk94f\""
Jul 27 18:37:29.660193 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.660170    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"]
Jul 27 18:37:29.681871 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.681840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.681871 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.681873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.682056 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.681902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e87a6b8-027b-49cd-895c-fa368a9d595b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.682056 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.681942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.682056 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.682005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.682056 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.682027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.682237 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.682078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.682237 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.682164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.682237 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.682223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l82cn\" (UniqueName: \"kubernetes.io/projected/5e87a6b8-027b-49cd-895c-fa368a9d595b-kube-api-access-l82cn\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.783549 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.783519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l82cn\" (UniqueName: \"kubernetes.io/projected/5e87a6b8-027b-49cd-895c-fa368a9d595b-kube-api-access-l82cn\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.783726 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.783557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.783726 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.783581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.783726 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.783608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e87a6b8-027b-49cd-895c-fa368a9d595b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.783918 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.783750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.783918 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.783853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.783918 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.783889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.784078 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.783976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.784078 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.784023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.784180 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.784023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.784180 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.784166    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.784300 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.784230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.784349 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.784333    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.784408 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.784382    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e87a6b8-027b-49cd-895c-fa368a9d595b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.786317 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.786289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.786420 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.786293    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.794239 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.794196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l82cn\" (UniqueName: \"kubernetes.io/projected/5e87a6b8-027b-49cd-895c-fa368a9d595b-kube-api-access-l82cn\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.794592 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.794572    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e87a6b8-027b-49cd-895c-fa368a9d595b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csftmj\" (UID: \"5e87a6b8-027b-49cd-895c-fa368a9d595b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:29.956233 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:29.956159    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:30.089971 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:30.089947    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:30.123898 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:30.123870    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"]
Jul 27 18:37:30.125565 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:37:30.125541    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e87a6b8_027b_49cd_895c_fa368a9d595b.slice/crio-dd2148f83d2cf6e9b33c7c4d4ca15167db322677192152046e24d488b9e5f899 WatchSource:0}: Error finding container dd2148f83d2cf6e9b33c7c4d4ca15167db322677192152046e24d488b9e5f899: Status 404 returned error can't find the container with id dd2148f83d2cf6e9b33c7c4d4ca15167db322677192152046e24d488b9e5f899
Jul 27 18:37:31.097115 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:31.097081    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj" event={"ID":"5e87a6b8-027b-49cd-895c-fa368a9d595b","Type":"ContainerStarted","Data":"dd2148f83d2cf6e9b33c7c4d4ca15167db322677192152046e24d488b9e5f899"}
Jul 27 18:37:32.783476 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.783345    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r972m"]
Jul 27 18:37:32.792025 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.791985    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:32.801289 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.801260    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vdxv9\""
Jul 27 18:37:32.801399 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.801290    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 18:37:32.806236 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.806214    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"]
Jul 27 18:37:32.810636 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.810617    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:32.811639 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.811612    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r972m"]
Jul 27 18:37:32.814715 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.814696    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 18:37:32.814715 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.814711    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sst2r\""
Jul 27 18:37:32.835739 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.835710    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"]
Jul 27 18:37:32.908176 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.908145    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 18:37:32.908283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.908220    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 18:37:32.908283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.908258    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 18:37:32.917504 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.917482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksdd9\" (UniqueName: \"kubernetes.io/projected/b0b29033-f0ce-4330-b340-c141e2739b16-kube-api-access-ksdd9\") pod \"kserve-controller-manager-d6f4b65b8-r972m\" (UID: \"b0b29033-f0ce-4330-b340-c141e2739b16\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:32.917602 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.917514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4kr\" (UniqueName: \"kubernetes.io/projected/8afed296-cb00-4e53-957a-3d2c6c5341dc-kube-api-access-2v4kr\") pod \"llmisvc-controller-manager-777c6bd7d5-j5pxg\" (UID: \"8afed296-cb00-4e53-957a-3d2c6c5341dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:32.917602 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.917543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0b29033-f0ce-4330-b340-c141e2739b16-cert\") pod \"kserve-controller-manager-d6f4b65b8-r972m\" (UID: \"b0b29033-f0ce-4330-b340-c141e2739b16\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:32.917720 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:32.917699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afed296-cb00-4e53-957a-3d2c6c5341dc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j5pxg\" (UID: \"8afed296-cb00-4e53-957a-3d2c6c5341dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:33.018929 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.018888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksdd9\" (UniqueName: \"kubernetes.io/projected/b0b29033-f0ce-4330-b340-c141e2739b16-kube-api-access-ksdd9\") pod \"kserve-controller-manager-d6f4b65b8-r972m\" (UID: \"b0b29033-f0ce-4330-b340-c141e2739b16\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:33.019173 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.018942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4kr\" (UniqueName: \"kubernetes.io/projected/8afed296-cb00-4e53-957a-3d2c6c5341dc-kube-api-access-2v4kr\") pod \"llmisvc-controller-manager-777c6bd7d5-j5pxg\" (UID: \"8afed296-cb00-4e53-957a-3d2c6c5341dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:33.019173 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.018985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0b29033-f0ce-4330-b340-c141e2739b16-cert\") pod \"kserve-controller-manager-d6f4b65b8-r972m\" (UID: \"b0b29033-f0ce-4330-b340-c141e2739b16\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:33.019173 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.019083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afed296-cb00-4e53-957a-3d2c6c5341dc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j5pxg\" (UID: \"8afed296-cb00-4e53-957a-3d2c6c5341dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:33.022376 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.022347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0b29033-f0ce-4330-b340-c141e2739b16-cert\") pod \"kserve-controller-manager-d6f4b65b8-r972m\" (UID: \"b0b29033-f0ce-4330-b340-c141e2739b16\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:33.022544 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.022347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afed296-cb00-4e53-957a-3d2c6c5341dc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j5pxg\" (UID: \"8afed296-cb00-4e53-957a-3d2c6c5341dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:33.030243 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.030219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksdd9\" (UniqueName: \"kubernetes.io/projected/b0b29033-f0ce-4330-b340-c141e2739b16-kube-api-access-ksdd9\") pod \"kserve-controller-manager-d6f4b65b8-r972m\" (UID: \"b0b29033-f0ce-4330-b340-c141e2739b16\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:33.031177 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.031148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4kr\" (UniqueName: \"kubernetes.io/projected/8afed296-cb00-4e53-957a-3d2c6c5341dc-kube-api-access-2v4kr\") pod \"llmisvc-controller-manager-777c6bd7d5-j5pxg\" (UID: \"8afed296-cb00-4e53-957a-3d2c6c5341dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:33.105187 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.105143    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:33.111046 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.111009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj" event={"ID":"5e87a6b8-027b-49cd-895c-fa368a9d595b","Type":"ContainerStarted","Data":"50a46838341a6883bd695513b69ed4220d36f579a6054f69795bac0dcdf9e341"}
Jul 27 18:37:33.122382 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.122139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:33.308100 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.308049    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj" podStartSLOduration=1.527798779 podStartE2EDuration="4.308024057s" totalImagesPullingTime="2.780225278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:33.158083872 +0000 UTC m=+351.241366723" watchObservedRunningTime="2026-07-27 18:37:33.308024057 +0000 UTC m=+351.391306909"
Jul 27 18:37:33.309133 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.309115    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r972m"]
Jul 27 18:37:33.310483 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:37:33.310456    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b29033_f0ce_4330_b340_c141e2739b16.slice/crio-83e1ce52691531545a1081eb74d19b9d9dbfd52d3baa075b691c1fd3c6388345 WatchSource:0}: Error finding container 83e1ce52691531545a1081eb74d19b9d9dbfd52d3baa075b691c1fd3c6388345: Status 404 returned error can't find the container with id 83e1ce52691531545a1081eb74d19b9d9dbfd52d3baa075b691c1fd3c6388345
Jul 27 18:37:33.366088 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.366013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"]
Jul 27 18:37:33.370862 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:37:33.370834    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8afed296_cb00_4e53_957a_3d2c6c5341dc.slice/crio-584eb6627fa2f6c9a318558f1af965fb12a3d55705e6f067469de5eb947c63e4 WatchSource:0}: Error finding container 584eb6627fa2f6c9a318558f1af965fb12a3d55705e6f067469de5eb947c63e4: Status 404 returned error can't find the container with id 584eb6627fa2f6c9a318558f1af965fb12a3d55705e6f067469de5eb947c63e4
Jul 27 18:37:33.956998 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.956970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:33.962596 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:33.962570    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:34.118891 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.118857    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg" event={"ID":"8afed296-cb00-4e53-957a-3d2c6c5341dc","Type":"ContainerStarted","Data":"584eb6627fa2f6c9a318558f1af965fb12a3d55705e6f067469de5eb947c63e4"}
Jul 27 18:37:34.120254 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.120223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m" event={"ID":"b0b29033-f0ce-4330-b340-c141e2739b16","Type":"ContainerStarted","Data":"83e1ce52691531545a1081eb74d19b9d9dbfd52d3baa075b691c1fd3c6388345"}
Jul 27 18:37:34.120558 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.120531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:34.121536 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.121512    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csftmj"
Jul 27 18:37:34.470024 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.469991    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"]
Jul 27 18:37:34.470229 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.470205    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c" podUID="485f2e3d-c55a-402e-97fe-e1da9fe3c402" containerName="discovery" containerID="cri-o://b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3" gracePeriod=30
Jul 27 18:37:34.757708 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.757681    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:34.836280 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.836251    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj4cq\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-kube-api-access-kj4cq\") pod \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") "
Jul 27 18:37:34.836471 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.836308    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-cacerts\") pod \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") "
Jul 27 18:37:34.836471 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.836352    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-dns-cert\") pod \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") "
Jul 27 18:37:34.836471 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.836380    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-token\") pod \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") "
Jul 27 18:37:34.836471 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.836442    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f2e3d-c55a-402e-97fe-e1da9fe3c402-local-certs\") pod \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") "
Jul 27 18:37:34.836695 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.836472    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-kubeconfig\") pod \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") "
Jul 27 18:37:34.836695 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.836571    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-ca-configmap\") pod \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\" (UID: \"485f2e3d-c55a-402e-97fe-e1da9fe3c402\") "
Jul 27 18:37:34.837391 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.837347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "485f2e3d-c55a-402e-97fe-e1da9fe3c402" (UID: "485f2e3d-c55a-402e-97fe-e1da9fe3c402"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:37:34.839259 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.839213    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-token" (OuterVolumeSpecName: "istio-token") pod "485f2e3d-c55a-402e-97fe-e1da9fe3c402" (UID: "485f2e3d-c55a-402e-97fe-e1da9fe3c402"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:37:34.839477 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.839368    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-cacerts" (OuterVolumeSpecName: "cacerts") pod "485f2e3d-c55a-402e-97fe-e1da9fe3c402" (UID: "485f2e3d-c55a-402e-97fe-e1da9fe3c402"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:37:34.839477 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.839418    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "485f2e3d-c55a-402e-97fe-e1da9fe3c402" (UID: "485f2e3d-c55a-402e-97fe-e1da9fe3c402"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:37:34.839612 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.839565    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "485f2e3d-c55a-402e-97fe-e1da9fe3c402" (UID: "485f2e3d-c55a-402e-97fe-e1da9fe3c402"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:37:34.839674 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.839621    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f2e3d-c55a-402e-97fe-e1da9fe3c402-local-certs" (OuterVolumeSpecName: "local-certs") pod "485f2e3d-c55a-402e-97fe-e1da9fe3c402" (UID: "485f2e3d-c55a-402e-97fe-e1da9fe3c402"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:37:34.839949 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.839928    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-kube-api-access-kj4cq" (OuterVolumeSpecName: "kube-api-access-kj4cq") pod "485f2e3d-c55a-402e-97fe-e1da9fe3c402" (UID: "485f2e3d-c55a-402e-97fe-e1da9fe3c402"). InnerVolumeSpecName "kube-api-access-kj4cq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:37:34.938151 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.938115    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-ca-configmap\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:37:34.938151 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.938152    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj4cq\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-kube-api-access-kj4cq\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:37:34.938419 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.938167    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-cacerts\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:37:34.938419 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.938181    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-csr-dns-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:37:34.938419 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.938197    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:37:34.938419 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.938209    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f2e3d-c55a-402e-97fe-e1da9fe3c402-local-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:37:34.938419 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:34.938220    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/485f2e3d-c55a-402e-97fe-e1da9fe3c402-istio-kubeconfig\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:37:35.126893 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.126853    2577 generic.go:356] "Generic (PLEG): container finished" podID="485f2e3d-c55a-402e-97fe-e1da9fe3c402" containerID="b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3" exitCode=0
Jul 27 18:37:35.127283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.126909    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"
Jul 27 18:37:35.127283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.126940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c" event={"ID":"485f2e3d-c55a-402e-97fe-e1da9fe3c402","Type":"ContainerDied","Data":"b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3"}
Jul 27 18:37:35.127283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.127023    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c" event={"ID":"485f2e3d-c55a-402e-97fe-e1da9fe3c402","Type":"ContainerDied","Data":"eff860c3fae6884e73907a88d2f964d101a418440cc7f97e882bb3e7298eabe5"}
Jul 27 18:37:35.127283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.127052    2577 scope.go:117] "RemoveContainer" containerID="b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3"
Jul 27 18:37:35.137318 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.137301    2577 scope.go:117] "RemoveContainer" containerID="b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3"
Jul 27 18:37:35.137603 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:37:35.137582    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3\": container with ID starting with b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3 not found: ID does not exist" containerID="b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3"
Jul 27 18:37:35.137666 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.137611    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3"} err="failed to get container status \"b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3\": rpc error: code = NotFound desc = could not find container \"b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3\": container with ID starting with b6dd321c42ec8cc882f8d4d63d8edde1f5989f97692524ab33089dd4277bb0f3 not found: ID does not exist"
Jul 27 18:37:35.162198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.162170    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"]
Jul 27 18:37:35.178035 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:35.178006    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w9t8c"]
Jul 27 18:37:36.068009 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:36.067979    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dcjwm"
Jul 27 18:37:36.513691 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:36.513656    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485f2e3d-c55a-402e-97fe-e1da9fe3c402" path="/var/lib/kubelet/pods/485f2e3d-c55a-402e-97fe-e1da9fe3c402/volumes"
Jul 27 18:37:37.143074 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:37.143039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m" event={"ID":"b0b29033-f0ce-4330-b340-c141e2739b16","Type":"ContainerStarted","Data":"9253e0be4d250422413e6ac45e2b6a3c7632324da96c9b1cef3717a298853ee0"}
Jul 27 18:37:37.143247 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:37.143228    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:37:37.144895 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:37.144873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg" event={"ID":"8afed296-cb00-4e53-957a-3d2c6c5341dc","Type":"ContainerStarted","Data":"7867c6688fd85820eadbfd01e5f79b01dd8f4bff62d938793b52efda3ca0c51e"}
Jul 27 18:37:37.145020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:37.145014    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:37:37.171658 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:37.171596    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m" podStartSLOduration=1.5255985650000001 podStartE2EDuration="5.171576441s" totalImagesPullingTime="3.645977876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:37.170361261 +0000 UTC m=+355.253644114" watchObservedRunningTime="2026-07-27 18:37:37.171576441 +0000 UTC m=+355.254859291"
Jul 27 18:37:37.213821 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:37.213724    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg" podStartSLOduration=1.592133161 podStartE2EDuration="5.213706197s" totalImagesPullingTime="3.621573036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:37.209249981 +0000 UTC m=+355.292532832" watchObservedRunningTime="2026-07-27 18:37:37.213706197 +0000 UTC m=+355.296989047"
Jul 27 18:37:40.093172 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:37:40.093141    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7bdv9"
Jul 27 18:38:08.154011 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:08.153980    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5pxg"
Jul 27 18:38:08.157045 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:08.157024    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r972m"
Jul 27 18:38:20.601807 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.601769    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gqg9"]
Jul 27 18:38:20.602192 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.602133    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485f2e3d-c55a-402e-97fe-e1da9fe3c402" containerName="discovery"
Jul 27 18:38:20.602192 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.602144    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="485f2e3d-c55a-402e-97fe-e1da9fe3c402" containerName="discovery"
Jul 27 18:38:20.602273 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.602217    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="485f2e3d-c55a-402e-97fe-e1da9fe3c402" containerName="discovery"
Jul 27 18:38:20.608623 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.608598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9"
Jul 27 18:38:20.611807 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.611784    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 18:38:20.611955 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.611821    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d8q4g\""
Jul 27 18:38:20.612811 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.612793    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 18:38:20.617856 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.617825    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gqg9"]
Jul 27 18:38:20.655924 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.655889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzlqq\" (UniqueName: \"kubernetes.io/projected/c56ec499-8428-4c46-aaa6-25358521e945-kube-api-access-dzlqq\") pod \"kuadrant-operator-catalog-5gqg9\" (UID: \"c56ec499-8428-4c46-aaa6-25358521e945\") " pod="kuadrant-system/kuadrant-operator-catalog-5gqg9"
Jul 27 18:38:20.757516 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.757482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzlqq\" (UniqueName: \"kubernetes.io/projected/c56ec499-8428-4c46-aaa6-25358521e945-kube-api-access-dzlqq\") pod \"kuadrant-operator-catalog-5gqg9\" (UID: \"c56ec499-8428-4c46-aaa6-25358521e945\") " pod="kuadrant-system/kuadrant-operator-catalog-5gqg9"
Jul 27 18:38:20.776068 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.776043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzlqq\" (UniqueName: \"kubernetes.io/projected/c56ec499-8428-4c46-aaa6-25358521e945-kube-api-access-dzlqq\") pod \"kuadrant-operator-catalog-5gqg9\" (UID: \"c56ec499-8428-4c46-aaa6-25358521e945\") " pod="kuadrant-system/kuadrant-operator-catalog-5gqg9"
Jul 27 18:38:20.920225 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.920146    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9"
Jul 27 18:38:20.981111 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:20.981076    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gqg9"]
Jul 27 18:38:21.099034 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.099005    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gqg9"]
Jul 27 18:38:21.101167 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:21.101143    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56ec499_8428_4c46_aaa6_25358521e945.slice/crio-3f2de9ce20ac75c97aec906fa57b3b4a8988d620971c646372933698d998f9ef WatchSource:0}: Error finding container 3f2de9ce20ac75c97aec906fa57b3b4a8988d620971c646372933698d998f9ef: Status 404 returned error can't find the container with id 3f2de9ce20ac75c97aec906fa57b3b4a8988d620971c646372933698d998f9ef
Jul 27 18:38:21.192816 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.192729    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-shptk"]
Jul 27 18:38:21.195708 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.195686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:21.265150 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.265118    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cpmq\" (UniqueName: \"kubernetes.io/projected/7cf040ab-7f37-4db4-a3b9-25f58b082d65-kube-api-access-2cpmq\") pod \"kuadrant-operator-catalog-shptk\" (UID: \"7cf040ab-7f37-4db4-a3b9-25f58b082d65\") " pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:21.286293 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.286262    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-shptk"]
Jul 27 18:38:21.365872 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.365842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cpmq\" (UniqueName: \"kubernetes.io/projected/7cf040ab-7f37-4db4-a3b9-25f58b082d65-kube-api-access-2cpmq\") pod \"kuadrant-operator-catalog-shptk\" (UID: \"7cf040ab-7f37-4db4-a3b9-25f58b082d65\") " pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:21.368150 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.368117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9" event={"ID":"c56ec499-8428-4c46-aaa6-25358521e945","Type":"ContainerStarted","Data":"3f2de9ce20ac75c97aec906fa57b3b4a8988d620971c646372933698d998f9ef"}
Jul 27 18:38:21.377313 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.377285    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cpmq\" (UniqueName: \"kubernetes.io/projected/7cf040ab-7f37-4db4-a3b9-25f58b082d65-kube-api-access-2cpmq\") pod \"kuadrant-operator-catalog-shptk\" (UID: \"7cf040ab-7f37-4db4-a3b9-25f58b082d65\") " pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:21.504824 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.504736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:21.644508 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:21.644483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-shptk"]
Jul 27 18:38:21.646326 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:21.646296    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf040ab_7f37_4db4_a3b9_25f58b082d65.slice/crio-4deb8c76e78dc4aaa1cb0c494fdbc3f8c0d7e0551affb32aeb0c6baa61251355 WatchSource:0}: Error finding container 4deb8c76e78dc4aaa1cb0c494fdbc3f8c0d7e0551affb32aeb0c6baa61251355: Status 404 returned error can't find the container with id 4deb8c76e78dc4aaa1cb0c494fdbc3f8c0d7e0551affb32aeb0c6baa61251355
Jul 27 18:38:22.376961 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:22.376925    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-shptk" event={"ID":"7cf040ab-7f37-4db4-a3b9-25f58b082d65","Type":"ContainerStarted","Data":"4deb8c76e78dc4aaa1cb0c494fdbc3f8c0d7e0551affb32aeb0c6baa61251355"}
Jul 27 18:38:24.389182 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.389138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-shptk" event={"ID":"7cf040ab-7f37-4db4-a3b9-25f58b082d65","Type":"ContainerStarted","Data":"19c387855f5c35ab35860bcf02d61417447768b62a1bd1736a83e4bfdbc27d3a"}
Jul 27 18:38:24.390702 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.390677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9" event={"ID":"c56ec499-8428-4c46-aaa6-25358521e945","Type":"ContainerStarted","Data":"5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0"}
Jul 27 18:38:24.390815 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.390701    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9" podUID="c56ec499-8428-4c46-aaa6-25358521e945" containerName="registry-server" containerID="cri-o://5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0" gracePeriod=2
Jul 27 18:38:24.405029 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.404980    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-shptk" podStartSLOduration=1.631244307 podStartE2EDuration="3.404962161s" totalImagesPullingTime="1.773717854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:38:24.404704033 +0000 UTC m=+402.487986893" watchObservedRunningTime="2026-07-27 18:38:24.404962161 +0000 UTC m=+402.488245014"
Jul 27 18:38:24.421332 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.421291    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9" podStartSLOduration=2.098026314 podStartE2EDuration="4.421276346s" totalImagesPullingTime="2.323250032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:38:24.420810308 +0000 UTC m=+402.504093158" watchObservedRunningTime="2026-07-27 18:38:24.421276346 +0000 UTC m=+402.504559196"
Jul 27 18:38:24.639352 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.639295    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9"
Jul 27 18:38:24.695952 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.695919    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzlqq\" (UniqueName: \"kubernetes.io/projected/c56ec499-8428-4c46-aaa6-25358521e945-kube-api-access-dzlqq\") pod \"c56ec499-8428-4c46-aaa6-25358521e945\" (UID: \"c56ec499-8428-4c46-aaa6-25358521e945\") "
Jul 27 18:38:24.698172 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.698145    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56ec499-8428-4c46-aaa6-25358521e945-kube-api-access-dzlqq" (OuterVolumeSpecName: "kube-api-access-dzlqq") pod "c56ec499-8428-4c46-aaa6-25358521e945" (UID: "c56ec499-8428-4c46-aaa6-25358521e945"). InnerVolumeSpecName "kube-api-access-dzlqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:38:24.796496 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:24.796470    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzlqq\" (UniqueName: \"kubernetes.io/projected/c56ec499-8428-4c46-aaa6-25358521e945-kube-api-access-dzlqq\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:25.396953 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.396917    2577 generic.go:356] "Generic (PLEG): container finished" podID="c56ec499-8428-4c46-aaa6-25358521e945" containerID="5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0" exitCode=0
Jul 27 18:38:25.397377 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.396964    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9"
Jul 27 18:38:25.397377 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.397007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9" event={"ID":"c56ec499-8428-4c46-aaa6-25358521e945","Type":"ContainerDied","Data":"5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0"}
Jul 27 18:38:25.397377 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.397058    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5gqg9" event={"ID":"c56ec499-8428-4c46-aaa6-25358521e945","Type":"ContainerDied","Data":"3f2de9ce20ac75c97aec906fa57b3b4a8988d620971c646372933698d998f9ef"}
Jul 27 18:38:25.397377 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.397079    2577 scope.go:117] "RemoveContainer" containerID="5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0"
Jul 27 18:38:25.406285 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.406266    2577 scope.go:117] "RemoveContainer" containerID="5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0"
Jul 27 18:38:25.406589 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:38:25.406566    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0\": container with ID starting with 5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0 not found: ID does not exist" containerID="5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0"
Jul 27 18:38:25.406702 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.406595    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0"} err="failed to get container status \"5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0\": rpc error: code = NotFound desc = could not find container \"5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0\": container with ID starting with 5c310f7f5c82850d6c2172d86b3441c0bf4b111a15f08013cd099b84b4f816f0 not found: ID does not exist"
Jul 27 18:38:25.418496 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.418474    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gqg9"]
Jul 27 18:38:25.422139 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:25.422120    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gqg9"]
Jul 27 18:38:26.511078 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:26.511046    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56ec499-8428-4c46-aaa6-25358521e945" path="/var/lib/kubelet/pods/c56ec499-8428-4c46-aaa6-25358521e945/volumes"
Jul 27 18:38:31.504864 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:31.504829    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:31.505277 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:31.505105    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:31.527058 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:31.527031    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:32.460772 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:32.460741    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-shptk"
Jul 27 18:38:35.842041 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.842007    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"]
Jul 27 18:38:35.842440 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.842376    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56ec499-8428-4c46-aaa6-25358521e945" containerName="registry-server"
Jul 27 18:38:35.842440 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.842386    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56ec499-8428-4c46-aaa6-25358521e945" containerName="registry-server"
Jul 27 18:38:35.842546 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.842464    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c56ec499-8428-4c46-aaa6-25358521e945" containerName="registry-server"
Jul 27 18:38:35.844696 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.844679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:35.847906 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.847890    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-snhgl\""
Jul 27 18:38:35.863513 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.863489    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"]
Jul 27 18:38:35.994594 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.994563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:35.994755 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.994602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x8ck\" (UniqueName: \"kubernetes.io/projected/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-kube-api-access-9x8ck\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:35.994755 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:35.994630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:36.096068 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.095979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:36.096068 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.096022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x8ck\" (UniqueName: \"kubernetes.io/projected/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-kube-api-access-9x8ck\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:36.096068 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.096058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:36.096378 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.096359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:36.096483 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.096468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:36.106668 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.106646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x8ck\" (UniqueName: \"kubernetes.io/projected/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-kube-api-access-9x8ck\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:36.154240 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.154214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:36.292122 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.292096    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"]
Jul 27 18:38:36.293696 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:36.293666    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9023a0e6_dc74_4c73_b7d5_f6136071bb8d.slice/crio-239e8c04bad3cfd30ddd552bb8b199fb65d70ab13a02e9f6ee345f6b0c42f9d8 WatchSource:0}: Error finding container 239e8c04bad3cfd30ddd552bb8b199fb65d70ab13a02e9f6ee345f6b0c42f9d8: Status 404 returned error can't find the container with id 239e8c04bad3cfd30ddd552bb8b199fb65d70ab13a02e9f6ee345f6b0c42f9d8
Jul 27 18:38:36.461128 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.461098    2577 generic.go:356] "Generic (PLEG): container finished" podID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerID="69611ea5fb610cc86e91096a74d74c943c1256abaf4eafaa71fcd3c346cd9889" exitCode=0
Jul 27 18:38:36.461288 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.461138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp" event={"ID":"9023a0e6-dc74-4c73-b7d5-f6136071bb8d","Type":"ContainerDied","Data":"69611ea5fb610cc86e91096a74d74c943c1256abaf4eafaa71fcd3c346cd9889"}
Jul 27 18:38:36.461288 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.461172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp" event={"ID":"9023a0e6-dc74-4c73-b7d5-f6136071bb8d","Type":"ContainerStarted","Data":"239e8c04bad3cfd30ddd552bb8b199fb65d70ab13a02e9f6ee345f6b0c42f9d8"}
Jul 27 18:38:36.644272 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.644196    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"]
Jul 27 18:38:36.646843 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.646828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.660020 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.659997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"]
Jul 27 18:38:36.802733 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.802705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7qc5\" (UniqueName: \"kubernetes.io/projected/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-kube-api-access-c7qc5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.802886 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.802746    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.802886 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.802763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.904076 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.903988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qc5\" (UniqueName: \"kubernetes.io/projected/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-kube-api-access-c7qc5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.904076 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.904036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.904076 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.904052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.904541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.904366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.904541 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.904407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.913923 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.913900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7qc5\" (UniqueName: \"kubernetes.io/projected/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-kube-api-access-c7qc5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:36.956177 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:36.956150    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:37.041300 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.037823    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"]
Jul 27 18:38:37.044195 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.044167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.050027 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.049995    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"]
Jul 27 18:38:37.105022 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.104994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"]
Jul 27 18:38:37.206834 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:37.206764    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c65be2a_3b7c_4e5f_9c0a_8c4fdf4a22b4.slice/crio-0372afaa7d82a1824b1eae82e680db5217277d5cb227d91e3bbd000e4a8926d5 WatchSource:0}: Error finding container 0372afaa7d82a1824b1eae82e680db5217277d5cb227d91e3bbd000e4a8926d5: Status 404 returned error can't find the container with id 0372afaa7d82a1824b1eae82e680db5217277d5cb227d91e3bbd000e4a8926d5
Jul 27 18:38:37.207530 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.207131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.207530 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.207261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.207530 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.207283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h77tk\" (UniqueName: \"kubernetes.io/projected/007b3ae2-001d-4683-be40-ce18213745c3-kube-api-access-h77tk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.307779 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.307747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.307912 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.307789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h77tk\" (UniqueName: \"kubernetes.io/projected/007b3ae2-001d-4683-be40-ce18213745c3-kube-api-access-h77tk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.307912 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.307814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.308148 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.308128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.308216 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.308134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.317875 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.317847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h77tk\" (UniqueName: \"kubernetes.io/projected/007b3ae2-001d-4683-be40-ce18213745c3-kube-api-access-h77tk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.358808 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.358778    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:37.456883 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.456816    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"]
Jul 27 18:38:37.461143 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.461118    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.469655 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.469498    2577 generic.go:356] "Generic (PLEG): container finished" podID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerID="900d6ccebad62f6cdcf785e9fabf57c7a18501770b4ea0c8e6a4d3179768003b" exitCode=0
Jul 27 18:38:37.469655 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.469632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp" event={"ID":"9023a0e6-dc74-4c73-b7d5-f6136071bb8d","Type":"ContainerDied","Data":"900d6ccebad62f6cdcf785e9fabf57c7a18501770b4ea0c8e6a4d3179768003b"}
Jul 27 18:38:37.471887 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.471862    2577 generic.go:356] "Generic (PLEG): container finished" podID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerID="a3aeb056b007b6255f1f84dc84786abeae35115d10b3da754f01c219a64678a9" exitCode=0
Jul 27 18:38:37.471978 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.471915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42" event={"ID":"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4","Type":"ContainerDied","Data":"a3aeb056b007b6255f1f84dc84786abeae35115d10b3da754f01c219a64678a9"}
Jul 27 18:38:37.471978 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.471955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42" event={"ID":"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4","Type":"ContainerStarted","Data":"0372afaa7d82a1824b1eae82e680db5217277d5cb227d91e3bbd000e4a8926d5"}
Jul 27 18:38:37.485688 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.485655    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"]
Jul 27 18:38:37.515314 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.515293    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"]
Jul 27 18:38:37.517570 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:37.517546    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007b3ae2_001d_4683_be40_ce18213745c3.slice/crio-9e27c89ea99b9b2a788bddaa4bdfc9b46f2994c12387412c9dfefef6f7215c01 WatchSource:0}: Error finding container 9e27c89ea99b9b2a788bddaa4bdfc9b46f2994c12387412c9dfefef6f7215c01: Status 404 returned error can't find the container with id 9e27c89ea99b9b2a788bddaa4bdfc9b46f2994c12387412c9dfefef6f7215c01
Jul 27 18:38:37.612021 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.611982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.612234 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.612092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.612234 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.612205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxbt\" (UniqueName: \"kubernetes.io/projected/27d9b599-3bff-43ec-8354-6633bbd06674-kube-api-access-xvxbt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.713005 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.712929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.713005 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.712982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.713178 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.713025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxbt\" (UniqueName: \"kubernetes.io/projected/27d9b599-3bff-43ec-8354-6633bbd06674-kube-api-access-xvxbt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.713307 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.713290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.713398 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.713377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.723114 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.723085    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxbt\" (UniqueName: \"kubernetes.io/projected/27d9b599-3bff-43ec-8354-6633bbd06674-kube-api-access-xvxbt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.773164 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.773138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:37.915478 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:37.915381    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"]
Jul 27 18:38:37.917628 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:37.917603    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d9b599_3bff_43ec_8354_6633bbd06674.slice/crio-be75b5dde7e6451358949a71b18ff9cca18b67a012161ca5cbe214ece8ae6e80 WatchSource:0}: Error finding container be75b5dde7e6451358949a71b18ff9cca18b67a012161ca5cbe214ece8ae6e80: Status 404 returned error can't find the container with id be75b5dde7e6451358949a71b18ff9cca18b67a012161ca5cbe214ece8ae6e80
Jul 27 18:38:38.479200 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.479116    2577 generic.go:356] "Generic (PLEG): container finished" podID="27d9b599-3bff-43ec-8354-6633bbd06674" containerID="981c618c31078ae1dc7de7650574d82d0c7c74cd019fb0cd6df7734e1c893804" exitCode=0
Jul 27 18:38:38.479200 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.479169    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq" event={"ID":"27d9b599-3bff-43ec-8354-6633bbd06674","Type":"ContainerDied","Data":"981c618c31078ae1dc7de7650574d82d0c7c74cd019fb0cd6df7734e1c893804"}
Jul 27 18:38:38.479458 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.479221    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq" event={"ID":"27d9b599-3bff-43ec-8354-6633bbd06674","Type":"ContainerStarted","Data":"be75b5dde7e6451358949a71b18ff9cca18b67a012161ca5cbe214ece8ae6e80"}
Jul 27 18:38:38.481498 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.481451    2577 generic.go:356] "Generic (PLEG): container finished" podID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerID="266cf5e1ca6b344ad83783889bc4cc70462d28714bb42137497fe6aa5d8d70cc" exitCode=0
Jul 27 18:38:38.481575 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.481522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp" event={"ID":"9023a0e6-dc74-4c73-b7d5-f6136071bb8d","Type":"ContainerDied","Data":"266cf5e1ca6b344ad83783889bc4cc70462d28714bb42137497fe6aa5d8d70cc"}
Jul 27 18:38:38.483030 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.483010    2577 generic.go:356] "Generic (PLEG): container finished" podID="007b3ae2-001d-4683-be40-ce18213745c3" containerID="637a0a109d2621bb834607ef0fe33e409db732808d44ff803d0129a6b828ab2e" exitCode=0
Jul 27 18:38:38.483128 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.483115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4" event={"ID":"007b3ae2-001d-4683-be40-ce18213745c3","Type":"ContainerDied","Data":"637a0a109d2621bb834607ef0fe33e409db732808d44ff803d0129a6b828ab2e"}
Jul 27 18:38:38.483184 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.483149    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4" event={"ID":"007b3ae2-001d-4683-be40-ce18213745c3","Type":"ContainerStarted","Data":"9e27c89ea99b9b2a788bddaa4bdfc9b46f2994c12387412c9dfefef6f7215c01"}
Jul 27 18:38:38.485009 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.484990    2577 generic.go:356] "Generic (PLEG): container finished" podID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerID="a361bc625b1926b9e0ecd13e60bbcc88d830d01ea59e499d473680e31a9261d6" exitCode=0
Jul 27 18:38:38.485103 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:38.485016    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42" event={"ID":"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4","Type":"ContainerDied","Data":"a361bc625b1926b9e0ecd13e60bbcc88d830d01ea59e499d473680e31a9261d6"}
Jul 27 18:38:39.493252 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.493164    2577 generic.go:356] "Generic (PLEG): container finished" podID="007b3ae2-001d-4683-be40-ce18213745c3" containerID="2c99ab9ae43d654e83582831aa5601f16a12b17f83b9406e21791436a56bc90e" exitCode=0
Jul 27 18:38:39.493683 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.493253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4" event={"ID":"007b3ae2-001d-4683-be40-ce18213745c3","Type":"ContainerDied","Data":"2c99ab9ae43d654e83582831aa5601f16a12b17f83b9406e21791436a56bc90e"}
Jul 27 18:38:39.495558 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.495535    2577 generic.go:356] "Generic (PLEG): container finished" podID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerID="a970c3d0717469b96bba2705623030234f28a4a75f59023bb74a5e16e9016f1e" exitCode=0
Jul 27 18:38:39.495639 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.495615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42" event={"ID":"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4","Type":"ContainerDied","Data":"a970c3d0717469b96bba2705623030234f28a4a75f59023bb74a5e16e9016f1e"}
Jul 27 18:38:39.638759 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.638730    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:39.732929 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.732899    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-util\") pod \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") "
Jul 27 18:38:39.733083 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.733044    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-bundle\") pod \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") "
Jul 27 18:38:39.733083 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.733076    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x8ck\" (UniqueName: \"kubernetes.io/projected/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-kube-api-access-9x8ck\") pod \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\" (UID: \"9023a0e6-dc74-4c73-b7d5-f6136071bb8d\") "
Jul 27 18:38:39.733509 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.733483    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-bundle" (OuterVolumeSpecName: "bundle") pod "9023a0e6-dc74-4c73-b7d5-f6136071bb8d" (UID: "9023a0e6-dc74-4c73-b7d5-f6136071bb8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:38:39.735223 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.735190    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-kube-api-access-9x8ck" (OuterVolumeSpecName: "kube-api-access-9x8ck") pod "9023a0e6-dc74-4c73-b7d5-f6136071bb8d" (UID: "9023a0e6-dc74-4c73-b7d5-f6136071bb8d"). InnerVolumeSpecName "kube-api-access-9x8ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:38:39.738978 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.738950    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-util" (OuterVolumeSpecName: "util") pod "9023a0e6-dc74-4c73-b7d5-f6136071bb8d" (UID: "9023a0e6-dc74-4c73-b7d5-f6136071bb8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:38:39.834051 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.834022    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:39.834149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.834059    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x8ck\" (UniqueName: \"kubernetes.io/projected/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-kube-api-access-9x8ck\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:39.834149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:39.834075    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9023a0e6-dc74-4c73-b7d5-f6136071bb8d-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:40.502782 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.502697    2577 generic.go:356] "Generic (PLEG): container finished" podID="27d9b599-3bff-43ec-8354-6633bbd06674" containerID="5e6873a0611aaa82a75999d934e5f845e31eb542f3d28c0f0f9292fc1f40ef40" exitCode=0
Jul 27 18:38:40.503198 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.502780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq" event={"ID":"27d9b599-3bff-43ec-8354-6633bbd06674","Type":"ContainerDied","Data":"5e6873a0611aaa82a75999d934e5f845e31eb542f3d28c0f0f9292fc1f40ef40"}
Jul 27 18:38:40.504874 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.504853    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp"
Jul 27 18:38:40.507083 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.507047    2577 generic.go:356] "Generic (PLEG): container finished" podID="007b3ae2-001d-4683-be40-ce18213745c3" containerID="7ce8d2c05609400cecfb12e81ab781aba52a35b8601495065196926b03f4aeb4" exitCode=0
Jul 27 18:38:40.511770 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.511740    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp" event={"ID":"9023a0e6-dc74-4c73-b7d5-f6136071bb8d","Type":"ContainerDied","Data":"239e8c04bad3cfd30ddd552bb8b199fb65d70ab13a02e9f6ee345f6b0c42f9d8"}
Jul 27 18:38:40.511890 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.511788    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="239e8c04bad3cfd30ddd552bb8b199fb65d70ab13a02e9f6ee345f6b0c42f9d8"
Jul 27 18:38:40.511890 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.511803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4" event={"ID":"007b3ae2-001d-4683-be40-ce18213745c3","Type":"ContainerDied","Data":"7ce8d2c05609400cecfb12e81ab781aba52a35b8601495065196926b03f4aeb4"}
Jul 27 18:38:40.646918 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.646894    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:40.740193 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.740165    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7qc5\" (UniqueName: \"kubernetes.io/projected/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-kube-api-access-c7qc5\") pod \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") "
Jul 27 18:38:40.740363 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.740271    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-util\") pod \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") "
Jul 27 18:38:40.740363 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.740301    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-bundle\") pod \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\" (UID: \"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4\") "
Jul 27 18:38:40.740838 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.740815    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-bundle" (OuterVolumeSpecName: "bundle") pod "9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" (UID: "9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:38:40.742325 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.742302    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-kube-api-access-c7qc5" (OuterVolumeSpecName: "kube-api-access-c7qc5") pod "9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" (UID: "9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4"). InnerVolumeSpecName "kube-api-access-c7qc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:38:40.745967 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.745927    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-util" (OuterVolumeSpecName: "util") pod "9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" (UID: "9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:38:40.841021 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.840985    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:40.841021 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.841015    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:40.841209 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:40.841029    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7qc5\" (UniqueName: \"kubernetes.io/projected/9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4-kube-api-access-c7qc5\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:41.514705 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.514610    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42"
Jul 27 18:38:41.514705 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.514625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42" event={"ID":"9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4","Type":"ContainerDied","Data":"0372afaa7d82a1824b1eae82e680db5217277d5cb227d91e3bbd000e4a8926d5"}
Jul 27 18:38:41.514705 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.514671    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0372afaa7d82a1824b1eae82e680db5217277d5cb227d91e3bbd000e4a8926d5"
Jul 27 18:38:41.516980 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.516953    2577 generic.go:356] "Generic (PLEG): container finished" podID="27d9b599-3bff-43ec-8354-6633bbd06674" containerID="a44ad357bc71105c7fe1d879a2b5fbdc5647c80fd29e06c3959463fa171cc0ba" exitCode=0
Jul 27 18:38:41.517110 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.517030    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq" event={"ID":"27d9b599-3bff-43ec-8354-6633bbd06674","Type":"ContainerDied","Data":"a44ad357bc71105c7fe1d879a2b5fbdc5647c80fd29e06c3959463fa171cc0ba"}
Jul 27 18:38:41.652597 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.652569    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:41.749949 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.749919    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-bundle\") pod \"007b3ae2-001d-4683-be40-ce18213745c3\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") "
Jul 27 18:38:41.750111 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.749957    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h77tk\" (UniqueName: \"kubernetes.io/projected/007b3ae2-001d-4683-be40-ce18213745c3-kube-api-access-h77tk\") pod \"007b3ae2-001d-4683-be40-ce18213745c3\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") "
Jul 27 18:38:41.750111 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.750006    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-util\") pod \"007b3ae2-001d-4683-be40-ce18213745c3\" (UID: \"007b3ae2-001d-4683-be40-ce18213745c3\") "
Jul 27 18:38:41.750711 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.750683    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-bundle" (OuterVolumeSpecName: "bundle") pod "007b3ae2-001d-4683-be40-ce18213745c3" (UID: "007b3ae2-001d-4683-be40-ce18213745c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:38:41.752181 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.752151    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/007b3ae2-001d-4683-be40-ce18213745c3-kube-api-access-h77tk" (OuterVolumeSpecName: "kube-api-access-h77tk") pod "007b3ae2-001d-4683-be40-ce18213745c3" (UID: "007b3ae2-001d-4683-be40-ce18213745c3"). InnerVolumeSpecName "kube-api-access-h77tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:38:41.755526 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.755498    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-util" (OuterVolumeSpecName: "util") pod "007b3ae2-001d-4683-be40-ce18213745c3" (UID: "007b3ae2-001d-4683-be40-ce18213745c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:38:41.851520 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.851493    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:41.851520 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.851518    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h77tk\" (UniqueName: \"kubernetes.io/projected/007b3ae2-001d-4683-be40-ce18213745c3-kube-api-access-h77tk\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:41.851715 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:41.851528    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/007b3ae2-001d-4683-be40-ce18213745c3-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:42.523621 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.523597    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4"
Jul 27 18:38:42.523956 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.523619    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4" event={"ID":"007b3ae2-001d-4683-be40-ce18213745c3","Type":"ContainerDied","Data":"9e27c89ea99b9b2a788bddaa4bdfc9b46f2994c12387412c9dfefef6f7215c01"}
Jul 27 18:38:42.523956 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.523656    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e27c89ea99b9b2a788bddaa4bdfc9b46f2994c12387412c9dfefef6f7215c01"
Jul 27 18:38:42.663515 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.663486    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:42.759351 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.759315    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvxbt\" (UniqueName: \"kubernetes.io/projected/27d9b599-3bff-43ec-8354-6633bbd06674-kube-api-access-xvxbt\") pod \"27d9b599-3bff-43ec-8354-6633bbd06674\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") "
Jul 27 18:38:42.759547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.759359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-bundle\") pod \"27d9b599-3bff-43ec-8354-6633bbd06674\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") "
Jul 27 18:38:42.759547 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.759398    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-util\") pod \"27d9b599-3bff-43ec-8354-6633bbd06674\" (UID: \"27d9b599-3bff-43ec-8354-6633bbd06674\") "
Jul 27 18:38:42.759922 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.759898    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-bundle" (OuterVolumeSpecName: "bundle") pod "27d9b599-3bff-43ec-8354-6633bbd06674" (UID: "27d9b599-3bff-43ec-8354-6633bbd06674"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:38:42.761610 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.761589    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d9b599-3bff-43ec-8354-6633bbd06674-kube-api-access-xvxbt" (OuterVolumeSpecName: "kube-api-access-xvxbt") pod "27d9b599-3bff-43ec-8354-6633bbd06674" (UID: "27d9b599-3bff-43ec-8354-6633bbd06674"). InnerVolumeSpecName "kube-api-access-xvxbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:38:42.767761 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.767717    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-util" (OuterVolumeSpecName: "util") pod "27d9b599-3bff-43ec-8354-6633bbd06674" (UID: "27d9b599-3bff-43ec-8354-6633bbd06674"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:38:42.860492 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.860459    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvxbt\" (UniqueName: \"kubernetes.io/projected/27d9b599-3bff-43ec-8354-6633bbd06674-kube-api-access-xvxbt\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:42.860492 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.860484    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:42.860492 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:42.860493    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d9b599-3bff-43ec-8354-6633bbd06674-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:38:43.531281 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:43.531244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq" event={"ID":"27d9b599-3bff-43ec-8354-6633bbd06674","Type":"ContainerDied","Data":"be75b5dde7e6451358949a71b18ff9cca18b67a012161ca5cbe214ece8ae6e80"}
Jul 27 18:38:43.531281 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:43.531289    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be75b5dde7e6451358949a71b18ff9cca18b67a012161ca5cbe214ece8ae6e80"
Jul 27 18:38:43.531731 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:43.531295    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq"
Jul 27 18:38:53.454355 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454319    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"]
Jul 27 18:38:53.454746 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454713    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="007b3ae2-001d-4683-be40-ce18213745c3" containerName="extract"
Jul 27 18:38:53.454746 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454725    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="007b3ae2-001d-4683-be40-ce18213745c3" containerName="extract"
Jul 27 18:38:53.454746 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454735    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerName="pull"
Jul 27 18:38:53.454746 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454740    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerName="pull"
Jul 27 18:38:53.454746 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454747    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerName="util"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454752    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerName="util"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454760    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerName="extract"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454765    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerName="extract"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454772    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerName="pull"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454776    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerName="pull"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454784    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerName="util"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454790    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerName="util"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454796    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d9b599-3bff-43ec-8354-6633bbd06674" containerName="pull"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454801    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d9b599-3bff-43ec-8354-6633bbd06674" containerName="pull"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454811    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="007b3ae2-001d-4683-be40-ce18213745c3" containerName="util"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454816    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="007b3ae2-001d-4683-be40-ce18213745c3" containerName="util"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454822    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d9b599-3bff-43ec-8354-6633bbd06674" containerName="extract"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454826    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d9b599-3bff-43ec-8354-6633bbd06674" containerName="extract"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454833    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerName="extract"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454838    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerName="extract"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454844    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="007b3ae2-001d-4683-be40-ce18213745c3" containerName="pull"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454848    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="007b3ae2-001d-4683-be40-ce18213745c3" containerName="pull"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454857    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d9b599-3bff-43ec-8354-6633bbd06674" containerName="util"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454862    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d9b599-3bff-43ec-8354-6633bbd06674" containerName="util"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454911    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d9b599-3bff-43ec-8354-6633bbd06674" containerName="extract"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454920    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4" containerName="extract"
Jul 27 18:38:53.454916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454925    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9023a0e6-dc74-4c73-b7d5-f6136071bb8d" containerName="extract"
Jul 27 18:38:53.455706 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.454933    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="007b3ae2-001d-4683-be40-ce18213745c3" containerName="extract"
Jul 27 18:38:53.458851 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.458835    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"
Jul 27 18:38:53.461524 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.461505    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wt4pj\""
Jul 27 18:38:53.469934 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.469906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"]
Jul 27 18:38:53.556773 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.556741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcfkh\" (UniqueName: \"kubernetes.io/projected/87d1fe8d-59d7-4d9f-8e04-45beec435d2a-kube-api-access-dcfkh\") pod \"authorino-operator-75cc8d5cb7-clv2p\" (UID: \"87d1fe8d-59d7-4d9f-8e04-45beec435d2a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"
Jul 27 18:38:53.657595 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.657548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcfkh\" (UniqueName: \"kubernetes.io/projected/87d1fe8d-59d7-4d9f-8e04-45beec435d2a-kube-api-access-dcfkh\") pod \"authorino-operator-75cc8d5cb7-clv2p\" (UID: \"87d1fe8d-59d7-4d9f-8e04-45beec435d2a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"
Jul 27 18:38:53.675220 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.675188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcfkh\" (UniqueName: \"kubernetes.io/projected/87d1fe8d-59d7-4d9f-8e04-45beec435d2a-kube-api-access-dcfkh\") pod \"authorino-operator-75cc8d5cb7-clv2p\" (UID: \"87d1fe8d-59d7-4d9f-8e04-45beec435d2a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"
Jul 27 18:38:53.769701 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.769612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"
Jul 27 18:38:53.928251 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:53.928218    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"]
Jul 27 18:38:53.932347 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:53.932316    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d1fe8d_59d7_4d9f_8e04_45beec435d2a.slice/crio-3b6034ba1d76fd59f4ee9c810d7e868fe719d267d2a9e72f40eb0809b738671d WatchSource:0}: Error finding container 3b6034ba1d76fd59f4ee9c810d7e868fe719d267d2a9e72f40eb0809b738671d: Status 404 returned error can't find the container with id 3b6034ba1d76fd59f4ee9c810d7e868fe719d267d2a9e72f40eb0809b738671d
Jul 27 18:38:54.588801 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:54.588761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p" event={"ID":"87d1fe8d-59d7-4d9f-8e04-45beec435d2a","Type":"ContainerStarted","Data":"3b6034ba1d76fd59f4ee9c810d7e868fe719d267d2a9e72f40eb0809b738671d"}
Jul 27 18:38:56.367813 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.367734    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"]
Jul 27 18:38:56.371462 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.371421    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"
Jul 27 18:38:56.375463 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.375444    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 18:38:56.375518 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.375479    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-flrhb\""
Jul 27 18:38:56.387484 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.387461    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"]
Jul 27 18:38:56.483885 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.483849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42tmh\" (UniqueName: \"kubernetes.io/projected/68d84c2d-f462-4a47-89a9-1cb83fb0b3c6-kube-api-access-42tmh\") pod \"dns-operator-controller-manager-864dd78c4c-fwxqc\" (UID: \"68d84c2d-f462-4a47-89a9-1cb83fb0b3c6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"
Jul 27 18:38:56.584483 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.584450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42tmh\" (UniqueName: \"kubernetes.io/projected/68d84c2d-f462-4a47-89a9-1cb83fb0b3c6-kube-api-access-42tmh\") pod \"dns-operator-controller-manager-864dd78c4c-fwxqc\" (UID: \"68d84c2d-f462-4a47-89a9-1cb83fb0b3c6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"
Jul 27 18:38:56.600396 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.600374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42tmh\" (UniqueName: \"kubernetes.io/projected/68d84c2d-f462-4a47-89a9-1cb83fb0b3c6-kube-api-access-42tmh\") pod \"dns-operator-controller-manager-864dd78c4c-fwxqc\" (UID: \"68d84c2d-f462-4a47-89a9-1cb83fb0b3c6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"
Jul 27 18:38:56.603480 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.603421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p" event={"ID":"87d1fe8d-59d7-4d9f-8e04-45beec435d2a","Type":"ContainerStarted","Data":"4bcd0cc9899869a5856aefd21446e3ae9ae4adc3babfdaa767d8cf175e6b5581"}
Jul 27 18:38:56.603621 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.603519    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"
Jul 27 18:38:56.633790 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.633679    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p" podStartSLOduration=1.449640896 podStartE2EDuration="3.633659189s" totalImagesPullingTime="2.184018293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:38:56.630186157 +0000 UTC m=+434.713469007" watchObservedRunningTime="2026-07-27 18:38:56.633659189 +0000 UTC m=+434.716942040"
Jul 27 18:38:56.681880 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.681846    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"
Jul 27 18:38:56.835655 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:56.835630    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"]
Jul 27 18:38:56.838608 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:56.838582    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d84c2d_f462_4a47_89a9_1cb83fb0b3c6.slice/crio-6d42ca3a67ed7377ab5fdc69d550cdaf40da94c80a5391b2b23931596cc2e485 WatchSource:0}: Error finding container 6d42ca3a67ed7377ab5fdc69d550cdaf40da94c80a5391b2b23931596cc2e485: Status 404 returned error can't find the container with id 6d42ca3a67ed7377ab5fdc69d550cdaf40da94c80a5391b2b23931596cc2e485
Jul 27 18:38:57.609717 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:57.609684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc" event={"ID":"68d84c2d-f462-4a47-89a9-1cb83fb0b3c6","Type":"ContainerStarted","Data":"6d42ca3a67ed7377ab5fdc69d550cdaf40da94c80a5391b2b23931596cc2e485"}
Jul 27 18:38:58.883041 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:58.883006    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"]
Jul 27 18:38:58.885979 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:58.885953    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:38:58.889370 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:58.889346    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t68kc\""
Jul 27 18:38:58.902051 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:58.902027    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"]
Jul 27 18:38:58.906401 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:58.906337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqlb\" (UniqueName: \"kubernetes.io/projected/31ab0ea0-7a61-4448-b721-78f9551f39ca-kube-api-access-wzqlb\") pod \"limitador-operator-controller-manager-859d7b78bd-ns6vr\" (UID: \"31ab0ea0-7a61-4448-b721-78f9551f39ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:38:59.007899 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:59.007849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqlb\" (UniqueName: \"kubernetes.io/projected/31ab0ea0-7a61-4448-b721-78f9551f39ca-kube-api-access-wzqlb\") pod \"limitador-operator-controller-manager-859d7b78bd-ns6vr\" (UID: \"31ab0ea0-7a61-4448-b721-78f9551f39ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:38:59.018386 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:59.018356    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqlb\" (UniqueName: \"kubernetes.io/projected/31ab0ea0-7a61-4448-b721-78f9551f39ca-kube-api-access-wzqlb\") pod \"limitador-operator-controller-manager-859d7b78bd-ns6vr\" (UID: \"31ab0ea0-7a61-4448-b721-78f9551f39ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:38:59.199159 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:59.199065    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:38:59.619820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:59.619788    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"]
Jul 27 18:38:59.624087 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:38:59.624058    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ab0ea0_7a61_4448_b721_78f9551f39ca.slice/crio-8492f459ef11568d64abf0b4a631728f5333601a6e9906bce565d220b99d7bff WatchSource:0}: Error finding container 8492f459ef11568d64abf0b4a631728f5333601a6e9906bce565d220b99d7bff: Status 404 returned error can't find the container with id 8492f459ef11568d64abf0b4a631728f5333601a6e9906bce565d220b99d7bff
Jul 27 18:38:59.626028 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:59.625998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc" event={"ID":"68d84c2d-f462-4a47-89a9-1cb83fb0b3c6","Type":"ContainerStarted","Data":"51dc1e6f3eec8ebf4e22969060dd43a6c6d33c01850ef9fb696d02acdc3d9651"}
Jul 27 18:38:59.626244 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:59.626223    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"
Jul 27 18:38:59.733224 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:38:59.733127    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc" podStartSLOduration=1.113248879 podStartE2EDuration="3.733111799s" totalImagesPullingTime="2.61986292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:38:59.729828541 +0000 UTC m=+437.813111394" watchObservedRunningTime="2026-07-27 18:38:59.733111799 +0000 UTC m=+437.816394649"
Jul 27 18:39:00.632354 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:00.632326    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr" event={"ID":"31ab0ea0-7a61-4448-b721-78f9551f39ca","Type":"ContainerStarted","Data":"8492f459ef11568d64abf0b4a631728f5333601a6e9906bce565d220b99d7bff"}
Jul 27 18:39:01.639844 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:01.639736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr" event={"ID":"31ab0ea0-7a61-4448-b721-78f9551f39ca","Type":"ContainerStarted","Data":"3e8c3cd66b5803add366099738c3bc904efc0d4339452c7a8fb422d5fca948e5"}
Jul 27 18:39:01.639844 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:01.639814    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:01.676394 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:01.676336    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr" podStartSLOduration=1.92133468 podStartE2EDuration="3.676318553s" totalImagesPullingTime="1.754983873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:39:01.671351351 +0000 UTC m=+439.754634204" watchObservedRunningTime="2026-07-27 18:39:01.676318553 +0000 UTC m=+439.759601404"
Jul 27 18:39:02.916272 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:02.916190    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"]
Jul 27 18:39:02.918755 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:02.918741    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:02.922274 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:02.922255    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zknkw\""
Jul 27 18:39:02.933979 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:02.933958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"]
Jul 27 18:39:02.947173 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:02.947149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz48d\" (UniqueName: \"kubernetes.io/projected/541affa1-51fd-4476-a386-5c9504165514-kube-api-access-mz48d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" (UID: \"541affa1-51fd-4476-a386-5c9504165514\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:02.947283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:02.947213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/541affa1-51fd-4476-a386-5c9504165514-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" (UID: \"541affa1-51fd-4476-a386-5c9504165514\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:03.047961 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:03.047927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/541affa1-51fd-4476-a386-5c9504165514-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" (UID: \"541affa1-51fd-4476-a386-5c9504165514\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:03.048125 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:03.048036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz48d\" (UniqueName: \"kubernetes.io/projected/541affa1-51fd-4476-a386-5c9504165514-kube-api-access-mz48d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" (UID: \"541affa1-51fd-4476-a386-5c9504165514\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:03.048316 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:03.048295    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/541affa1-51fd-4476-a386-5c9504165514-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" (UID: \"541affa1-51fd-4476-a386-5c9504165514\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:03.057536 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:03.057511    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz48d\" (UniqueName: \"kubernetes.io/projected/541affa1-51fd-4476-a386-5c9504165514-kube-api-access-mz48d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" (UID: \"541affa1-51fd-4476-a386-5c9504165514\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:03.228828 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:03.228735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:03.383022 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:03.382996    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"]
Jul 27 18:39:03.384634 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:39:03.384608    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541affa1_51fd_4476_a386_5c9504165514.slice/crio-60e6f061412d91fbfe89d9c82391bb4536ac223fcd33dc880ad90c73edfba796 WatchSource:0}: Error finding container 60e6f061412d91fbfe89d9c82391bb4536ac223fcd33dc880ad90c73edfba796: Status 404 returned error can't find the container with id 60e6f061412d91fbfe89d9c82391bb4536ac223fcd33dc880ad90c73edfba796
Jul 27 18:39:03.651815 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:03.651776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg" event={"ID":"541affa1-51fd-4476-a386-5c9504165514","Type":"ContainerStarted","Data":"60e6f061412d91fbfe89d9c82391bb4536ac223fcd33dc880ad90c73edfba796"}
Jul 27 18:39:07.612591 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:07.612556    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clv2p"
Jul 27 18:39:10.635525 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:10.635493    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwxqc"
Jul 27 18:39:10.698329 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:10.698293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg" event={"ID":"541affa1-51fd-4476-a386-5c9504165514","Type":"ContainerStarted","Data":"0a9e7191c46f23a8fc7a7ec92d37ddc1f0e591cc31c6ac98f224a2d4b3b37f0f"}
Jul 27 18:39:10.698529 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:10.698395    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:11.637419 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.637362    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg" podStartSLOduration=3.016089328 podStartE2EDuration="9.637342134s" totalImagesPullingTime="6.621252806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:39:10.727179334 +0000 UTC m=+448.810462185" watchObservedRunningTime="2026-07-27 18:39:11.637342134 +0000 UTC m=+449.720624984"
Jul 27 18:39:11.639785 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.639752    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f8fd5bb9b-jschq"]
Jul 27 18:39:11.642332 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.642314    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.663634 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.663606    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8fd5bb9b-jschq"]
Jul 27 18:39:11.736026 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.735988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-serving-cert\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.736287 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.736125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrq82\" (UniqueName: \"kubernetes.io/projected/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-kube-api-access-vrq82\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.736287 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.736165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-config\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.736287 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.736259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-oauth-config\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.736486 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.736291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-service-ca\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.736486 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.736324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-trusted-ca-bundle\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.736486 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.736378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-oauth-serving-cert\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.837073 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.837041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-serving-cert\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.837250 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.837132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrq82\" (UniqueName: \"kubernetes.io/projected/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-kube-api-access-vrq82\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.837250 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.837163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-config\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.837250 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.837211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-oauth-config\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.837250 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.837235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-service-ca\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.837538 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.837261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-trusted-ca-bundle\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.837538 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.837289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-oauth-serving-cert\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.838005 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.837982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-config\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.838319 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.838292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-oauth-serving-cert\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.838454 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.838411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-trusted-ca-bundle\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.838554 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.838535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-service-ca\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.840076 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.840053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-serving-cert\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.840169 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.840145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-console-oauth-config\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.862288 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.862258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrq82\" (UniqueName: \"kubernetes.io/projected/e3c7e0a9-64a4-444e-b1a0-ff5d2b414701-kube-api-access-vrq82\") pod \"console-f8fd5bb9b-jschq\" (UID: \"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701\") " pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:11.952420 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:11.952337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:12.102595 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:12.102572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8fd5bb9b-jschq"]
Jul 27 18:39:12.103904 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:39:12.103875    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c7e0a9_64a4_444e_b1a0_ff5d2b414701.slice/crio-f5d9f03317759ceb2dc216ee79e432073b26e95d98f0add088a4c1f454875103 WatchSource:0}: Error finding container f5d9f03317759ceb2dc216ee79e432073b26e95d98f0add088a4c1f454875103: Status 404 returned error can't find the container with id f5d9f03317759ceb2dc216ee79e432073b26e95d98f0add088a4c1f454875103
Jul 27 18:39:12.647839 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:12.647811    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:12.719826 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:12.719792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8fd5bb9b-jschq" event={"ID":"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701","Type":"ContainerStarted","Data":"5aeb4a10b83e5f53ce0c923f969a6c3126cc92662c6f32ac500ae8ad695443a6"}
Jul 27 18:39:12.720008 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:12.719880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8fd5bb9b-jschq" event={"ID":"e3c7e0a9-64a4-444e-b1a0-ff5d2b414701","Type":"ContainerStarted","Data":"f5d9f03317759ceb2dc216ee79e432073b26e95d98f0add088a4c1f454875103"}
Jul 27 18:39:12.754101 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:12.754052    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f8fd5bb9b-jschq" podStartSLOduration=1.754037504 podStartE2EDuration="1.754037504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:39:12.751307947 +0000 UTC m=+450.834590810" watchObservedRunningTime="2026-07-27 18:39:12.754037504 +0000 UTC m=+450.837320354"
Jul 27 18:39:21.706149 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:21.706114    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:21.953293 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:21.953259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:21.953499 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:21.953313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:21.958400 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:21.958342    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:22.779623 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:22.779594    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f8fd5bb9b-jschq"
Jul 27 18:39:22.919545 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:22.919505    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5668b6665-cwb65"]
Jul 27 18:39:23.587214 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.587158    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"]
Jul 27 18:39:23.587602 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.587574    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg" podUID="541affa1-51fd-4476-a386-5c9504165514" containerName="manager" containerID="cri-o://0a9e7191c46f23a8fc7a7ec92d37ddc1f0e591cc31c6ac98f224a2d4b3b37f0f" gracePeriod=2
Jul 27 18:39:23.620143 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.620115    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"]
Jul 27 18:39:23.634761 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.634737    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"]
Jul 27 18:39:23.634995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.634964    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" containerName="manager" containerID="cri-o://3e8c3cd66b5803add366099738c3bc904efc0d4339452c7a8fb422d5fca948e5" gracePeriod=2
Jul 27 18:39:23.641821 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.641795    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"]
Jul 27 18:39:23.673666 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.673624    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"541affa1-51fd-4476-a386-5c9504165514\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-92rwg\": pods \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:23.676085 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.676054    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="541affa1-51fd-4476-a386-5c9504165514" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:23.679586 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.679557    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ns6vr\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:23.687164 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.687140    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"]
Jul 27 18:39:23.687631 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.687617    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541affa1-51fd-4476-a386-5c9504165514" containerName="manager"
Jul 27 18:39:23.687631 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.687633    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="541affa1-51fd-4476-a386-5c9504165514" containerName="manager"
Jul 27 18:39:23.687744 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.687645    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" containerName="manager"
Jul 27 18:39:23.687744 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.687652    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" containerName="manager"
Jul 27 18:39:23.687744 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.687723    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="541affa1-51fd-4476-a386-5c9504165514" containerName="manager"
Jul 27 18:39:23.687744 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.687734    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" containerName="manager"
Jul 27 18:39:23.690084 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.690069    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:23.693382 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.693348    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="541affa1-51fd-4476-a386-5c9504165514" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:23.696085 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.696059    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ns6vr\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:23.710085 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.710062    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"]
Jul 27 18:39:23.713016 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.712982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"
Jul 27 18:39:23.745743 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.745721    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"]
Jul 27 18:39:23.750413 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.750388    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"]
Jul 27 18:39:23.771789 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.771746    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ns6vr\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:23.785852 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.785823    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ab0ea0-7a61-4448-b721-78f9551f39ca" containerID="3e8c3cd66b5803add366099738c3bc904efc0d4339452c7a8fb422d5fca948e5" exitCode=0
Jul 27 18:39:23.787621 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.787586    2577 generic.go:356] "Generic (PLEG): container finished" podID="541affa1-51fd-4476-a386-5c9504165514" containerID="0a9e7191c46f23a8fc7a7ec92d37ddc1f0e591cc31c6ac98f224a2d4b3b37f0f" exitCode=0
Jul 27 18:39:23.839451 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.839326    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="541affa1-51fd-4476-a386-5c9504165514" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:23.844760 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.844731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59wp4\" (UniqueName: \"kubernetes.io/projected/5f908382-08b8-4eff-b9ef-302b6b0691db-kube-api-access-59wp4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q672f\" (UID: \"5f908382-08b8-4eff-b9ef-302b6b0691db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:23.844901 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.844785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f908382-08b8-4eff-b9ef-302b6b0691db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q672f\" (UID: \"5f908382-08b8-4eff-b9ef-302b6b0691db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:23.844957 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.844908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6489\" (UniqueName: \"kubernetes.io/projected/9e2653c9-d515-4ebe-98d3-f61b8d9d6bee-kube-api-access-j6489\") pod \"limitador-operator-controller-manager-859d7b78bd-d2vnm\" (UID: \"9e2653c9-d515-4ebe-98d3-f61b8d9d6bee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"
Jul 27 18:39:23.886461 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.886418    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:23.889566 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.889544    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:23.890282 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.890261    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ns6vr\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:23.893794 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.893776    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="541affa1-51fd-4476-a386-5c9504165514" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:23.895885 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.895865    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-92rwg\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="541affa1-51fd-4476-a386-5c9504165514" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:23.899937 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:23.899918    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ns6vr\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:23.946222 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.946195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6489\" (UniqueName: \"kubernetes.io/projected/9e2653c9-d515-4ebe-98d3-f61b8d9d6bee-kube-api-access-j6489\") pod \"limitador-operator-controller-manager-859d7b78bd-d2vnm\" (UID: \"9e2653c9-d515-4ebe-98d3-f61b8d9d6bee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"
Jul 27 18:39:23.946466 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.946411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59wp4\" (UniqueName: \"kubernetes.io/projected/5f908382-08b8-4eff-b9ef-302b6b0691db-kube-api-access-59wp4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q672f\" (UID: \"5f908382-08b8-4eff-b9ef-302b6b0691db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:23.946658 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.946637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f908382-08b8-4eff-b9ef-302b6b0691db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q672f\" (UID: \"5f908382-08b8-4eff-b9ef-302b6b0691db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:23.946966 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.946947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f908382-08b8-4eff-b9ef-302b6b0691db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q672f\" (UID: \"5f908382-08b8-4eff-b9ef-302b6b0691db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:23.983190 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.983160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6489\" (UniqueName: \"kubernetes.io/projected/9e2653c9-d515-4ebe-98d3-f61b8d9d6bee-kube-api-access-j6489\") pod \"limitador-operator-controller-manager-859d7b78bd-d2vnm\" (UID: \"9e2653c9-d515-4ebe-98d3-f61b8d9d6bee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"
Jul 27 18:39:23.987037 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:23.987020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59wp4\" (UniqueName: \"kubernetes.io/projected/5f908382-08b8-4eff-b9ef-302b6b0691db-kube-api-access-59wp4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q672f\" (UID: \"5f908382-08b8-4eff-b9ef-302b6b0691db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:24.035085 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.035048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:24.044277 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.044252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"
Jul 27 18:39:24.047341 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.047324    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/541affa1-51fd-4476-a386-5c9504165514-extensions-socket-volume\") pod \"541affa1-51fd-4476-a386-5c9504165514\" (UID: \"541affa1-51fd-4476-a386-5c9504165514\") "
Jul 27 18:39:24.047439 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.047353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz48d\" (UniqueName: \"kubernetes.io/projected/541affa1-51fd-4476-a386-5c9504165514-kube-api-access-mz48d\") pod \"541affa1-51fd-4476-a386-5c9504165514\" (UID: \"541affa1-51fd-4476-a386-5c9504165514\") "
Jul 27 18:39:24.047439 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.047379    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzqlb\" (UniqueName: \"kubernetes.io/projected/31ab0ea0-7a61-4448-b721-78f9551f39ca-kube-api-access-wzqlb\") pod \"31ab0ea0-7a61-4448-b721-78f9551f39ca\" (UID: \"31ab0ea0-7a61-4448-b721-78f9551f39ca\") "
Jul 27 18:39:24.047973 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.047940    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541affa1-51fd-4476-a386-5c9504165514-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "541affa1-51fd-4476-a386-5c9504165514" (UID: "541affa1-51fd-4476-a386-5c9504165514"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:39:24.049591 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.049568    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541affa1-51fd-4476-a386-5c9504165514-kube-api-access-mz48d" (OuterVolumeSpecName: "kube-api-access-mz48d") pod "541affa1-51fd-4476-a386-5c9504165514" (UID: "541affa1-51fd-4476-a386-5c9504165514"). InnerVolumeSpecName "kube-api-access-mz48d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:39:24.049737 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.049712    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ab0ea0-7a61-4448-b721-78f9551f39ca-kube-api-access-wzqlb" (OuterVolumeSpecName: "kube-api-access-wzqlb") pod "31ab0ea0-7a61-4448-b721-78f9551f39ca" (UID: "31ab0ea0-7a61-4448-b721-78f9551f39ca"). InnerVolumeSpecName "kube-api-access-wzqlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:39:24.149165 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.149135    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/541affa1-51fd-4476-a386-5c9504165514-extensions-socket-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:24.149165 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.149162    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz48d\" (UniqueName: \"kubernetes.io/projected/541affa1-51fd-4476-a386-5c9504165514-kube-api-access-mz48d\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:24.149165 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.149171    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzqlb\" (UniqueName: \"kubernetes.io/projected/31ab0ea0-7a61-4448-b721-78f9551f39ca-kube-api-access-wzqlb\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:24.192916 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.192881    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"]
Jul 27 18:39:24.194553 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:39:24.194527    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f908382_08b8_4eff_b9ef_302b6b0691db.slice/crio-80c92451bd0cdc4db28732eaea22da9007bb30d6f815c564d72fbfe9ba002885 WatchSource:0}: Error finding container 80c92451bd0cdc4db28732eaea22da9007bb30d6f815c564d72fbfe9ba002885: Status 404 returned error can't find the container with id 80c92451bd0cdc4db28732eaea22da9007bb30d6f815c564d72fbfe9ba002885
Jul 27 18:39:24.217274 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.217253    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"]
Jul 27 18:39:24.222574 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:39:24.222551    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2653c9_d515_4ebe_98d3_f61b8d9d6bee.slice/crio-16c38473e24458a6bedee0e424b0b9bbbcb6e30922767a1694d9450afdd59111 WatchSource:0}: Error finding container 16c38473e24458a6bedee0e424b0b9bbbcb6e30922767a1694d9450afdd59111: Status 404 returned error can't find the container with id 16c38473e24458a6bedee0e424b0b9bbbcb6e30922767a1694d9450afdd59111
Jul 27 18:39:24.510666 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.510586    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ab0ea0-7a61-4448-b721-78f9551f39ca" path="/var/lib/kubelet/pods/31ab0ea0-7a61-4448-b721-78f9551f39ca/volumes"
Jul 27 18:39:24.510952 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.510940    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="541affa1-51fd-4476-a386-5c9504165514" path="/var/lib/kubelet/pods/541affa1-51fd-4476-a386-5c9504165514/volumes"
Jul 27 18:39:24.795457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.795359    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-92rwg"
Jul 27 18:39:24.795457 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.795401    2577 scope.go:117] "RemoveContainer" containerID="0a9e7191c46f23a8fc7a7ec92d37ddc1f0e591cc31c6ac98f224a2d4b3b37f0f"
Jul 27 18:39:24.797460 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.797398    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm" event={"ID":"9e2653c9-d515-4ebe-98d3-f61b8d9d6bee","Type":"ContainerStarted","Data":"74cd74f25dd042c2ff7cca5296524e1d894849fba2280ec7f3ccf370dadba850"}
Jul 27 18:39:24.797648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.797477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm" event={"ID":"9e2653c9-d515-4ebe-98d3-f61b8d9d6bee","Type":"ContainerStarted","Data":"16c38473e24458a6bedee0e424b0b9bbbcb6e30922767a1694d9450afdd59111"}
Jul 27 18:39:24.797648 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.797522    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"
Jul 27 18:39:24.798999 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.798983    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ns6vr"
Jul 27 18:39:24.800804 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.800780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f" event={"ID":"5f908382-08b8-4eff-b9ef-302b6b0691db","Type":"ContainerStarted","Data":"81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3"}
Jul 27 18:39:24.800902 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.800822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f" event={"ID":"5f908382-08b8-4eff-b9ef-302b6b0691db","Type":"ContainerStarted","Data":"80c92451bd0cdc4db28732eaea22da9007bb30d6f815c564d72fbfe9ba002885"}
Jul 27 18:39:24.800902 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.800859    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:24.805909 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.805894    2577 scope.go:117] "RemoveContainer" containerID="3e8c3cd66b5803add366099738c3bc904efc0d4339452c7a8fb422d5fca948e5"
Jul 27 18:39:24.825321 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.825270    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm" podStartSLOduration=1.825256752 podStartE2EDuration="1.825256752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:39:24.823578341 +0000 UTC m=+462.906861387" watchObservedRunningTime="2026-07-27 18:39:24.825256752 +0000 UTC m=+462.908539669"
Jul 27 18:39:24.870386 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.870335    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f" podStartSLOduration=1.870320055 podStartE2EDuration="1.870320055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:39:24.869073306 +0000 UTC m=+462.952356180" watchObservedRunningTime="2026-07-27 18:39:24.870320055 +0000 UTC m=+462.953602905"
Jul 27 18:39:24.955309 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.955276    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"]
Jul 27 18:39:24.958807 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.958791    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:24.984324 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:24.984294    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"]
Jul 27 18:39:25.058072 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.057985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m58sf\" (UID: \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:25.058072 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.058047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5zcz\" (UniqueName: \"kubernetes.io/projected/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-kube-api-access-b5zcz\") pod \"kuadrant-operator-controller-manager-86878c769f-m58sf\" (UID: \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:25.159120 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.159085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m58sf\" (UID: \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:25.159295 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.159135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5zcz\" (UniqueName: \"kubernetes.io/projected/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-kube-api-access-b5zcz\") pod \"kuadrant-operator-controller-manager-86878c769f-m58sf\" (UID: \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:25.159480 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.159460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m58sf\" (UID: \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:25.171221 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.171189    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5zcz\" (UniqueName: \"kubernetes.io/projected/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-kube-api-access-b5zcz\") pod \"kuadrant-operator-controller-manager-86878c769f-m58sf\" (UID: \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:25.269559 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.269531    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:25.439083 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:39:25.439017    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcc6434_eadb_406c_b8c4_892d2f83a8a2.slice/crio-22b5b06d31570b2fdd4572d747d6dfe4d190721271e10bfc9711a5be65a84a7a WatchSource:0}: Error finding container 22b5b06d31570b2fdd4572d747d6dfe4d190721271e10bfc9711a5be65a84a7a: Status 404 returned error can't find the container with id 22b5b06d31570b2fdd4572d747d6dfe4d190721271e10bfc9711a5be65a84a7a
Jul 27 18:39:25.443674 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.443647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"]
Jul 27 18:39:25.807837 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.807783    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf" event={"ID":"7dcc6434-eadb-406c-b8c4-892d2f83a8a2","Type":"ContainerStarted","Data":"24d91101a632ea9c366d1a62cf64adf287c52a73b2a1e27f8febb0da3408bc3f"}
Jul 27 18:39:25.808263 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.807864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf" event={"ID":"7dcc6434-eadb-406c-b8c4-892d2f83a8a2","Type":"ContainerStarted","Data":"22b5b06d31570b2fdd4572d747d6dfe4d190721271e10bfc9711a5be65a84a7a"}
Jul 27 18:39:25.808263 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.807899    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:25.836712 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:25.836661    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf" podStartSLOduration=1.836639417 podStartE2EDuration="1.836639417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:39:25.833473435 +0000 UTC m=+463.916756283" watchObservedRunningTime="2026-07-27 18:39:25.836639417 +0000 UTC m=+463.919922268"
Jul 27 18:39:35.812044 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:35.812012    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:35.812486 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:35.812145    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2vnm"
Jul 27 18:39:36.818863 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:36.818829    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:39:36.888089 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:36.888056    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"]
Jul 27 18:39:36.888228 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:36.888215    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f" podUID="5f908382-08b8-4eff-b9ef-302b6b0691db" containerName="manager" containerID="cri-o://81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3" gracePeriod=10
Jul 27 18:39:37.133690 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.133665    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:37.163921 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.163897    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f908382-08b8-4eff-b9ef-302b6b0691db-extensions-socket-volume\") pod \"5f908382-08b8-4eff-b9ef-302b6b0691db\" (UID: \"5f908382-08b8-4eff-b9ef-302b6b0691db\") "
Jul 27 18:39:37.164260 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.164239    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f908382-08b8-4eff-b9ef-302b6b0691db-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5f908382-08b8-4eff-b9ef-302b6b0691db" (UID: "5f908382-08b8-4eff-b9ef-302b6b0691db"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:39:37.264553 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.264515    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59wp4\" (UniqueName: \"kubernetes.io/projected/5f908382-08b8-4eff-b9ef-302b6b0691db-kube-api-access-59wp4\") pod \"5f908382-08b8-4eff-b9ef-302b6b0691db\" (UID: \"5f908382-08b8-4eff-b9ef-302b6b0691db\") "
Jul 27 18:39:37.264766 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.264752    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f908382-08b8-4eff-b9ef-302b6b0691db-extensions-socket-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:37.266683 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.266655    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f908382-08b8-4eff-b9ef-302b6b0691db-kube-api-access-59wp4" (OuterVolumeSpecName: "kube-api-access-59wp4") pod "5f908382-08b8-4eff-b9ef-302b6b0691db" (UID: "5f908382-08b8-4eff-b9ef-302b6b0691db"). InnerVolumeSpecName "kube-api-access-59wp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:39:37.365308 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.365219    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59wp4\" (UniqueName: \"kubernetes.io/projected/5f908382-08b8-4eff-b9ef-302b6b0691db-kube-api-access-59wp4\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:37.892534 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.892502    2577 generic.go:356] "Generic (PLEG): container finished" podID="5f908382-08b8-4eff-b9ef-302b6b0691db" containerID="81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3" exitCode=0
Jul 27 18:39:37.892934 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.892551    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"
Jul 27 18:39:37.892934 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.892597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f" event={"ID":"5f908382-08b8-4eff-b9ef-302b6b0691db","Type":"ContainerDied","Data":"81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3"}
Jul 27 18:39:37.892934 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.892650    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f" event={"ID":"5f908382-08b8-4eff-b9ef-302b6b0691db","Type":"ContainerDied","Data":"80c92451bd0cdc4db28732eaea22da9007bb30d6f815c564d72fbfe9ba002885"}
Jul 27 18:39:37.892934 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.892674    2577 scope.go:117] "RemoveContainer" containerID="81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3"
Jul 27 18:39:37.902333 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.902317    2577 scope.go:117] "RemoveContainer" containerID="81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3"
Jul 27 18:39:37.902636 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:37.902618    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3\": container with ID starting with 81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3 not found: ID does not exist" containerID="81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3"
Jul 27 18:39:37.902711 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.902650    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3"} err="failed to get container status \"81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3\": rpc error: code = NotFound desc = could not find container \"81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3\": container with ID starting with 81d377e2bbe69864a74429cd69b92511965bedceb5805f47d0fb6921c81768e3 not found: ID does not exist"
Jul 27 18:39:37.919360 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.919327    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"]
Jul 27 18:39:37.924634 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:37.924611    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q672f"]
Jul 27 18:39:38.510901 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:38.510867    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f908382-08b8-4eff-b9ef-302b6b0691db" path="/var/lib/kubelet/pods/5f908382-08b8-4eff-b9ef-302b6b0691db/volumes"
Jul 27 18:39:47.940186 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:47.940145    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5668b6665-cwb65" podUID="f34cc544-be0e-44a0-8854-de893a8fdc3f" containerName="console" containerID="cri-o://9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa" gracePeriod=15
Jul 27 18:39:48.197097 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.197040    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:39:48.260312 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260278    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-config\") pod \"f34cc544-be0e-44a0-8854-de893a8fdc3f\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") "
Jul 27 18:39:48.260529 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260331    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-trusted-ca-bundle\") pod \"f34cc544-be0e-44a0-8854-de893a8fdc3f\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") "
Jul 27 18:39:48.260529 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-oauth-serving-cert\") pod \"f34cc544-be0e-44a0-8854-de893a8fdc3f\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") "
Jul 27 18:39:48.260529 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260384    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-service-ca\") pod \"f34cc544-be0e-44a0-8854-de893a8fdc3f\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") "
Jul 27 18:39:48.260529 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260416    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzdr5\" (UniqueName: \"kubernetes.io/projected/f34cc544-be0e-44a0-8854-de893a8fdc3f-kube-api-access-qzdr5\") pod \"f34cc544-be0e-44a0-8854-de893a8fdc3f\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") "
Jul 27 18:39:48.260529 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260510    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-serving-cert\") pod \"f34cc544-be0e-44a0-8854-de893a8fdc3f\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") "
Jul 27 18:39:48.260529 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260529    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-oauth-config\") pod \"f34cc544-be0e-44a0-8854-de893a8fdc3f\" (UID: \"f34cc544-be0e-44a0-8854-de893a8fdc3f\") "
Jul 27 18:39:48.260872 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260784    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-config" (OuterVolumeSpecName: "console-config") pod "f34cc544-be0e-44a0-8854-de893a8fdc3f" (UID: "f34cc544-be0e-44a0-8854-de893a8fdc3f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:39:48.260872 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260842    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f34cc544-be0e-44a0-8854-de893a8fdc3f" (UID: "f34cc544-be0e-44a0-8854-de893a8fdc3f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:39:48.260980 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260862    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f34cc544-be0e-44a0-8854-de893a8fdc3f" (UID: "f34cc544-be0e-44a0-8854-de893a8fdc3f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:39:48.260980 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.260896    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-service-ca" (OuterVolumeSpecName: "service-ca") pod "f34cc544-be0e-44a0-8854-de893a8fdc3f" (UID: "f34cc544-be0e-44a0-8854-de893a8fdc3f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:39:48.262769 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.262747    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f34cc544-be0e-44a0-8854-de893a8fdc3f" (UID: "f34cc544-be0e-44a0-8854-de893a8fdc3f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:39:48.262919 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.262891    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f34cc544-be0e-44a0-8854-de893a8fdc3f" (UID: "f34cc544-be0e-44a0-8854-de893a8fdc3f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:39:48.262960 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.262914    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34cc544-be0e-44a0-8854-de893a8fdc3f-kube-api-access-qzdr5" (OuterVolumeSpecName: "kube-api-access-qzdr5") pod "f34cc544-be0e-44a0-8854-de893a8fdc3f" (UID: "f34cc544-be0e-44a0-8854-de893a8fdc3f"). InnerVolumeSpecName "kube-api-access-qzdr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:39:48.361914 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.361875    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzdr5\" (UniqueName: \"kubernetes.io/projected/f34cc544-be0e-44a0-8854-de893a8fdc3f-kube-api-access-qzdr5\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:48.361914 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.361908    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-serving-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:48.361914 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.361917    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-oauth-config\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:48.361914 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.361926    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-console-config\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:48.362189 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.361935    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-trusted-ca-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:48.362189 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.361943    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-oauth-serving-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:48.362189 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.361951    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f34cc544-be0e-44a0-8854-de893a8fdc3f-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:39:48.964270 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.964233    2577 generic.go:356] "Generic (PLEG): container finished" podID="f34cc544-be0e-44a0-8854-de893a8fdc3f" containerID="9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa" exitCode=0
Jul 27 18:39:48.964752 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.964287    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668b6665-cwb65"
Jul 27 18:39:48.964752 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.964320    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668b6665-cwb65" event={"ID":"f34cc544-be0e-44a0-8854-de893a8fdc3f","Type":"ContainerDied","Data":"9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa"}
Jul 27 18:39:48.964752 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.964369    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668b6665-cwb65" event={"ID":"f34cc544-be0e-44a0-8854-de893a8fdc3f","Type":"ContainerDied","Data":"cf9ec20d8df51018a6d5d0a862e8cc36b9b2e423372d0ef12e867be9030245af"}
Jul 27 18:39:48.964752 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.964396    2577 scope.go:117] "RemoveContainer" containerID="9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa"
Jul 27 18:39:48.973861 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.973849    2577 scope.go:117] "RemoveContainer" containerID="9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa"
Jul 27 18:39:48.974122 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:39:48.974103    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa\": container with ID starting with 9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa not found: ID does not exist" containerID="9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa"
Jul 27 18:39:48.974169 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.974131    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa"} err="failed to get container status \"9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa\": rpc error: code = NotFound desc = could not find container \"9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa\": container with ID starting with 9478e20a43b355958122a9dcd4ea9de754c7154678551ad2852a0d80719f1eaa not found: ID does not exist"
Jul 27 18:39:48.985037 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.985011    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5668b6665-cwb65"]
Jul 27 18:39:48.993645 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:48.993622    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5668b6665-cwb65"]
Jul 27 18:39:50.511186 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:50.511153    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34cc544-be0e-44a0-8854-de893a8fdc3f" path="/var/lib/kubelet/pods/f34cc544-be0e-44a0-8854-de893a8fdc3f/volumes"
Jul 27 18:39:58.846360 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.846327    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:39:58.846798 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.846783    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34cc544-be0e-44a0-8854-de893a8fdc3f" containerName="console"
Jul 27 18:39:58.846798 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.846799    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34cc544-be0e-44a0-8854-de893a8fdc3f" containerName="console"
Jul 27 18:39:58.846874 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.846810    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f908382-08b8-4eff-b9ef-302b6b0691db" containerName="manager"
Jul 27 18:39:58.846874 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.846815    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f908382-08b8-4eff-b9ef-302b6b0691db" containerName="manager"
Jul 27 18:39:58.846941 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.846890    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f908382-08b8-4eff-b9ef-302b6b0691db" containerName="manager"
Jul 27 18:39:58.846941 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.846900    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34cc544-be0e-44a0-8854-de893a8fdc3f" containerName="console"
Jul 27 18:39:58.850094 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.850078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:39:58.853672 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.853654    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 18:39:58.855123 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.855109    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-snhgl\""
Jul 27 18:39:58.874634 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.874606    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:39:58.943120 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.943087    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:39:58.961845 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.961817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfckz\" (UniqueName: \"kubernetes.io/projected/a76ebd8a-71df-4b68-8351-5fff9191968c-kube-api-access-pfckz\") pod \"limitador-limitador-54d6d988d5-hnkcp\" (UID: \"a76ebd8a-71df-4b68-8351-5fff9191968c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:39:58.962005 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:58.961850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a76ebd8a-71df-4b68-8351-5fff9191968c-config-file\") pod \"limitador-limitador-54d6d988d5-hnkcp\" (UID: \"a76ebd8a-71df-4b68-8351-5fff9191968c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:39:59.063253 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.063218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfckz\" (UniqueName: \"kubernetes.io/projected/a76ebd8a-71df-4b68-8351-5fff9191968c-kube-api-access-pfckz\") pod \"limitador-limitador-54d6d988d5-hnkcp\" (UID: \"a76ebd8a-71df-4b68-8351-5fff9191968c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:39:59.063253 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.063253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a76ebd8a-71df-4b68-8351-5fff9191968c-config-file\") pod \"limitador-limitador-54d6d988d5-hnkcp\" (UID: \"a76ebd8a-71df-4b68-8351-5fff9191968c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:39:59.063849 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.063832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a76ebd8a-71df-4b68-8351-5fff9191968c-config-file\") pod \"limitador-limitador-54d6d988d5-hnkcp\" (UID: \"a76ebd8a-71df-4b68-8351-5fff9191968c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:39:59.074933 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.074910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfckz\" (UniqueName: \"kubernetes.io/projected/a76ebd8a-71df-4b68-8351-5fff9191968c-kube-api-access-pfckz\") pod \"limitador-limitador-54d6d988d5-hnkcp\" (UID: \"a76ebd8a-71df-4b68-8351-5fff9191968c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:39:59.160494 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.160401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:39:59.319317 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.319287    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:39:59.320954 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:39:59.320931    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76ebd8a_71df_4b68_8351_5fff9191968c.slice/crio-3ea6ceebb7efc2089669e3e1f61ec826c1eb78498d307ff7c1a2514979b0a0fe WatchSource:0}: Error finding container 3ea6ceebb7efc2089669e3e1f61ec826c1eb78498d307ff7c1a2514979b0a0fe: Status 404 returned error can't find the container with id 3ea6ceebb7efc2089669e3e1f61ec826c1eb78498d307ff7c1a2514979b0a0fe
Jul 27 18:39:59.687072 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.687032    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5pszj"]
Jul 27 18:39:59.690486 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.690467    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5pszj"
Jul 27 18:39:59.697767 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.697729    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lxnsr\""
Jul 27 18:39:59.701179 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.701157    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5pszj"]
Jul 27 18:39:59.770820 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.770768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn669\" (UniqueName: \"kubernetes.io/projected/94990e79-728b-4543-a15e-0ed2cb7defa8-kube-api-access-gn669\") pod \"authorino-75d556bd77-5pszj\" (UID: \"94990e79-728b-4543-a15e-0ed2cb7defa8\") " pod="kuadrant-system/authorino-75d556bd77-5pszj"
Jul 27 18:39:59.871678 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.871647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn669\" (UniqueName: \"kubernetes.io/projected/94990e79-728b-4543-a15e-0ed2cb7defa8-kube-api-access-gn669\") pod \"authorino-75d556bd77-5pszj\" (UID: \"94990e79-728b-4543-a15e-0ed2cb7defa8\") " pod="kuadrant-system/authorino-75d556bd77-5pszj"
Jul 27 18:39:59.886401 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:39:59.886339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn669\" (UniqueName: \"kubernetes.io/projected/94990e79-728b-4543-a15e-0ed2cb7defa8-kube-api-access-gn669\") pod \"authorino-75d556bd77-5pszj\" (UID: \"94990e79-728b-4543-a15e-0ed2cb7defa8\") " pod="kuadrant-system/authorino-75d556bd77-5pszj"
Jul 27 18:40:00.002702 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:00.002621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5pszj"
Jul 27 18:40:00.035242 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:00.035170    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp" event={"ID":"a76ebd8a-71df-4b68-8351-5fff9191968c","Type":"ContainerStarted","Data":"3ea6ceebb7efc2089669e3e1f61ec826c1eb78498d307ff7c1a2514979b0a0fe"}
Jul 27 18:40:00.209901 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:00.209455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5pszj"]
Jul 27 18:40:00.214326 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:40:00.213922    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94990e79_728b_4543_a15e_0ed2cb7defa8.slice/crio-045be4f056b8a8cb5a60f9ec142a2f53fc6b541f6fc3f03c9d00c27a84e6ee15 WatchSource:0}: Error finding container 045be4f056b8a8cb5a60f9ec142a2f53fc6b541f6fc3f03c9d00c27a84e6ee15: Status 404 returned error can't find the container with id 045be4f056b8a8cb5a60f9ec142a2f53fc6b541f6fc3f03c9d00c27a84e6ee15
Jul 27 18:40:01.043103 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:01.043069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5pszj" event={"ID":"94990e79-728b-4543-a15e-0ed2cb7defa8","Type":"ContainerStarted","Data":"045be4f056b8a8cb5a60f9ec142a2f53fc6b541f6fc3f03c9d00c27a84e6ee15"}
Jul 27 18:40:03.060485 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:03.060450    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp" event={"ID":"a76ebd8a-71df-4b68-8351-5fff9191968c","Type":"ContainerStarted","Data":"1543ca283a56df2bd275c60ca26158cce10bf7178d8cd7a28ab51258d6851be9"}
Jul 27 18:40:03.060931 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:03.060618    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:40:03.081671 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:03.081620    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp" podStartSLOduration=2.346180094 podStartE2EDuration="5.081604706s" totalImagesPullingTime="2.735424612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:40:03.079242547 +0000 UTC m=+501.162525412" watchObservedRunningTime="2026-07-27 18:40:03.081604706 +0000 UTC m=+501.164887572"
Jul 27 18:40:05.074816 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:05.074778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5pszj" event={"ID":"94990e79-728b-4543-a15e-0ed2cb7defa8","Type":"ContainerStarted","Data":"17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41"}
Jul 27 18:40:05.097296 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:05.097239    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5pszj" podStartSLOduration=2.125145769 podStartE2EDuration="6.097221393s" totalImagesPullingTime="3.972075624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:40:05.093979428 +0000 UTC m=+503.177262280" watchObservedRunningTime="2026-07-27 18:40:05.097221393 +0000 UTC m=+503.180504243"
Jul 27 18:40:14.069518 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:14.069479    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"
Jul 27 18:40:38.218973 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:38.218883    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5pszj"]
Jul 27 18:40:38.219371 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:38.219105    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5pszj" podUID="94990e79-728b-4543-a15e-0ed2cb7defa8" containerName="authorino" containerID="cri-o://17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41" gracePeriod=30
Jul 27 18:40:38.474037 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:38.473977    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5pszj"
Jul 27 18:40:38.524054 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:38.524014    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn669\" (UniqueName: \"kubernetes.io/projected/94990e79-728b-4543-a15e-0ed2cb7defa8-kube-api-access-gn669\") pod \"94990e79-728b-4543-a15e-0ed2cb7defa8\" (UID: \"94990e79-728b-4543-a15e-0ed2cb7defa8\") "
Jul 27 18:40:38.526304 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:38.526268    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94990e79-728b-4543-a15e-0ed2cb7defa8-kube-api-access-gn669" (OuterVolumeSpecName: "kube-api-access-gn669") pod "94990e79-728b-4543-a15e-0ed2cb7defa8" (UID: "94990e79-728b-4543-a15e-0ed2cb7defa8"). InnerVolumeSpecName "kube-api-access-gn669". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:40:38.625213 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:38.625178    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn669\" (UniqueName: \"kubernetes.io/projected/94990e79-728b-4543-a15e-0ed2cb7defa8-kube-api-access-gn669\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:40:39.271108 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.271075    2577 generic.go:356] "Generic (PLEG): container finished" podID="94990e79-728b-4543-a15e-0ed2cb7defa8" containerID="17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41" exitCode=0
Jul 27 18:40:39.271565 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.271122    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5pszj"
Jul 27 18:40:39.271565 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.271166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5pszj" event={"ID":"94990e79-728b-4543-a15e-0ed2cb7defa8","Type":"ContainerDied","Data":"17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41"}
Jul 27 18:40:39.271565 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.271206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5pszj" event={"ID":"94990e79-728b-4543-a15e-0ed2cb7defa8","Type":"ContainerDied","Data":"045be4f056b8a8cb5a60f9ec142a2f53fc6b541f6fc3f03c9d00c27a84e6ee15"}
Jul 27 18:40:39.271565 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.271222    2577 scope.go:117] "RemoveContainer" containerID="17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41"
Jul 27 18:40:39.280830 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.280810    2577 scope.go:117] "RemoveContainer" containerID="17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41"
Jul 27 18:40:39.281152 ip-10-0-131-150 kubenswrapper[2577]: E0727 18:40:39.281122    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41\": container with ID starting with 17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41 not found: ID does not exist" containerID="17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41"
Jul 27 18:40:39.281262 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.281150    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41"} err="failed to get container status \"17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41\": rpc error: code = NotFound desc = could not find container \"17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41\": container with ID starting with 17c576c501a806002236e0ee6d15ddd3ee0c67acd18d17c13f5828a7c5147f41 not found: ID does not exist"
Jul 27 18:40:39.306759 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.306726    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5pszj"]
Jul 27 18:40:39.321699 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:39.321670    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5pszj"]
Jul 27 18:40:40.510721 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:40:40.510688    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94990e79-728b-4543-a15e-0ed2cb7defa8" path="/var/lib/kubelet/pods/94990e79-728b-4543-a15e-0ed2cb7defa8/volumes"
Jul 27 18:41:23.618931 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:41:23.618896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:42:01.715717 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:42:01.715677    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:42:07.407333 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:42:07.407250    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:42:25.000758 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:42:25.000726    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:42:32.438539 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:42:32.438503    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:42:48.303638 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:42:48.303597    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:42:58.615368 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:42:58.615336    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:43:54.440130 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.440093    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f4fc4b65f-8fgcs"]
Jul 27 18:43:54.440799 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.440778    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94990e79-728b-4543-a15e-0ed2cb7defa8" containerName="authorino"
Jul 27 18:43:54.440845 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.440805    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="94990e79-728b-4543-a15e-0ed2cb7defa8" containerName="authorino"
Jul 27 18:43:54.440908 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.440898    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="94990e79-728b-4543-a15e-0ed2cb7defa8" containerName="authorino"
Jul 27 18:43:54.444277 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.444261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs"
Jul 27 18:43:54.448580 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.448558    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 18:43:54.448702 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.448599    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lxnsr\""
Jul 27 18:43:54.454795 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.454770    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f4fc4b65f-8fgcs"]
Jul 27 18:43:54.494702 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.494670    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb7r9\" (UniqueName: \"kubernetes.io/projected/1dc1439b-2a69-4d1d-a567-c40678a1df6f-kube-api-access-gb7r9\") pod \"authorino-5f4fc4b65f-8fgcs\" (UID: \"1dc1439b-2a69-4d1d-a567-c40678a1df6f\") " pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs"
Jul 27 18:43:54.494870 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.494731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dc1439b-2a69-4d1d-a567-c40678a1df6f-tls-cert\") pod \"authorino-5f4fc4b65f-8fgcs\" (UID: \"1dc1439b-2a69-4d1d-a567-c40678a1df6f\") " pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs"
Jul 27 18:43:54.595617 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.595582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb7r9\" (UniqueName: \"kubernetes.io/projected/1dc1439b-2a69-4d1d-a567-c40678a1df6f-kube-api-access-gb7r9\") pod \"authorino-5f4fc4b65f-8fgcs\" (UID: \"1dc1439b-2a69-4d1d-a567-c40678a1df6f\") " pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs"
Jul 27 18:43:54.595793 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.595638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dc1439b-2a69-4d1d-a567-c40678a1df6f-tls-cert\") pod \"authorino-5f4fc4b65f-8fgcs\" (UID: \"1dc1439b-2a69-4d1d-a567-c40678a1df6f\") " pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs"
Jul 27 18:43:54.598170 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.598153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dc1439b-2a69-4d1d-a567-c40678a1df6f-tls-cert\") pod \"authorino-5f4fc4b65f-8fgcs\" (UID: \"1dc1439b-2a69-4d1d-a567-c40678a1df6f\") " pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs"
Jul 27 18:43:54.613067 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.613039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb7r9\" (UniqueName: \"kubernetes.io/projected/1dc1439b-2a69-4d1d-a567-c40678a1df6f-kube-api-access-gb7r9\") pod \"authorino-5f4fc4b65f-8fgcs\" (UID: \"1dc1439b-2a69-4d1d-a567-c40678a1df6f\") " pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs"
Jul 27 18:43:54.754923 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.754851    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs"
Jul 27 18:43:54.911791 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.911758    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f4fc4b65f-8fgcs"]
Jul 27 18:43:54.914569 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:43:54.914537    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dc1439b_2a69_4d1d_a567_c40678a1df6f.slice/crio-c3bd211c593ab1347cfe711863223915e4ae300d3e0f19e8d9d2939ece612aad WatchSource:0}: Error finding container c3bd211c593ab1347cfe711863223915e4ae300d3e0f19e8d9d2939ece612aad: Status 404 returned error can't find the container with id c3bd211c593ab1347cfe711863223915e4ae300d3e0f19e8d9d2939ece612aad
Jul 27 18:43:54.915788 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:54.915759    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:43:55.380671 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:55.380645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs" event={"ID":"1dc1439b-2a69-4d1d-a567-c40678a1df6f","Type":"ContainerStarted","Data":"c3bd211c593ab1347cfe711863223915e4ae300d3e0f19e8d9d2939ece612aad"}
Jul 27 18:43:56.388902 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:56.388855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs" event={"ID":"1dc1439b-2a69-4d1d-a567-c40678a1df6f","Type":"ContainerStarted","Data":"6a4e4e021f6d46e220bdcc4f6665aa841f0bd597095a44bc91c6e0e58ed87214"}
Jul 27 18:43:56.406208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:43:56.406150    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f4fc4b65f-8fgcs" podStartSLOduration=1.961343139 podStartE2EDuration="2.406136625s" totalImagesPullingTime="444.793486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:43:56.404551315 +0000 UTC m=+734.487834168" watchObservedRunningTime="2026-07-27 18:43:56.406136625 +0000 UTC m=+734.489419476"
Jul 27 18:44:28.796065 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:44:28.796023    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:44:58.987364 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:44:58.987325    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:45:12.190373 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:45:12.190299    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:46:49.090117 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:46:49.090078    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:46:58.389724 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:46:58.389686    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:47:27.092145 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:47:27.092109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:47:36.688394 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:47:36.688361    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:47:45.594040 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:47:45.593994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:47:57.391904 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:47:57.391872    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:48:08.406242 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:48:08.406153    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:48:19.998894 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:48:19.998852    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:48:30.982140 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:48:30.982103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:48:40.997158 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:48:40.997115    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:49:03.291450 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:49:03.291403    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:49:15.304232 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:49:15.304197    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:49:39.835381 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:49:39.835296    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:49:51.020832 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:49:51.020799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:50:07.094799 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:50:07.094763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:50:17.215461 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:50:17.215412    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:50:26.895710 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:50:26.895674    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:50:36.703474 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:50:36.703435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:50:46.291680 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:50:46.291641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:51:11.478884 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:11.478799    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"]
Jul 27 18:51:11.479451 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:11.479055    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf" podUID="7dcc6434-eadb-406c-b8c4-892d2f83a8a2" containerName="manager" containerID="cri-o://24d91101a632ea9c366d1a62cf64adf287c52a73b2a1e27f8febb0da3408bc3f" gracePeriod=10
Jul 27 18:51:13.941857 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:13.941774    2577 generic.go:356] "Generic (PLEG): container finished" podID="7dcc6434-eadb-406c-b8c4-892d2f83a8a2" containerID="24d91101a632ea9c366d1a62cf64adf287c52a73b2a1e27f8febb0da3408bc3f" exitCode=0
Jul 27 18:51:13.942208 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:13.941850    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf" event={"ID":"7dcc6434-eadb-406c-b8c4-892d2f83a8a2","Type":"ContainerDied","Data":"24d91101a632ea9c366d1a62cf64adf287c52a73b2a1e27f8febb0da3408bc3f"}
Jul 27 18:51:14.241179 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.241154    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:51:14.275318 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.275286    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5zcz\" (UniqueName: \"kubernetes.io/projected/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-kube-api-access-b5zcz\") pod \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\" (UID: \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\") "
Jul 27 18:51:14.275521 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.275336    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-extensions-socket-volume\") pod \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\" (UID: \"7dcc6434-eadb-406c-b8c4-892d2f83a8a2\") "
Jul 27 18:51:14.275880 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.275846    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7dcc6434-eadb-406c-b8c4-892d2f83a8a2" (UID: "7dcc6434-eadb-406c-b8c4-892d2f83a8a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:51:14.277531 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.277494    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-kube-api-access-b5zcz" (OuterVolumeSpecName: "kube-api-access-b5zcz") pod "7dcc6434-eadb-406c-b8c4-892d2f83a8a2" (UID: "7dcc6434-eadb-406c-b8c4-892d2f83a8a2"). InnerVolumeSpecName "kube-api-access-b5zcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:51:14.376640 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.376607    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5zcz\" (UniqueName: \"kubernetes.io/projected/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-kube-api-access-b5zcz\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:51:14.376640 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.376633    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7dcc6434-eadb-406c-b8c4-892d2f83a8a2-extensions-socket-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 18:51:14.948271 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.948236    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"
Jul 27 18:51:14.948767 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.948236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf" event={"ID":"7dcc6434-eadb-406c-b8c4-892d2f83a8a2","Type":"ContainerDied","Data":"22b5b06d31570b2fdd4572d747d6dfe4d190721271e10bfc9711a5be65a84a7a"}
Jul 27 18:51:14.948767 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.948370    2577 scope.go:117] "RemoveContainer" containerID="24d91101a632ea9c366d1a62cf64adf287c52a73b2a1e27f8febb0da3408bc3f"
Jul 27 18:51:14.968047 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.968021    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"]
Jul 27 18:51:14.973535 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:14.973511    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m58sf"]
Jul 27 18:51:16.510661 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:51:16.510628    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dcc6434-eadb-406c-b8c4-892d2f83a8a2" path="/var/lib/kubelet/pods/7dcc6434-eadb-406c-b8c4-892d2f83a8a2/volumes"
Jul 27 18:52:12.555075 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.555039    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"]
Jul 27 18:52:12.555537 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.555474    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcc6434-eadb-406c-b8c4-892d2f83a8a2" containerName="manager"
Jul 27 18:52:12.555537 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.555487    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcc6434-eadb-406c-b8c4-892d2f83a8a2" containerName="manager"
Jul 27 18:52:12.555617 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.555549    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcc6434-eadb-406c-b8c4-892d2f83a8a2" containerName="manager"
Jul 27 18:52:12.558581 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.558566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:12.561706 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.561686    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zknkw\""
Jul 27 18:52:12.571413 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.571389    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"]
Jul 27 18:52:12.625209 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.625184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lkdl\" (UniqueName: \"kubernetes.io/projected/cc63d903-89e3-4e20-b65d-e9340fcc6634-kube-api-access-8lkdl\") pod \"kuadrant-operator-controller-manager-86878c769f-q2vbw\" (UID: \"cc63d903-89e3-4e20-b65d-e9340fcc6634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:12.625384 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.625221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc63d903-89e3-4e20-b65d-e9340fcc6634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q2vbw\" (UID: \"cc63d903-89e3-4e20-b65d-e9340fcc6634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:12.725756 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.725730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lkdl\" (UniqueName: \"kubernetes.io/projected/cc63d903-89e3-4e20-b65d-e9340fcc6634-kube-api-access-8lkdl\") pod \"kuadrant-operator-controller-manager-86878c769f-q2vbw\" (UID: \"cc63d903-89e3-4e20-b65d-e9340fcc6634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:12.725931 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.725766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc63d903-89e3-4e20-b65d-e9340fcc6634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q2vbw\" (UID: \"cc63d903-89e3-4e20-b65d-e9340fcc6634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:12.726193 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.726174    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc63d903-89e3-4e20-b65d-e9340fcc6634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q2vbw\" (UID: \"cc63d903-89e3-4e20-b65d-e9340fcc6634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:12.735492 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.735467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lkdl\" (UniqueName: \"kubernetes.io/projected/cc63d903-89e3-4e20-b65d-e9340fcc6634-kube-api-access-8lkdl\") pod \"kuadrant-operator-controller-manager-86878c769f-q2vbw\" (UID: \"cc63d903-89e3-4e20-b65d-e9340fcc6634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:12.869615 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:12.869582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:13.018679 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:13.018657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"]
Jul 27 18:52:13.020036 ip-10-0-131-150 kubenswrapper[2577]: W0727 18:52:13.020005    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc63d903_89e3_4e20_b65d_e9340fcc6634.slice/crio-eff962c673b1b4a96df5b283a116d082a2cf237929bdc05987a744090b005aad WatchSource:0}: Error finding container eff962c673b1b4a96df5b283a116d082a2cf237929bdc05987a744090b005aad: Status 404 returned error can't find the container with id eff962c673b1b4a96df5b283a116d082a2cf237929bdc05987a744090b005aad
Jul 27 18:52:13.271047 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:13.270964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw" event={"ID":"cc63d903-89e3-4e20-b65d-e9340fcc6634","Type":"ContainerStarted","Data":"df85b15130aaff5704cbdc97cd11aa54a33512e59e507cfd22191a1bf5a9fb93"}
Jul 27 18:52:13.271047 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:13.271009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw" event={"ID":"cc63d903-89e3-4e20-b65d-e9340fcc6634","Type":"ContainerStarted","Data":"eff962c673b1b4a96df5b283a116d082a2cf237929bdc05987a744090b005aad"}
Jul 27 18:52:13.271257 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:13.271046    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:13.300692 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:13.300644    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw" podStartSLOduration=1.300630213 podStartE2EDuration="1.300630213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:52:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:52:13.29714415 +0000 UTC m=+1231.380427015" watchObservedRunningTime="2026-07-27 18:52:13.300630213 +0000 UTC m=+1231.383913064"
Jul 27 18:52:24.279113 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:24.279082    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2vbw"
Jul 27 18:52:33.594453 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:33.594358    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:52:45.988608 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:45.988563    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:52:56.884122 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:52:56.884082    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:53:08.998737 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:53:08.998701    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:53:20.802639 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:53:20.802600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:53:30.579536 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:53:30.579499    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:53:40.286236 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:53:40.286198    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:53:49.684658 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:53:49.684624    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:54:02.125781 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:54:02.125732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:54:10.579735 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:54:10.579691    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:54:21.380327 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:54:21.380290    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:54:45.681071 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:54:45.681039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:54:53.204363 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:54:53.204325    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:55:06.090218 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:55:06.090177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:55:35.490995 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:55:35.490894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:56:15.284170 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:56:15.284134    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:56:28.893520 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:56:28.893480    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:56:36.301124 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:56:36.301083    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:56:52.628919 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:56:52.628878    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:57:02.092942 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:57:02.092896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:57:11.487034 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:57:11.486997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:57:21.587863 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:57:21.587828    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:57:37.185239 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:57:37.185207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:57:44.890929 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:57:44.890892    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:57:55.092250 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:57:55.092214    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:58:09.392283 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:58:09.392245    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:58:18.980574 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:58:18.980537    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:58:28.386247 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:58:28.386206    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:58:40.581554 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:58:40.581479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:58:57.091538 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:58:57.091490    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:59:09.488441 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:59:09.488392    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:59:23.085620 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:59:23.085583    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:59:36.977456 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:59:36.977407    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:59:46.376373 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:59:46.376336    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 18:59:56.491231 ip-10-0-131-150 kubenswrapper[2577]: I0727 18:59:56.491198    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:00:00.262193 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.262157    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"]
Jul 27 19:00:00.266228 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.266211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:00.269036 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.269010    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-165a5b4f\""
Jul 27 19:00:00.277786 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.277763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"]
Jul 27 19:00:00.296124 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.296091    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"]
Jul 27 19:00:00.299741 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.299713    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:00.302507 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.302485    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-165a5b4f-dockercfg-b6ndt\""
Jul 27 19:00:00.309243 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.309218    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"]
Jul 27 19:00:00.325013 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.324979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nfpf\" (UniqueName: \"kubernetes.io/projected/553a456c-bf9d-4dfd-bf83-030c9ac64afd-kube-api-access-9nfpf\") pod \"payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd\" (UID: \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:00.325193 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.325163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/553a456c-bf9d-4dfd-bf83-030c9ac64afd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd\" (UID: \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:00.425977 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.425936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nfpf\" (UniqueName: \"kubernetes.io/projected/553a456c-bf9d-4dfd-bf83-030c9ac64afd-kube-api-access-9nfpf\") pod \"payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd\" (UID: \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:00.426172 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.426041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhr8d\" (UniqueName: \"kubernetes.io/projected/b270ba84-8e1f-4bb9-b190-d24ee5117b24-kube-api-access-bhr8d\") pod \"payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf\" (UID: \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\") " pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:00.426172 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.426090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b270ba84-8e1f-4bb9-b190-d24ee5117b24-plugins-config-volume\") pod \"payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf\" (UID: \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\") " pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:00.426172 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.426137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/553a456c-bf9d-4dfd-bf83-030c9ac64afd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd\" (UID: \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:00.427209 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.427159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/553a456c-bf9d-4dfd-bf83-030c9ac64afd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd\" (UID: \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:00.434947 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.434916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nfpf\" (UniqueName: \"kubernetes.io/projected/553a456c-bf9d-4dfd-bf83-030c9ac64afd-kube-api-access-9nfpf\") pod \"payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd\" (UID: \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:00.527110 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.526998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhr8d\" (UniqueName: \"kubernetes.io/projected/b270ba84-8e1f-4bb9-b190-d24ee5117b24-kube-api-access-bhr8d\") pod \"payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf\" (UID: \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\") " pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:00.527110 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.527061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b270ba84-8e1f-4bb9-b190-d24ee5117b24-plugins-config-volume\") pod \"payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf\" (UID: \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\") " pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:00.528007 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.527980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b270ba84-8e1f-4bb9-b190-d24ee5117b24-plugins-config-volume\") pod \"payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf\" (UID: \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\") " pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:00.535536 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.535511    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhr8d\" (UniqueName: \"kubernetes.io/projected/b270ba84-8e1f-4bb9-b190-d24ee5117b24-kube-api-access-bhr8d\") pod \"payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf\" (UID: \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\") " pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:00.577309 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.577261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:00.611167 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.611133    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:00.773370 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.773342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"]
Jul 27 19:00:00.774026 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:00:00.774001    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb270ba84_8e1f_4bb9_b190_d24ee5117b24.slice/crio-c8c63fee0e4927e4f217c922c4b14d59621b1185baa5c1b41e872e0057a5470a WatchSource:0}: Error finding container c8c63fee0e4927e4f217c922c4b14d59621b1185baa5c1b41e872e0057a5470a: Status 404 returned error can't find the container with id c8c63fee0e4927e4f217c922c4b14d59621b1185baa5c1b41e872e0057a5470a
Jul 27 19:00:00.775778 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.775764    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:00:00.945304 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.945279    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"]
Jul 27 19:00:00.946295 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:00:00.946272    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553a456c_bf9d_4dfd_bf83_030c9ac64afd.slice/crio-3ed6201386a16c82785d0f8519a9f8248af0209213abec660424b961d7d994e8 WatchSource:0}: Error finding container 3ed6201386a16c82785d0f8519a9f8248af0209213abec660424b961d7d994e8: Status 404 returned error can't find the container with id 3ed6201386a16c82785d0f8519a9f8248af0209213abec660424b961d7d994e8
Jul 27 19:00:00.975952 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.975924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf" event={"ID":"b270ba84-8e1f-4bb9-b190-d24ee5117b24","Type":"ContainerStarted","Data":"c8c63fee0e4927e4f217c922c4b14d59621b1185baa5c1b41e872e0057a5470a"}
Jul 27 19:00:00.977054 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:00.977036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd" event={"ID":"553a456c-bf9d-4dfd-bf83-030c9ac64afd","Type":"ContainerStarted","Data":"3ed6201386a16c82785d0f8519a9f8248af0209213abec660424b961d7d994e8"}
Jul 27 19:00:04.002228 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:04.002185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd" event={"ID":"553a456c-bf9d-4dfd-bf83-030c9ac64afd","Type":"ContainerStarted","Data":"aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09"}
Jul 27 19:00:04.002748 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:04.002294    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:04.003822 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:04.003796    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf" event={"ID":"b270ba84-8e1f-4bb9-b190-d24ee5117b24","Type":"ContainerStarted","Data":"9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917"}
Jul 27 19:00:04.003955 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:04.003842    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:04.028287 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:04.028233    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd" podStartSLOduration=2.003393467 podStartE2EDuration="4.028213511s" totalImagesPullingTime="2.024820044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:04.027558786 +0000 UTC m=+1702.110841639" watchObservedRunningTime="2026-07-27 19:00:04.028213511 +0000 UTC m=+1702.111496363"
Jul 27 19:00:04.052790 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:04.052725    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf" podStartSLOduration=1.84930017 podStartE2EDuration="4.052703729s" totalImagesPullingTime="2.203403559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:04.048826172 +0000 UTC m=+1702.132109022" watchObservedRunningTime="2026-07-27 19:00:04.052703729 +0000 UTC m=+1702.135986583"
Jul 27 19:00:07.292862 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:07.292823    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:00:15.011944 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:15.011915    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:15.012345 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:15.011994    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:24.831016 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:24.830980    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"]
Jul 27 19:00:24.835715 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:24.835698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"
Jul 27 19:00:24.839312 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:24.839287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gwtlm\""
Jul 27 19:00:24.839691 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:24.839291    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:00:24.841809 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:24.841786    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"]
Jul 27 19:00:24.966392 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:24.966358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d95e04e-5d2d-4c7f-a20e-7e96d418bf34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-165a5b4f-x6666\" (UID: \"6d95e04e-5d2d-4c7f-a20e-7e96d418bf34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"
Jul 27 19:00:25.067216 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:25.067179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d95e04e-5d2d-4c7f-a20e-7e96d418bf34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-165a5b4f-x6666\" (UID: \"6d95e04e-5d2d-4c7f-a20e-7e96d418bf34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"
Jul 27 19:00:25.067821 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:25.067800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d95e04e-5d2d-4c7f-a20e-7e96d418bf34-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-165a5b4f-x6666\" (UID: \"6d95e04e-5d2d-4c7f-a20e-7e96d418bf34\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"
Jul 27 19:00:25.149238 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:25.149190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"
Jul 27 19:00:25.290487 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:25.290460    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"]
Jul 27 19:00:25.292692 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:00:25.292655    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d95e04e_5d2d_4c7f_a20e_7e96d418bf34.slice/crio-1fbf50588046be641b8480325879095ff09cf5ca130a97e5e9960272ab80eb2f WatchSource:0}: Error finding container 1fbf50588046be641b8480325879095ff09cf5ca130a97e5e9960272ab80eb2f: Status 404 returned error can't find the container with id 1fbf50588046be641b8480325879095ff09cf5ca130a97e5e9960272ab80eb2f
Jul 27 19:00:26.135801 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:26.135765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666" event={"ID":"6d95e04e-5d2d-4c7f-a20e-7e96d418bf34","Type":"ContainerStarted","Data":"1fbf50588046be641b8480325879095ff09cf5ca130a97e5e9960272ab80eb2f"}
Jul 27 19:00:29.157745 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:29.157705    2577 generic.go:356] "Generic (PLEG): container finished" podID="6d95e04e-5d2d-4c7f-a20e-7e96d418bf34" containerID="55a0b0ca70d0e79080fe88e1cf70c347b97c9d7d7daab7d9f3eb8a2e7128dd05" exitCode=0
Jul 27 19:00:29.158139 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:29.157792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666" event={"ID":"6d95e04e-5d2d-4c7f-a20e-7e96d418bf34","Type":"ContainerDied","Data":"55a0b0ca70d0e79080fe88e1cf70c347b97c9d7d7daab7d9f3eb8a2e7128dd05"}
Jul 27 19:00:30.299329 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:30.299308    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"
Jul 27 19:00:30.306451 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:30.306410    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d95e04e-5d2d-4c7f-a20e-7e96d418bf34-maas-api-service-ca\") pod \"6d95e04e-5d2d-4c7f-a20e-7e96d418bf34\" (UID: \"6d95e04e-5d2d-4c7f-a20e-7e96d418bf34\") "
Jul 27 19:00:30.306723 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:30.306703    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d95e04e-5d2d-4c7f-a20e-7e96d418bf34-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d95e04e-5d2d-4c7f-a20e-7e96d418bf34" (UID: "6d95e04e-5d2d-4c7f-a20e-7e96d418bf34"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:30.407705 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:30.407669    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d95e04e-5d2d-4c7f-a20e-7e96d418bf34-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:00:31.170519 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:31.170478    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"
Jul 27 19:00:31.170693 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:31.170478    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666" event={"ID":"6d95e04e-5d2d-4c7f-a20e-7e96d418bf34","Type":"ContainerDied","Data":"1fbf50588046be641b8480325879095ff09cf5ca130a97e5e9960272ab80eb2f"}
Jul 27 19:00:31.170693 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:31.170611    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fbf50588046be641b8480325879095ff09cf5ca130a97e5e9960272ab80eb2f"
Jul 27 19:00:35.299281 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.299232    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"]
Jul 27 19:00:35.299899 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.299504    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf" podUID="b270ba84-8e1f-4bb9-b190-d24ee5117b24" containerName="payload-processing" containerID="cri-o://9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917" gracePeriod=30
Jul 27 19:00:35.306092 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.306061    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"]
Jul 27 19:00:35.306332 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.306297    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd" podUID="553a456c-bf9d-4dfd-bf83-030c9ac64afd" containerName="payload-pre-processing" containerID="cri-o://aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09" gracePeriod=30
Jul 27 19:00:35.565613 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.565548    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:35.596412 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.596388    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:35.659348 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.659319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhr8d\" (UniqueName: \"kubernetes.io/projected/b270ba84-8e1f-4bb9-b190-d24ee5117b24-kube-api-access-bhr8d\") pod \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\" (UID: \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\") "
Jul 27 19:00:35.659348 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.659354    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/553a456c-bf9d-4dfd-bf83-030c9ac64afd-plugins-config-volume\") pod \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\" (UID: \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\") "
Jul 27 19:00:35.659579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.659406    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nfpf\" (UniqueName: \"kubernetes.io/projected/553a456c-bf9d-4dfd-bf83-030c9ac64afd-kube-api-access-9nfpf\") pod \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\" (UID: \"553a456c-bf9d-4dfd-bf83-030c9ac64afd\") "
Jul 27 19:00:35.659579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.659467    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b270ba84-8e1f-4bb9-b190-d24ee5117b24-plugins-config-volume\") pod \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\" (UID: \"b270ba84-8e1f-4bb9-b190-d24ee5117b24\") "
Jul 27 19:00:35.659870 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.659836    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/553a456c-bf9d-4dfd-bf83-030c9ac64afd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "553a456c-bf9d-4dfd-bf83-030c9ac64afd" (UID: "553a456c-bf9d-4dfd-bf83-030c9ac64afd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:35.659953 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.659871    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b270ba84-8e1f-4bb9-b190-d24ee5117b24-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b270ba84-8e1f-4bb9-b190-d24ee5117b24" (UID: "b270ba84-8e1f-4bb9-b190-d24ee5117b24"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:35.661654 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.661632    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/553a456c-bf9d-4dfd-bf83-030c9ac64afd-kube-api-access-9nfpf" (OuterVolumeSpecName: "kube-api-access-9nfpf") pod "553a456c-bf9d-4dfd-bf83-030c9ac64afd" (UID: "553a456c-bf9d-4dfd-bf83-030c9ac64afd"). InnerVolumeSpecName "kube-api-access-9nfpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:00:35.661716 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.661656    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b270ba84-8e1f-4bb9-b190-d24ee5117b24-kube-api-access-bhr8d" (OuterVolumeSpecName: "kube-api-access-bhr8d") pod "b270ba84-8e1f-4bb9-b190-d24ee5117b24" (UID: "b270ba84-8e1f-4bb9-b190-d24ee5117b24"). InnerVolumeSpecName "kube-api-access-bhr8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:00:35.760529 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.760492    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhr8d\" (UniqueName: \"kubernetes.io/projected/b270ba84-8e1f-4bb9-b190-d24ee5117b24-kube-api-access-bhr8d\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:00:35.760529 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.760524    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/553a456c-bf9d-4dfd-bf83-030c9ac64afd-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:00:35.760529 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.760533    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nfpf\" (UniqueName: \"kubernetes.io/projected/553a456c-bf9d-4dfd-bf83-030c9ac64afd-kube-api-access-9nfpf\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:00:35.760774 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:35.760543    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b270ba84-8e1f-4bb9-b190-d24ee5117b24-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:00:36.200178 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.200145    2577 generic.go:356] "Generic (PLEG): container finished" podID="553a456c-bf9d-4dfd-bf83-030c9ac64afd" containerID="aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09" exitCode=0
Jul 27 19:00:36.200361 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.200185    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"
Jul 27 19:00:36.200361 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.200231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd" event={"ID":"553a456c-bf9d-4dfd-bf83-030c9ac64afd","Type":"ContainerDied","Data":"aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09"}
Jul 27 19:00:36.200361 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.200297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd" event={"ID":"553a456c-bf9d-4dfd-bf83-030c9ac64afd","Type":"ContainerDied","Data":"3ed6201386a16c82785d0f8519a9f8248af0209213abec660424b961d7d994e8"}
Jul 27 19:00:36.200361 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.200331    2577 scope.go:117] "RemoveContainer" containerID="aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09"
Jul 27 19:00:36.201680 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.201660    2577 generic.go:356] "Generic (PLEG): container finished" podID="b270ba84-8e1f-4bb9-b190-d24ee5117b24" containerID="9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917" exitCode=0
Jul 27 19:00:36.201798 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.201703    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"
Jul 27 19:00:36.201798 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.201704    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf" event={"ID":"b270ba84-8e1f-4bb9-b190-d24ee5117b24","Type":"ContainerDied","Data":"9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917"}
Jul 27 19:00:36.201798 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.201755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf" event={"ID":"b270ba84-8e1f-4bb9-b190-d24ee5117b24","Type":"ContainerDied","Data":"c8c63fee0e4927e4f217c922c4b14d59621b1185baa5c1b41e872e0057a5470a"}
Jul 27 19:00:36.212851 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.212697    2577 scope.go:117] "RemoveContainer" containerID="aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09"
Jul 27 19:00:36.213141 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:00:36.213123    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09\": container with ID starting with aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09 not found: ID does not exist" containerID="aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09"
Jul 27 19:00:36.213220 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.213150    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09"} err="failed to get container status \"aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09\": rpc error: code = NotFound desc = could not find container \"aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09\": container with ID starting with aa22714d8df939fdcc47b3b8afcffbd24e8c5cbd0bf04e62d8d2de6614ac9b09 not found: ID does not exist"
Jul 27 19:00:36.213220 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.213173    2577 scope.go:117] "RemoveContainer" containerID="9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917"
Jul 27 19:00:36.223318 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.223306    2577 scope.go:117] "RemoveContainer" containerID="9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917"
Jul 27 19:00:36.223847 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:00:36.223826    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917\": container with ID starting with 9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917 not found: ID does not exist" containerID="9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917"
Jul 27 19:00:36.223950 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.223861    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917"} err="failed to get container status \"9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917\": rpc error: code = NotFound desc = could not find container \"9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917\": container with ID starting with 9e4f2535b78c2e18dd552478f46078d91a89933e7037d5bf3e187eacc79b1917 not found: ID does not exist"
Jul 27 19:00:36.243538 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.243508    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"]
Jul 27 19:00:36.254632 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.254607    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-165a5b4f-776df94544-kxbnf"]
Jul 27 19:00:36.277610 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.277583    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"]
Jul 27 19:00:36.287801 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.287775    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-165a5b4f-68998f968-xnjmd"]
Jul 27 19:00:36.511380 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.511300    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="553a456c-bf9d-4dfd-bf83-030c9ac64afd" path="/var/lib/kubelet/pods/553a456c-bf9d-4dfd-bf83-030c9ac64afd/volumes"
Jul 27 19:00:36.511751 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:36.511698    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b270ba84-8e1f-4bb9-b190-d24ee5117b24" path="/var/lib/kubelet/pods/b270ba84-8e1f-4bb9-b190-d24ee5117b24/volumes"
Jul 27 19:00:38.188505 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:38.188470    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:00:39.909417 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:39.909382    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"]
Jul 27 19:00:39.911651 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:39.911630    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-165a5b4f-x6666"]
Jul 27 19:00:40.512499 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:40.512458    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d95e04e-5d2d-4c7f-a20e-7e96d418bf34" path="/var/lib/kubelet/pods/6d95e04e-5d2d-4c7f-a20e-7e96d418bf34/volumes"
Jul 27 19:00:43.743018 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.742988    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"]
Jul 27 19:00:43.743523 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743507    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d95e04e-5d2d-4c7f-a20e-7e96d418bf34" containerName="revoke-keys"
Jul 27 19:00:43.743579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743524    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d95e04e-5d2d-4c7f-a20e-7e96d418bf34" containerName="revoke-keys"
Jul 27 19:00:43.743579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743537    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553a456c-bf9d-4dfd-bf83-030c9ac64afd" containerName="payload-pre-processing"
Jul 27 19:00:43.743579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743544    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="553a456c-bf9d-4dfd-bf83-030c9ac64afd" containerName="payload-pre-processing"
Jul 27 19:00:43.743579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743568    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b270ba84-8e1f-4bb9-b190-d24ee5117b24" containerName="payload-processing"
Jul 27 19:00:43.743579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743573    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b270ba84-8e1f-4bb9-b190-d24ee5117b24" containerName="payload-processing"
Jul 27 19:00:43.743737 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743631    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b270ba84-8e1f-4bb9-b190-d24ee5117b24" containerName="payload-processing"
Jul 27 19:00:43.743737 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743640    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="553a456c-bf9d-4dfd-bf83-030c9ac64afd" containerName="payload-pre-processing"
Jul 27 19:00:43.743737 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.743646    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d95e04e-5d2d-4c7f-a20e-7e96d418bf34" containerName="revoke-keys"
Jul 27 19:00:43.748105 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.748085    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:43.750765 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.750746    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:00:43.751836 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.751819    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-e045185e-serving-cert\""
Jul 27 19:00:43.751836 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.751828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5c8w7\""
Jul 27 19:00:43.752002 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.751951    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:00:43.759212 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.759193    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"]
Jul 27 19:00:43.829106 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.829072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7hzh\" (UniqueName: \"kubernetes.io/projected/99b640ed-867c-4543-abc0-e151cd08407f-kube-api-access-p7hzh\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:43.829106 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.829107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:43.829306 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.829130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99b640ed-867c-4543-abc0-e151cd08407f-openshift-service-ca\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:43.930087 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.930044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7hzh\" (UniqueName: \"kubernetes.io/projected/99b640ed-867c-4543-abc0-e151cd08407f-kube-api-access-p7hzh\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:43.930087 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.930090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:43.930322 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.930115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99b640ed-867c-4543-abc0-e151cd08407f-openshift-service-ca\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:43.930322 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:00:43.930233    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-serving-cert: secret "maas-api-e2e-migrate-e045185e-serving-cert" not found
Jul 27 19:00:43.930418 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:00:43.930333    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls podName:99b640ed-867c-4543-abc0-e151cd08407f nodeName:}" failed. No retries permitted until 2026-07-27 19:00:44.430311774 +0000 UTC m=+1742.513594622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls") pod "maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6" (UID: "99b640ed-867c-4543-abc0-e151cd08407f") : secret "maas-api-e2e-migrate-e045185e-serving-cert" not found
Jul 27 19:00:43.930997 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.930975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99b640ed-867c-4543-abc0-e151cd08407f-openshift-service-ca\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:43.946080 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:43.946049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7hzh\" (UniqueName: \"kubernetes.io/projected/99b640ed-867c-4543-abc0-e151cd08407f-kube-api-access-p7hzh\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:44.436068 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.436035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:44.438957 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.438934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls\") pod \"maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:44.631492 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.631453    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"]
Jul 27 19:00:44.635252 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.635214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:44.638774 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.638754    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-e045185e\""
Jul 27 19:00:44.639527 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.639509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-e045185e-dockercfg-6jzjn\""
Jul 27 19:00:44.648770 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.648749    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"]
Jul 27 19:00:44.659276 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.659251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:44.738959 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.738931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4c74632-3927-4571-ae0e-05baab35230b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5\" (UID: \"f4c74632-3927-4571-ae0e-05baab35230b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:44.739124 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.738983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld8r7\" (UniqueName: \"kubernetes.io/projected/f4c74632-3927-4571-ae0e-05baab35230b-kube-api-access-ld8r7\") pod \"payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5\" (UID: \"f4c74632-3927-4571-ae0e-05baab35230b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:44.807368 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.807338    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"]
Jul 27 19:00:44.808597 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:00:44.808573    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b640ed_867c_4543_abc0_e151cd08407f.slice/crio-7e2c0f1209dcb4dfa2a895a4837deeb7a044b564aff82f192caaca3a7d1ad2da WatchSource:0}: Error finding container 7e2c0f1209dcb4dfa2a895a4837deeb7a044b564aff82f192caaca3a7d1ad2da: Status 404 returned error can't find the container with id 7e2c0f1209dcb4dfa2a895a4837deeb7a044b564aff82f192caaca3a7d1ad2da
Jul 27 19:00:44.840529 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.840498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4c74632-3927-4571-ae0e-05baab35230b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5\" (UID: \"f4c74632-3927-4571-ae0e-05baab35230b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:44.840665 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.840549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld8r7\" (UniqueName: \"kubernetes.io/projected/f4c74632-3927-4571-ae0e-05baab35230b-kube-api-access-ld8r7\") pod \"payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5\" (UID: \"f4c74632-3927-4571-ae0e-05baab35230b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:44.841185 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.841168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4c74632-3927-4571-ae0e-05baab35230b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5\" (UID: \"f4c74632-3927-4571-ae0e-05baab35230b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:44.849332 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.849306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld8r7\" (UniqueName: \"kubernetes.io/projected/f4c74632-3927-4571-ae0e-05baab35230b-kube-api-access-ld8r7\") pod \"payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5\" (UID: \"f4c74632-3927-4571-ae0e-05baab35230b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:44.946535 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:44.946503    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:45.090651 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:45.090627    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"]
Jul 27 19:00:45.092545 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:00:45.092517    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c74632_3927_4571_ae0e_05baab35230b.slice/crio-d59ed5f31cec00792f9932581889aefb7e39427691312162a9c2dbed7b085668 WatchSource:0}: Error finding container d59ed5f31cec00792f9932581889aefb7e39427691312162a9c2dbed7b085668: Status 404 returned error can't find the container with id d59ed5f31cec00792f9932581889aefb7e39427691312162a9c2dbed7b085668
Jul 27 19:00:45.259244 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:45.259144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5" event={"ID":"f4c74632-3927-4571-ae0e-05baab35230b","Type":"ContainerStarted","Data":"b35bce256c6571304931eeb7fd3c433689babd032b67b6c7e00e46f9e7ab0e8a"}
Jul 27 19:00:45.259244 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:45.259204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5" event={"ID":"f4c74632-3927-4571-ae0e-05baab35230b","Type":"ContainerStarted","Data":"d59ed5f31cec00792f9932581889aefb7e39427691312162a9c2dbed7b085668"}
Jul 27 19:00:45.259244 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:45.259237    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:00:45.260379 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:45.260355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6" event={"ID":"99b640ed-867c-4543-abc0-e151cd08407f","Type":"ContainerStarted","Data":"7e2c0f1209dcb4dfa2a895a4837deeb7a044b564aff82f192caaca3a7d1ad2da"}
Jul 27 19:00:45.285362 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:45.285310    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5" podStartSLOduration=1.28529304 podStartE2EDuration="1.28529304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:45.283745466 +0000 UTC m=+1743.367028317" watchObservedRunningTime="2026-07-27 19:00:45.28529304 +0000 UTC m=+1743.368575891"
Jul 27 19:00:48.281504 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:48.281467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6" event={"ID":"99b640ed-867c-4543-abc0-e151cd08407f","Type":"ContainerStarted","Data":"6b385addd601f75b9c82819e13fee88717e5cdc55ac053b535d9f35f559329dc"}
Jul 27 19:00:48.281939 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:48.281663    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:48.301459 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:48.301369    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6" podStartSLOduration=2.6691164450000002 podStartE2EDuration="5.301355768s" totalImagesPullingTime="2.632239323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:48.298532468 +0000 UTC m=+1746.381815319" watchObservedRunningTime="2026-07-27 19:00:48.301355768 +0000 UTC m=+1746.384638619"
Jul 27 19:00:51.686985 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:51.686948    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:00:54.298074 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:54.298047    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:00:56.270105 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:00:56.270071    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:01:19.255225 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.255190    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"]
Jul 27 19:01:19.255833 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.255470    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6" podUID="99b640ed-867c-4543-abc0-e151cd08407f" containerName="maas-api" containerID="cri-o://6b385addd601f75b9c82819e13fee88717e5cdc55ac053b535d9f35f559329dc" gracePeriod=30
Jul 27 19:01:19.293784 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.293749    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6" podUID="99b640ed-867c-4543-abc0-e151cd08407f" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.59:8443/health\": dial tcp 10.134.0.59:8443: connect: connection refused"
Jul 27 19:01:19.331728 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.331689    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"]
Jul 27 19:01:19.331973 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.331930    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5" podUID="f4c74632-3927-4571-ae0e-05baab35230b" containerName="payload-pre-processing" containerID="cri-o://b35bce256c6571304931eeb7fd3c433689babd032b67b6c7e00e46f9e7ab0e8a" gracePeriod=30
Jul 27 19:01:19.476314 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.476278    2577 generic.go:356] "Generic (PLEG): container finished" podID="99b640ed-867c-4543-abc0-e151cd08407f" containerID="6b385addd601f75b9c82819e13fee88717e5cdc55ac053b535d9f35f559329dc" exitCode=0
Jul 27 19:01:19.476524 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.476346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6" event={"ID":"99b640ed-867c-4543-abc0-e151cd08407f","Type":"ContainerDied","Data":"6b385addd601f75b9c82819e13fee88717e5cdc55ac053b535d9f35f559329dc"}
Jul 27 19:01:19.478273 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.478248    2577 generic.go:356] "Generic (PLEG): container finished" podID="f4c74632-3927-4571-ae0e-05baab35230b" containerID="b35bce256c6571304931eeb7fd3c433689babd032b67b6c7e00e46f9e7ab0e8a" exitCode=0
Jul 27 19:01:19.478383 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.478318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5" event={"ID":"f4c74632-3927-4571-ae0e-05baab35230b","Type":"ContainerDied","Data":"b35bce256c6571304931eeb7fd3c433689babd032b67b6c7e00e46f9e7ab0e8a"}
Jul 27 19:01:19.583271 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.583246    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:01:19.616682 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.616661    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:01:19.765985 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.765954    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7hzh\" (UniqueName: \"kubernetes.io/projected/99b640ed-867c-4543-abc0-e151cd08407f-kube-api-access-p7hzh\") pod \"99b640ed-867c-4543-abc0-e151cd08407f\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") "
Jul 27 19:01:19.765985 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.765987    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls\") pod \"99b640ed-867c-4543-abc0-e151cd08407f\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") "
Jul 27 19:01:19.766203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.766027    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld8r7\" (UniqueName: \"kubernetes.io/projected/f4c74632-3927-4571-ae0e-05baab35230b-kube-api-access-ld8r7\") pod \"f4c74632-3927-4571-ae0e-05baab35230b\" (UID: \"f4c74632-3927-4571-ae0e-05baab35230b\") "
Jul 27 19:01:19.766203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.766050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99b640ed-867c-4543-abc0-e151cd08407f-openshift-service-ca\") pod \"99b640ed-867c-4543-abc0-e151cd08407f\" (UID: \"99b640ed-867c-4543-abc0-e151cd08407f\") "
Jul 27 19:01:19.766203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.766065    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4c74632-3927-4571-ae0e-05baab35230b-plugins-config-volume\") pod \"f4c74632-3927-4571-ae0e-05baab35230b\" (UID: \"f4c74632-3927-4571-ae0e-05baab35230b\") "
Jul 27 19:01:19.766507 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.766479    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99b640ed-867c-4543-abc0-e151cd08407f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99b640ed-867c-4543-abc0-e151cd08407f" (UID: "99b640ed-867c-4543-abc0-e151cd08407f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:01:19.766616 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.766587    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c74632-3927-4571-ae0e-05baab35230b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f4c74632-3927-4571-ae0e-05baab35230b" (UID: "f4c74632-3927-4571-ae0e-05baab35230b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:01:19.768468 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.768415    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99b640ed-867c-4543-abc0-e151cd08407f" (UID: "99b640ed-867c-4543-abc0-e151cd08407f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:01:19.768768 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.768740    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c74632-3927-4571-ae0e-05baab35230b-kube-api-access-ld8r7" (OuterVolumeSpecName: "kube-api-access-ld8r7") pod "f4c74632-3927-4571-ae0e-05baab35230b" (UID: "f4c74632-3927-4571-ae0e-05baab35230b"). InnerVolumeSpecName "kube-api-access-ld8r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:01:19.768768 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.768752    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b640ed-867c-4543-abc0-e151cd08407f-kube-api-access-p7hzh" (OuterVolumeSpecName: "kube-api-access-p7hzh") pod "99b640ed-867c-4543-abc0-e151cd08407f" (UID: "99b640ed-867c-4543-abc0-e151cd08407f"). InnerVolumeSpecName "kube-api-access-p7hzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:01:19.867064 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.867036    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7hzh\" (UniqueName: \"kubernetes.io/projected/99b640ed-867c-4543-abc0-e151cd08407f-kube-api-access-p7hzh\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:01:19.867064 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.867062    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99b640ed-867c-4543-abc0-e151cd08407f-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:01:19.867251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.867071    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld8r7\" (UniqueName: \"kubernetes.io/projected/f4c74632-3927-4571-ae0e-05baab35230b-kube-api-access-ld8r7\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:01:19.867251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.867082    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99b640ed-867c-4543-abc0-e151cd08407f-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:01:19.867251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:19.867093    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4c74632-3927-4571-ae0e-05baab35230b-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:01:20.485821 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.485794    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"
Jul 27 19:01:20.486228 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.485838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6" event={"ID":"99b640ed-867c-4543-abc0-e151cd08407f","Type":"ContainerDied","Data":"7e2c0f1209dcb4dfa2a895a4837deeb7a044b564aff82f192caaca3a7d1ad2da"}
Jul 27 19:01:20.486228 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.485901    2577 scope.go:117] "RemoveContainer" containerID="6b385addd601f75b9c82819e13fee88717e5cdc55ac053b535d9f35f559329dc"
Jul 27 19:01:20.487250 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.487235    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"
Jul 27 19:01:20.487333 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.487261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5" event={"ID":"f4c74632-3927-4571-ae0e-05baab35230b","Type":"ContainerDied","Data":"d59ed5f31cec00792f9932581889aefb7e39427691312162a9c2dbed7b085668"}
Jul 27 19:01:20.496946 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.496927    2577 scope.go:117] "RemoveContainer" containerID="b35bce256c6571304931eeb7fd3c433689babd032b67b6c7e00e46f9e7ab0e8a"
Jul 27 19:01:20.511496 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.511475    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"]
Jul 27 19:01:20.515618 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.515594    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e045185e-8554bdcf8f-q4mz6"]
Jul 27 19:01:20.525599 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.525547    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"]
Jul 27 19:01:20.529600 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:20.529580    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e045185e-d6cdcfc4d-x9mw5"]
Jul 27 19:01:22.480290 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:22.480258    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:01:22.514388 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:22.514351    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99b640ed-867c-4543-abc0-e151cd08407f" path="/var/lib/kubelet/pods/99b640ed-867c-4543-abc0-e151cd08407f/volumes"
Jul 27 19:01:22.514753 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:22.514738    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c74632-3927-4571-ae0e-05baab35230b" path="/var/lib/kubelet/pods/f4c74632-3927-4571-ae0e-05baab35230b/volumes"
Jul 27 19:01:26.953874 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.953844    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"]
Jul 27 19:01:26.954283 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.954269    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c74632-3927-4571-ae0e-05baab35230b" containerName="payload-pre-processing"
Jul 27 19:01:26.954283 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.954284    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c74632-3927-4571-ae0e-05baab35230b" containerName="payload-pre-processing"
Jul 27 19:01:26.954376 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.954296    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b640ed-867c-4543-abc0-e151cd08407f" containerName="maas-api"
Jul 27 19:01:26.954376 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.954302    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b640ed-867c-4543-abc0-e151cd08407f" containerName="maas-api"
Jul 27 19:01:26.954485 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.954377    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b640ed-867c-4543-abc0-e151cd08407f" containerName="maas-api"
Jul 27 19:01:26.954485 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.954389    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c74632-3927-4571-ae0e-05baab35230b" containerName="payload-pre-processing"
Jul 27 19:01:26.958962 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.958943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:26.961563 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.961541    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-cf4c6eb2-serving-cert\""
Jul 27 19:01:26.961694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.961597    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:01:26.962653 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.962631    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5c8w7\""
Jul 27 19:01:26.962653 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.962634    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:01:26.969171 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:26.969026    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"]
Jul 27 19:01:27.023568 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.023532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzvvd\" (UniqueName: \"kubernetes.io/projected/29c60615-ee43-4f7c-bf4f-256a7739c49a-kube-api-access-qzvvd\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.023753 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.023621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29c60615-ee43-4f7c-bf4f-256a7739c49a-openshift-service-ca\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.023753 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.023674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.124262 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.124226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.124471 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.124280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzvvd\" (UniqueName: \"kubernetes.io/projected/29c60615-ee43-4f7c-bf4f-256a7739c49a-kube-api-access-qzvvd\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.124471 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.124358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29c60615-ee43-4f7c-bf4f-256a7739c49a-openshift-service-ca\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.124471 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:01:27.124395    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-serving-cert: secret "maas-api-e2e-ait-cf4c6eb2-serving-cert" not found
Jul 27 19:01:27.124649 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:01:27.124497    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls podName:29c60615-ee43-4f7c-bf4f-256a7739c49a nodeName:}" failed. No retries permitted until 2026-07-27 19:01:27.624476034 +0000 UTC m=+1785.707758867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls") pod "maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g" (UID: "29c60615-ee43-4f7c-bf4f-256a7739c49a") : secret "maas-api-e2e-ait-cf4c6eb2-serving-cert" not found
Jul 27 19:01:27.125002 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.124984    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29c60615-ee43-4f7c-bf4f-256a7739c49a-openshift-service-ca\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.134594 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.134565    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzvvd\" (UniqueName: \"kubernetes.io/projected/29c60615-ee43-4f7c-bf4f-256a7739c49a-kube-api-access-qzvvd\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.630281 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.630239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.633152 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.633117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls\") pod \"maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.725048 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.725016    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"]
Jul 27 19:01:27.728846 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.728824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:27.730779 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.730756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca98953d-c831-4b33-8090-e0a21adbaf45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw\" (UID: \"ca98953d-c831-4b33-8090-e0a21adbaf45\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:27.730872 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.730798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtm4d\" (UniqueName: \"kubernetes.io/projected/ca98953d-c831-4b33-8090-e0a21adbaf45-kube-api-access-dtm4d\") pod \"payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw\" (UID: \"ca98953d-c831-4b33-8090-e0a21adbaf45\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:27.731498 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.731481    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-cf4c6eb2\""
Jul 27 19:01:27.731575 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.731525    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-cf4c6eb2-dockercfg-8blcl\""
Jul 27 19:01:27.739788 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.739766    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"]
Jul 27 19:01:27.752331 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.752302    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"]
Jul 27 19:01:27.756233 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.756208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:27.768672 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.768648    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"]
Jul 27 19:01:27.831906 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.831875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c10ef747-2f7b-4a0d-b838-12b86ed69780-plugins-config-volume\") pod \"payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg\" (UID: \"c10ef747-2f7b-4a0d-b838-12b86ed69780\") " pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:27.832084 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.831940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca98953d-c831-4b33-8090-e0a21adbaf45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw\" (UID: \"ca98953d-c831-4b33-8090-e0a21adbaf45\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:27.832084 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.832038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtm4d\" (UniqueName: \"kubernetes.io/projected/ca98953d-c831-4b33-8090-e0a21adbaf45-kube-api-access-dtm4d\") pod \"payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw\" (UID: \"ca98953d-c831-4b33-8090-e0a21adbaf45\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:27.832165 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.832101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c877d\" (UniqueName: \"kubernetes.io/projected/c10ef747-2f7b-4a0d-b838-12b86ed69780-kube-api-access-c877d\") pod \"payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg\" (UID: \"c10ef747-2f7b-4a0d-b838-12b86ed69780\") " pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:27.832683 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.832664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca98953d-c831-4b33-8090-e0a21adbaf45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw\" (UID: \"ca98953d-c831-4b33-8090-e0a21adbaf45\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:27.840869 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.840843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtm4d\" (UniqueName: \"kubernetes.io/projected/ca98953d-c831-4b33-8090-e0a21adbaf45-kube-api-access-dtm4d\") pod \"payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw\" (UID: \"ca98953d-c831-4b33-8090-e0a21adbaf45\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:27.870699 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.870665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:27.933019 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.932984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c877d\" (UniqueName: \"kubernetes.io/projected/c10ef747-2f7b-4a0d-b838-12b86ed69780-kube-api-access-c877d\") pod \"payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg\" (UID: \"c10ef747-2f7b-4a0d-b838-12b86ed69780\") " pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:27.934858 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.933852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c10ef747-2f7b-4a0d-b838-12b86ed69780-plugins-config-volume\") pod \"payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg\" (UID: \"c10ef747-2f7b-4a0d-b838-12b86ed69780\") " pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:27.935073 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.934886    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c10ef747-2f7b-4a0d-b838-12b86ed69780-plugins-config-volume\") pod \"payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg\" (UID: \"c10ef747-2f7b-4a0d-b838-12b86ed69780\") " pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:27.942867 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:27.942843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c877d\" (UniqueName: \"kubernetes.io/projected/c10ef747-2f7b-4a0d-b838-12b86ed69780-kube-api-access-c877d\") pod \"payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg\" (UID: \"c10ef747-2f7b-4a0d-b838-12b86ed69780\") " pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:28.029138 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.028972    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"]
Jul 27 19:01:28.032564 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:01:28.032533    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c60615_ee43_4f7c_bf4f_256a7739c49a.slice/crio-d34d87f529c0aad86e5c5352ccf1b0351caf6f4980a6933fe05d2a21eb4f4525 WatchSource:0}: Error finding container d34d87f529c0aad86e5c5352ccf1b0351caf6f4980a6933fe05d2a21eb4f4525: Status 404 returned error can't find the container with id d34d87f529c0aad86e5c5352ccf1b0351caf6f4980a6933fe05d2a21eb4f4525
Jul 27 19:01:28.041599 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.041575    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:28.066661 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.066639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:28.201977 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.201949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"]
Jul 27 19:01:28.204705 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:01:28.204637    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca98953d_c831_4b33_8090_e0a21adbaf45.slice/crio-2f17b22570213f4b4a8557c64136a68b91ca08b794ad0062efb73bc05ab41011 WatchSource:0}: Error finding container 2f17b22570213f4b4a8557c64136a68b91ca08b794ad0062efb73bc05ab41011: Status 404 returned error can't find the container with id 2f17b22570213f4b4a8557c64136a68b91ca08b794ad0062efb73bc05ab41011
Jul 27 19:01:28.228576 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.227891    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"]
Jul 27 19:01:28.231536 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:01:28.231513    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10ef747_2f7b_4a0d_b838_12b86ed69780.slice/crio-d2cdda32d8920b1c5f5d5a437d3968c53b8d9c64eb7220714807103963c2bcfe WatchSource:0}: Error finding container d2cdda32d8920b1c5f5d5a437d3968c53b8d9c64eb7220714807103963c2bcfe: Status 404 returned error can't find the container with id d2cdda32d8920b1c5f5d5a437d3968c53b8d9c64eb7220714807103963c2bcfe
Jul 27 19:01:28.550138 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.550035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g" event={"ID":"29c60615-ee43-4f7c-bf4f-256a7739c49a","Type":"ContainerStarted","Data":"d34d87f529c0aad86e5c5352ccf1b0351caf6f4980a6933fe05d2a21eb4f4525"}
Jul 27 19:01:28.551893 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.551859    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg" event={"ID":"c10ef747-2f7b-4a0d-b838-12b86ed69780","Type":"ContainerStarted","Data":"12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9"}
Jul 27 19:01:28.552068 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.551920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg" event={"ID":"c10ef747-2f7b-4a0d-b838-12b86ed69780","Type":"ContainerStarted","Data":"d2cdda32d8920b1c5f5d5a437d3968c53b8d9c64eb7220714807103963c2bcfe"}
Jul 27 19:01:28.552068 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.551948    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:28.553608 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.553581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw" event={"ID":"ca98953d-c831-4b33-8090-e0a21adbaf45","Type":"ContainerStarted","Data":"91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9"}
Jul 27 19:01:28.553730 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.553629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw" event={"ID":"ca98953d-c831-4b33-8090-e0a21adbaf45","Type":"ContainerStarted","Data":"2f17b22570213f4b4a8557c64136a68b91ca08b794ad0062efb73bc05ab41011"}
Jul 27 19:01:28.553730 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.553667    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:01:28.572676 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.572628    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg" podStartSLOduration=1.5726094000000002 podStartE2EDuration="1.5726094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:01:28.569058738 +0000 UTC m=+1786.652341591" watchObservedRunningTime="2026-07-27 19:01:28.5726094 +0000 UTC m=+1786.655892253"
Jul 27 19:01:28.585988 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:28.585943    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw" podStartSLOduration=1.585930189 podStartE2EDuration="1.585930189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:01:28.585272962 +0000 UTC m=+1786.668555813" watchObservedRunningTime="2026-07-27 19:01:28.585930189 +0000 UTC m=+1786.669213039"
Jul 27 19:01:29.561908 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:29.561871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g" event={"ID":"29c60615-ee43-4f7c-bf4f-256a7739c49a","Type":"ContainerStarted","Data":"5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e"}
Jul 27 19:01:29.562373 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:29.562039    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:29.582276 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:29.582226    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g" podStartSLOduration=3.021602144 podStartE2EDuration="3.582210849s" totalImagesPullingTime="560.608705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:01:29.579674657 +0000 UTC m=+1787.662957510" watchObservedRunningTime="2026-07-27 19:01:29.582210849 +0000 UTC m=+1787.665493699"
Jul 27 19:01:33.985339 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:33.985261    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:01:35.575346 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:35.575314    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:01:39.564620 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:39.564590    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:01:39.565016 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:01:39.564658    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:02:02.957367 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:02.957330    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"]
Jul 27 19:02:02.957973 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:02.957602    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g" podUID="29c60615-ee43-4f7c-bf4f-256a7739c49a" containerName="maas-api" containerID="cri-o://5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e" gracePeriod=30
Jul 27 19:02:03.012714 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.012681    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"]
Jul 27 19:02:03.012920 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.012896    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg" podUID="c10ef747-2f7b-4a0d-b838-12b86ed69780" containerName="payload-processing" containerID="cri-o://12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9" gracePeriod=30
Jul 27 19:02:03.021582 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.021549    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"]
Jul 27 19:02:03.021890 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.021817    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw" podUID="ca98953d-c831-4b33-8090-e0a21adbaf45" containerName="payload-pre-processing" containerID="cri-o://91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9" gracePeriod=30
Jul 27 19:02:03.285571 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.285544    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:02:03.309836 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.309811    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:02:03.331250 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.331221    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:02:03.470264 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470174    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca98953d-c831-4b33-8090-e0a21adbaf45-plugins-config-volume\") pod \"ca98953d-c831-4b33-8090-e0a21adbaf45\" (UID: \"ca98953d-c831-4b33-8090-e0a21adbaf45\") "
Jul 27 19:02:03.470264 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470235    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c877d\" (UniqueName: \"kubernetes.io/projected/c10ef747-2f7b-4a0d-b838-12b86ed69780-kube-api-access-c877d\") pod \"c10ef747-2f7b-4a0d-b838-12b86ed69780\" (UID: \"c10ef747-2f7b-4a0d-b838-12b86ed69780\") "
Jul 27 19:02:03.470264 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470259    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls\") pod \"29c60615-ee43-4f7c-bf4f-256a7739c49a\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") "
Jul 27 19:02:03.470602 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470315    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtm4d\" (UniqueName: \"kubernetes.io/projected/ca98953d-c831-4b33-8090-e0a21adbaf45-kube-api-access-dtm4d\") pod \"ca98953d-c831-4b33-8090-e0a21adbaf45\" (UID: \"ca98953d-c831-4b33-8090-e0a21adbaf45\") "
Jul 27 19:02:03.470602 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470361    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29c60615-ee43-4f7c-bf4f-256a7739c49a-openshift-service-ca\") pod \"29c60615-ee43-4f7c-bf4f-256a7739c49a\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") "
Jul 27 19:02:03.470602 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470393    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c10ef747-2f7b-4a0d-b838-12b86ed69780-plugins-config-volume\") pod \"c10ef747-2f7b-4a0d-b838-12b86ed69780\" (UID: \"c10ef747-2f7b-4a0d-b838-12b86ed69780\") "
Jul 27 19:02:03.470602 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470459    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzvvd\" (UniqueName: \"kubernetes.io/projected/29c60615-ee43-4f7c-bf4f-256a7739c49a-kube-api-access-qzvvd\") pod \"29c60615-ee43-4f7c-bf4f-256a7739c49a\" (UID: \"29c60615-ee43-4f7c-bf4f-256a7739c49a\") "
Jul 27 19:02:03.470855 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470658    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca98953d-c831-4b33-8090-e0a21adbaf45-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca98953d-c831-4b33-8090-e0a21adbaf45" (UID: "ca98953d-c831-4b33-8090-e0a21adbaf45"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:02:03.470855 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.470773    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca98953d-c831-4b33-8090-e0a21adbaf45-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:03.471042 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.471003    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29c60615-ee43-4f7c-bf4f-256a7739c49a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "29c60615-ee43-4f7c-bf4f-256a7739c49a" (UID: "29c60615-ee43-4f7c-bf4f-256a7739c49a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:02:03.471248 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.471198    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c10ef747-2f7b-4a0d-b838-12b86ed69780-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c10ef747-2f7b-4a0d-b838-12b86ed69780" (UID: "c10ef747-2f7b-4a0d-b838-12b86ed69780"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:02:03.472650 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.472614    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "29c60615-ee43-4f7c-bf4f-256a7739c49a" (UID: "29c60615-ee43-4f7c-bf4f-256a7739c49a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:02:03.472650 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.472636    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c10ef747-2f7b-4a0d-b838-12b86ed69780-kube-api-access-c877d" (OuterVolumeSpecName: "kube-api-access-c877d") pod "c10ef747-2f7b-4a0d-b838-12b86ed69780" (UID: "c10ef747-2f7b-4a0d-b838-12b86ed69780"). InnerVolumeSpecName "kube-api-access-c877d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:03.473157 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.473132    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c60615-ee43-4f7c-bf4f-256a7739c49a-kube-api-access-qzvvd" (OuterVolumeSpecName: "kube-api-access-qzvvd") pod "29c60615-ee43-4f7c-bf4f-256a7739c49a" (UID: "29c60615-ee43-4f7c-bf4f-256a7739c49a"). InnerVolumeSpecName "kube-api-access-qzvvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:03.473244 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.473164    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca98953d-c831-4b33-8090-e0a21adbaf45-kube-api-access-dtm4d" (OuterVolumeSpecName: "kube-api-access-dtm4d") pod "ca98953d-c831-4b33-8090-e0a21adbaf45" (UID: "ca98953d-c831-4b33-8090-e0a21adbaf45"). InnerVolumeSpecName "kube-api-access-dtm4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:03.571401 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.571361    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c877d\" (UniqueName: \"kubernetes.io/projected/c10ef747-2f7b-4a0d-b838-12b86ed69780-kube-api-access-c877d\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:03.571401 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.571394    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29c60615-ee43-4f7c-bf4f-256a7739c49a-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:03.571401 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.571404    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtm4d\" (UniqueName: \"kubernetes.io/projected/ca98953d-c831-4b33-8090-e0a21adbaf45-kube-api-access-dtm4d\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:03.571676 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.571414    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29c60615-ee43-4f7c-bf4f-256a7739c49a-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:03.571676 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.571436    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c10ef747-2f7b-4a0d-b838-12b86ed69780-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:03.571676 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.571447    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzvvd\" (UniqueName: \"kubernetes.io/projected/29c60615-ee43-4f7c-bf4f-256a7739c49a-kube-api-access-qzvvd\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:03.776404 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.776299    2577 generic.go:356] "Generic (PLEG): container finished" podID="c10ef747-2f7b-4a0d-b838-12b86ed69780" containerID="12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9" exitCode=0
Jul 27 19:02:03.776404 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.776352    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"
Jul 27 19:02:03.776404 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.776384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg" event={"ID":"c10ef747-2f7b-4a0d-b838-12b86ed69780","Type":"ContainerDied","Data":"12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9"}
Jul 27 19:02:03.776729 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.776486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg" event={"ID":"c10ef747-2f7b-4a0d-b838-12b86ed69780","Type":"ContainerDied","Data":"d2cdda32d8920b1c5f5d5a437d3968c53b8d9c64eb7220714807103963c2bcfe"}
Jul 27 19:02:03.776729 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.776516    2577 scope.go:117] "RemoveContainer" containerID="12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9"
Jul 27 19:02:03.778146 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.778110    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca98953d-c831-4b33-8090-e0a21adbaf45" containerID="91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9" exitCode=0
Jul 27 19:02:03.778284 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.778176    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"
Jul 27 19:02:03.778284 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.778231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw" event={"ID":"ca98953d-c831-4b33-8090-e0a21adbaf45","Type":"ContainerDied","Data":"91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9"}
Jul 27 19:02:03.778284 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.778270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw" event={"ID":"ca98953d-c831-4b33-8090-e0a21adbaf45","Type":"ContainerDied","Data":"2f17b22570213f4b4a8557c64136a68b91ca08b794ad0062efb73bc05ab41011"}
Jul 27 19:02:03.779671 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.779647    2577 generic.go:356] "Generic (PLEG): container finished" podID="29c60615-ee43-4f7c-bf4f-256a7739c49a" containerID="5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e" exitCode=0
Jul 27 19:02:03.779803 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.779700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g" event={"ID":"29c60615-ee43-4f7c-bf4f-256a7739c49a","Type":"ContainerDied","Data":"5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e"}
Jul 27 19:02:03.779803 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.779734    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"
Jul 27 19:02:03.779803 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.779745    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g" event={"ID":"29c60615-ee43-4f7c-bf4f-256a7739c49a","Type":"ContainerDied","Data":"d34d87f529c0aad86e5c5352ccf1b0351caf6f4980a6933fe05d2a21eb4f4525"}
Jul 27 19:02:03.788826 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.788803    2577 scope.go:117] "RemoveContainer" containerID="12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9"
Jul 27 19:02:03.789102 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:02:03.789085    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9\": container with ID starting with 12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9 not found: ID does not exist" containerID="12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9"
Jul 27 19:02:03.789191 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.789113    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9"} err="failed to get container status \"12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9\": rpc error: code = NotFound desc = could not find container \"12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9\": container with ID starting with 12229264775b61cf522ed9aaa02f63f346448cf9de6358fe95580023ab9094d9 not found: ID does not exist"
Jul 27 19:02:03.789191 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.789136    2577 scope.go:117] "RemoveContainer" containerID="91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9"
Jul 27 19:02:03.798084 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.798069    2577 scope.go:117] "RemoveContainer" containerID="91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9"
Jul 27 19:02:03.798333 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:02:03.798316    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9\": container with ID starting with 91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9 not found: ID does not exist" containerID="91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9"
Jul 27 19:02:03.798385 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.798339    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9"} err="failed to get container status \"91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9\": rpc error: code = NotFound desc = could not find container \"91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9\": container with ID starting with 91940ac393569643128a7f765a0d5c6b681796107420547d1258450c675379f9 not found: ID does not exist"
Jul 27 19:02:03.798385 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.798355    2577 scope.go:117] "RemoveContainer" containerID="5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e"
Jul 27 19:02:03.806912 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.806897    2577 scope.go:117] "RemoveContainer" containerID="5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e"
Jul 27 19:02:03.807154 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:02:03.807137    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e\": container with ID starting with 5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e not found: ID does not exist" containerID="5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e"
Jul 27 19:02:03.807204 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.807160    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e"} err="failed to get container status \"5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e\": rpc error: code = NotFound desc = could not find container \"5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e\": container with ID starting with 5a9b57cdb218517d092d6fd993e7ce672bb0bce54132acaa1f7dcecffcade45e not found: ID does not exist"
Jul 27 19:02:03.808373 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.808357    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"]
Jul 27 19:02:03.812858 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.812833    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-cf4c6eb2-79c5fddd6b-dmhxg"]
Jul 27 19:02:03.824445 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.824399    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"]
Jul 27 19:02:03.829573 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.829549    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cf4c6eb2-68b454968-s56xw"]
Jul 27 19:02:03.840330 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.840307    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"]
Jul 27 19:02:03.843512 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:03.843493    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf4c6eb2-58b88bdffd-btd9g"]
Jul 27 19:02:04.512357 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:04.512318    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29c60615-ee43-4f7c-bf4f-256a7739c49a" path="/var/lib/kubelet/pods/29c60615-ee43-4f7c-bf4f-256a7739c49a/volumes"
Jul 27 19:02:04.512743 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:04.512707    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c10ef747-2f7b-4a0d-b838-12b86ed69780" path="/var/lib/kubelet/pods/c10ef747-2f7b-4a0d-b838-12b86ed69780/volumes"
Jul 27 19:02:04.513030 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:04.513016    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca98953d-c831-4b33-8090-e0a21adbaf45" path="/var/lib/kubelet/pods/ca98953d-c831-4b33-8090-e0a21adbaf45/volumes"
Jul 27 19:02:05.788816 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:05.788782    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:02:12.156671 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.156640    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"]
Jul 27 19:02:12.157326 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157300    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29c60615-ee43-4f7c-bf4f-256a7739c49a" containerName="maas-api"
Jul 27 19:02:12.157527 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157506    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="29c60615-ee43-4f7c-bf4f-256a7739c49a" containerName="maas-api"
Jul 27 19:02:12.157642 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157543    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c10ef747-2f7b-4a0d-b838-12b86ed69780" containerName="payload-processing"
Jul 27 19:02:12.157642 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157552    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c10ef747-2f7b-4a0d-b838-12b86ed69780" containerName="payload-processing"
Jul 27 19:02:12.157642 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157569    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca98953d-c831-4b33-8090-e0a21adbaf45" containerName="payload-pre-processing"
Jul 27 19:02:12.157642 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157577    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca98953d-c831-4b33-8090-e0a21adbaf45" containerName="payload-pre-processing"
Jul 27 19:02:12.157790 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157664    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c10ef747-2f7b-4a0d-b838-12b86ed69780" containerName="payload-processing"
Jul 27 19:02:12.157790 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157674    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="29c60615-ee43-4f7c-bf4f-256a7739c49a" containerName="maas-api"
Jul 27 19:02:12.157790 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.157684    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca98953d-c831-4b33-8090-e0a21adbaf45" containerName="payload-pre-processing"
Jul 27 19:02:12.160777 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.160761    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.163811 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.163790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-27df8036-serving-cert\""
Jul 27 19:02:12.163929 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.163835    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:02:12.164466 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.164448    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5c8w7\""
Jul 27 19:02:12.164558 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.164486    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:02:12.172906 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.172873    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"]
Jul 27 19:02:12.244009 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.243976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt9sp\" (UniqueName: \"kubernetes.io/projected/ac5f433f-19e8-43d1-b6ff-05befb49d990-kube-api-access-rt9sp\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.244009 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.244009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.244219 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.244082    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5f433f-19e8-43d1-b6ff-05befb49d990-openshift-service-ca\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.345272 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.345237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt9sp\" (UniqueName: \"kubernetes.io/projected/ac5f433f-19e8-43d1-b6ff-05befb49d990-kube-api-access-rt9sp\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.345272 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.345275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.345532 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.345324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5f433f-19e8-43d1-b6ff-05befb49d990-openshift-service-ca\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.345573 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:02:12.345537    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-serving-cert: secret "maas-api-e2e-derive-27df8036-serving-cert" not found
Jul 27 19:02:12.345633 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:02:12.345619    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls podName:ac5f433f-19e8-43d1-b6ff-05befb49d990 nodeName:}" failed. No retries permitted until 2026-07-27 19:02:12.845596546 +0000 UTC m=+1830.928879392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls") pod "maas-api-e2e-derive-27df8036-5fb4c59578-58nlf" (UID: "ac5f433f-19e8-43d1-b6ff-05befb49d990") : secret "maas-api-e2e-derive-27df8036-serving-cert" not found
Jul 27 19:02:12.346111 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.346094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5f433f-19e8-43d1-b6ff-05befb49d990-openshift-service-ca\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.353828 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.353798    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt9sp\" (UniqueName: \"kubernetes.io/projected/ac5f433f-19e8-43d1-b6ff-05befb49d990-kube-api-access-rt9sp\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.851767 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.851738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.854238 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.854219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls\") pod \"maas-api-e2e-derive-27df8036-5fb4c59578-58nlf\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:12.928822 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.928789    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"]
Jul 27 19:02:12.932882 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.932861    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:12.935585 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.935559    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-27df8036\""
Jul 27 19:02:12.935710 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.935603    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-27df8036-dockercfg-zz559\""
Jul 27 19:02:12.945144 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.945116    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"]
Jul 27 19:02:12.952449 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.952401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9rlm\" (UniqueName: \"kubernetes.io/projected/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-kube-api-access-m9rlm\") pod \"payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv\" (UID: \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:12.952577 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:12.952493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv\" (UID: \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:13.053824 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.053787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv\" (UID: \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:13.054002 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.053879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rlm\" (UniqueName: \"kubernetes.io/projected/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-kube-api-access-m9rlm\") pod \"payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv\" (UID: \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:13.054514 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.054495    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv\" (UID: \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:13.064665 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.064640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9rlm\" (UniqueName: \"kubernetes.io/projected/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-kube-api-access-m9rlm\") pod \"payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv\" (UID: \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:13.073456 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.073437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:13.219735 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.219699    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"]
Jul 27 19:02:13.221492 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:02:13.221464    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5f433f_19e8_43d1_b6ff_05befb49d990.slice/crio-a79659ece01490a0a9da10c25ee392b4015c92d8c8422e46ef3f1996c0b2c5f3 WatchSource:0}: Error finding container a79659ece01490a0a9da10c25ee392b4015c92d8c8422e46ef3f1996c0b2c5f3: Status 404 returned error can't find the container with id a79659ece01490a0a9da10c25ee392b4015c92d8c8422e46ef3f1996c0b2c5f3
Jul 27 19:02:13.245523 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.245491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:13.390987 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.390955    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"]
Jul 27 19:02:13.392591 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:02:13.392554    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e499b0_0d4e_4ca2_96a7_b8acd31840d0.slice/crio-82e35663080e13533bf77a3ad3950183e23fbf7e82a2e0fb536c27489d22b9dd WatchSource:0}: Error finding container 82e35663080e13533bf77a3ad3950183e23fbf7e82a2e0fb536c27489d22b9dd: Status 404 returned error can't find the container with id 82e35663080e13533bf77a3ad3950183e23fbf7e82a2e0fb536c27489d22b9dd
Jul 27 19:02:13.851058 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.851018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv" event={"ID":"05e499b0-0d4e-4ca2-96a7-b8acd31840d0","Type":"ContainerStarted","Data":"ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c"}
Jul 27 19:02:13.851226 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.851118    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:13.851226 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.851148    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv" event={"ID":"05e499b0-0d4e-4ca2-96a7-b8acd31840d0","Type":"ContainerStarted","Data":"82e35663080e13533bf77a3ad3950183e23fbf7e82a2e0fb536c27489d22b9dd"}
Jul 27 19:02:13.852649 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.852622    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf" event={"ID":"ac5f433f-19e8-43d1-b6ff-05befb49d990","Type":"ContainerStarted","Data":"d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03"}
Jul 27 19:02:13.852772 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.852670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf" event={"ID":"ac5f433f-19e8-43d1-b6ff-05befb49d990","Type":"ContainerStarted","Data":"a79659ece01490a0a9da10c25ee392b4015c92d8c8422e46ef3f1996c0b2c5f3"}
Jul 27 19:02:13.852772 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.852730    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:13.868368 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.868311    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv" podStartSLOduration=1.868295443 podStartE2EDuration="1.868295443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:02:13.867561815 +0000 UTC m=+1831.950844679" watchObservedRunningTime="2026-07-27 19:02:13.868295443 +0000 UTC m=+1831.951578294"
Jul 27 19:02:13.886137 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:13.886083    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf" podStartSLOduration=1.567441726 podStartE2EDuration="1.88606486s" totalImagesPullingTime="318.623134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:02:13.884470623 +0000 UTC m=+1831.967753478" watchObservedRunningTime="2026-07-27 19:02:13.88606486 +0000 UTC m=+1831.969347711"
Jul 27 19:02:15.086162 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:15.086128    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:02:19.864413 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:19.864382    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:24.861636 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:24.861598    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:47.315336 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.315297    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"]
Jul 27 19:02:47.316375 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.316333    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf" podUID="ac5f433f-19e8-43d1-b6ff-05befb49d990" containerName="maas-api" containerID="cri-o://d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03" gracePeriod=30
Jul 27 19:02:47.371645 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.371611    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"]
Jul 27 19:02:47.371871 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.371823    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv" podUID="05e499b0-0d4e-4ca2-96a7-b8acd31840d0" containerName="payload-pre-processing" containerID="cri-o://ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c" gracePeriod=30
Jul 27 19:02:47.624872 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.624842    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:47.660175 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.660145    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:47.790542 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.790504    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9rlm\" (UniqueName: \"kubernetes.io/projected/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-kube-api-access-m9rlm\") pod \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\" (UID: \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\") "
Jul 27 19:02:47.790717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.790573    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5f433f-19e8-43d1-b6ff-05befb49d990-openshift-service-ca\") pod \"ac5f433f-19e8-43d1-b6ff-05befb49d990\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") "
Jul 27 19:02:47.790717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.790644    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt9sp\" (UniqueName: \"kubernetes.io/projected/ac5f433f-19e8-43d1-b6ff-05befb49d990-kube-api-access-rt9sp\") pod \"ac5f433f-19e8-43d1-b6ff-05befb49d990\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") "
Jul 27 19:02:47.790717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.790670    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls\") pod \"ac5f433f-19e8-43d1-b6ff-05befb49d990\" (UID: \"ac5f433f-19e8-43d1-b6ff-05befb49d990\") "
Jul 27 19:02:47.790901 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.790722    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-plugins-config-volume\") pod \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\" (UID: \"05e499b0-0d4e-4ca2-96a7-b8acd31840d0\") "
Jul 27 19:02:47.790977 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.790946    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac5f433f-19e8-43d1-b6ff-05befb49d990-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac5f433f-19e8-43d1-b6ff-05befb49d990" (UID: "ac5f433f-19e8-43d1-b6ff-05befb49d990"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:02:47.791161 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.791133    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05e499b0-0d4e-4ca2-96a7-b8acd31840d0" (UID: "05e499b0-0d4e-4ca2-96a7-b8acd31840d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:02:47.792976 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.792951    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-kube-api-access-m9rlm" (OuterVolumeSpecName: "kube-api-access-m9rlm") pod "05e499b0-0d4e-4ca2-96a7-b8acd31840d0" (UID: "05e499b0-0d4e-4ca2-96a7-b8acd31840d0"). InnerVolumeSpecName "kube-api-access-m9rlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:47.793086 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.792979    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac5f433f-19e8-43d1-b6ff-05befb49d990" (UID: "ac5f433f-19e8-43d1-b6ff-05befb49d990"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:02:47.793086 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.792979    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5f433f-19e8-43d1-b6ff-05befb49d990-kube-api-access-rt9sp" (OuterVolumeSpecName: "kube-api-access-rt9sp") pod "ac5f433f-19e8-43d1-b6ff-05befb49d990" (UID: "ac5f433f-19e8-43d1-b6ff-05befb49d990"). InnerVolumeSpecName "kube-api-access-rt9sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:47.891717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.891678    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:47.891717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.891713    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9rlm\" (UniqueName: \"kubernetes.io/projected/05e499b0-0d4e-4ca2-96a7-b8acd31840d0-kube-api-access-m9rlm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:47.891717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.891722    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac5f433f-19e8-43d1-b6ff-05befb49d990-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:47.891974 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.891742    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt9sp\" (UniqueName: \"kubernetes.io/projected/ac5f433f-19e8-43d1-b6ff-05befb49d990-kube-api-access-rt9sp\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:47.891974 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:47.891753    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac5f433f-19e8-43d1-b6ff-05befb49d990-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:02:48.071530 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.071495    2577 generic.go:356] "Generic (PLEG): container finished" podID="ac5f433f-19e8-43d1-b6ff-05befb49d990" containerID="d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03" exitCode=0
Jul 27 19:02:48.071741 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.071551    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"
Jul 27 19:02:48.071741 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.071575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf" event={"ID":"ac5f433f-19e8-43d1-b6ff-05befb49d990","Type":"ContainerDied","Data":"d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03"}
Jul 27 19:02:48.071741 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.071630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf" event={"ID":"ac5f433f-19e8-43d1-b6ff-05befb49d990","Type":"ContainerDied","Data":"a79659ece01490a0a9da10c25ee392b4015c92d8c8422e46ef3f1996c0b2c5f3"}
Jul 27 19:02:48.071741 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.071652    2577 scope.go:117] "RemoveContainer" containerID="d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03"
Jul 27 19:02:48.073066 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.073039    2577 generic.go:356] "Generic (PLEG): container finished" podID="05e499b0-0d4e-4ca2-96a7-b8acd31840d0" containerID="ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c" exitCode=0
Jul 27 19:02:48.073179 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.073070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv" event={"ID":"05e499b0-0d4e-4ca2-96a7-b8acd31840d0","Type":"ContainerDied","Data":"ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c"}
Jul 27 19:02:48.073179 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.073094    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"
Jul 27 19:02:48.073179 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.073115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv" event={"ID":"05e499b0-0d4e-4ca2-96a7-b8acd31840d0","Type":"ContainerDied","Data":"82e35663080e13533bf77a3ad3950183e23fbf7e82a2e0fb536c27489d22b9dd"}
Jul 27 19:02:48.083249 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.083233    2577 scope.go:117] "RemoveContainer" containerID="d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03"
Jul 27 19:02:48.083628 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:02:48.083605    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03\": container with ID starting with d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03 not found: ID does not exist" containerID="d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03"
Jul 27 19:02:48.083701 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.083639    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03"} err="failed to get container status \"d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03\": rpc error: code = NotFound desc = could not find container \"d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03\": container with ID starting with d39e6f94a09ae70f8d6978b3bf18aaaa88f5dc0573afcee1ca06b04e1d3acc03 not found: ID does not exist"
Jul 27 19:02:48.083701 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.083657    2577 scope.go:117] "RemoveContainer" containerID="ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c"
Jul 27 19:02:48.095515 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.095495    2577 scope.go:117] "RemoveContainer" containerID="ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c"
Jul 27 19:02:48.095865 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:02:48.095837    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c\": container with ID starting with ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c not found: ID does not exist" containerID="ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c"
Jul 27 19:02:48.095922 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.095873    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c"} err="failed to get container status \"ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c\": rpc error: code = NotFound desc = could not find container \"ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c\": container with ID starting with ec67096ce5f2e1f466282df52401f587e241b9efc1b6cab2c0fe07e5c78d982c not found: ID does not exist"
Jul 27 19:02:48.097041 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.097022    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"]
Jul 27 19:02:48.101255 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.101234    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-27df8036-5fb4c59578-58nlf"]
Jul 27 19:02:48.112157 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.112132    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"]
Jul 27 19:02:48.117899 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.117873    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-27df8036-555c4994c6-p6rxv"]
Jul 27 19:02:48.510786 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.510755    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e499b0-0d4e-4ca2-96a7-b8acd31840d0" path="/var/lib/kubelet/pods/05e499b0-0d4e-4ca2-96a7-b8acd31840d0/volumes"
Jul 27 19:02:48.511156 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:48.511137    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac5f433f-19e8-43d1-b6ff-05befb49d990" path="/var/lib/kubelet/pods/ac5f433f-19e8-43d1-b6ff-05befb49d990/volumes"
Jul 27 19:02:50.685562 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:02:50.685532    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:04:19.085951 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:19.085920    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:04:29.078340 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:29.078300    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:04:34.484089 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.484010    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"]
Jul 27 19:04:34.484695 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.484673    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e499b0-0d4e-4ca2-96a7-b8acd31840d0" containerName="payload-pre-processing"
Jul 27 19:04:34.484774 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.484701    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e499b0-0d4e-4ca2-96a7-b8acd31840d0" containerName="payload-pre-processing"
Jul 27 19:04:34.484774 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.484749    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5f433f-19e8-43d1-b6ff-05befb49d990" containerName="maas-api"
Jul 27 19:04:34.484774 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.484757    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5f433f-19e8-43d1-b6ff-05befb49d990" containerName="maas-api"
Jul 27 19:04:34.484873 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.484859    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e499b0-0d4e-4ca2-96a7-b8acd31840d0" containerName="payload-pre-processing"
Jul 27 19:04:34.484911 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.484874    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5f433f-19e8-43d1-b6ff-05befb49d990" containerName="maas-api"
Jul 27 19:04:34.488715 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.488699    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.491308 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.491285    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5863a6bc-serving-cert\""
Jul 27 19:04:34.491490 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.491468    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:04:34.491572 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.491541    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5c8w7\""
Jul 27 19:04:34.492269 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.492249    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:04:34.500829 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.500802    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"]
Jul 27 19:04:34.614051 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.614011    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfr9p\" (UniqueName: \"kubernetes.io/projected/009dd976-f563-4f9f-a081-94a64df766c8-kube-api-access-mfr9p\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.614233 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.614070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009dd976-f563-4f9f-a081-94a64df766c8-maas-api-tls\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.614233 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.614171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009dd976-f563-4f9f-a081-94a64df766c8-openshift-service-ca\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.715257 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.715222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfr9p\" (UniqueName: \"kubernetes.io/projected/009dd976-f563-4f9f-a081-94a64df766c8-kube-api-access-mfr9p\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.715461 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.715269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009dd976-f563-4f9f-a081-94a64df766c8-maas-api-tls\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.715461 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.715316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009dd976-f563-4f9f-a081-94a64df766c8-openshift-service-ca\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.716081 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.716062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009dd976-f563-4f9f-a081-94a64df766c8-openshift-service-ca\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.717952 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.717922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009dd976-f563-4f9f-a081-94a64df766c8-maas-api-tls\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.728343 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.728255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfr9p\" (UniqueName: \"kubernetes.io/projected/009dd976-f563-4f9f-a081-94a64df766c8-kube-api-access-mfr9p\") pod \"maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.804410 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.804311    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:34.984912 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:34.984865    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"]
Jul 27 19:04:35.459951 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.459920    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"]
Jul 27 19:04:35.463594 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.463578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:35.466956 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.466929    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5863a6bc-dockercfg-9tr8v\""
Jul 27 19:04:35.466956 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.466927    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5863a6bc\""
Jul 27 19:04:35.473977 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.473958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"]
Jul 27 19:04:35.624950 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.624855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh\" (UID: \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:35.625395 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.625094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsb5m\" (UniqueName: \"kubernetes.io/projected/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-kube-api-access-nsb5m\") pod \"payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh\" (UID: \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:35.710892 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.710851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8" event={"ID":"009dd976-f563-4f9f-a081-94a64df766c8","Type":"ContainerStarted","Data":"1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8"}
Jul 27 19:04:35.711080 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.710917    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:35.711080 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.710945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8" event={"ID":"009dd976-f563-4f9f-a081-94a64df766c8","Type":"ContainerStarted","Data":"1abce04fc8d006ca0bbc4f6dba1d22f8e67a3f05744b6e0091137daf7b41667a"}
Jul 27 19:04:35.726587 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.726553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsb5m\" (UniqueName: \"kubernetes.io/projected/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-kube-api-access-nsb5m\") pod \"payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh\" (UID: \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:35.726767 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.726640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh\" (UID: \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:35.727474 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.727448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh\" (UID: \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:35.735440 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.735374    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8" podStartSLOduration=1.372338729 podStartE2EDuration="1.735354923s" totalImagesPullingTime="363.016194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:04:35.732441323 +0000 UTC m=+1973.815724168" watchObservedRunningTime="2026-07-27 19:04:35.735354923 +0000 UTC m=+1973.818637767"
Jul 27 19:04:35.742575 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.742550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsb5m\" (UniqueName: \"kubernetes.io/projected/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-kube-api-access-nsb5m\") pod \"payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh\" (UID: \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:35.775353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.775319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:35.973182 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:35.973152    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"]
Jul 27 19:04:35.975217 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:04:35.975182    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9c1bf1_3c1f_4e0a_a144_23809cf2494e.slice/crio-6917947f995b8b4f46f200f0fd0543e7a2740873ae598850f29df9c88d2524fd WatchSource:0}: Error finding container 6917947f995b8b4f46f200f0fd0543e7a2740873ae598850f29df9c88d2524fd: Status 404 returned error can't find the container with id 6917947f995b8b4f46f200f0fd0543e7a2740873ae598850f29df9c88d2524fd
Jul 27 19:04:36.719758 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:36.719722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh" event={"ID":"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e","Type":"ContainerStarted","Data":"9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919"}
Jul 27 19:04:36.720200 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:36.719776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh" event={"ID":"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e","Type":"ContainerStarted","Data":"6917947f995b8b4f46f200f0fd0543e7a2740873ae598850f29df9c88d2524fd"}
Jul 27 19:04:36.720200 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:36.719812    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:36.742466 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:36.742378    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh" podStartSLOduration=1.742357438 podStartE2EDuration="1.742357438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:04:36.741856192 +0000 UTC m=+1974.825139046" watchObservedRunningTime="2026-07-27 19:04:36.742357438 +0000 UTC m=+1974.825640290"
Jul 27 19:04:39.603930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:39.603899    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:04:41.726123 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:41.726090    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:47.728335 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:47.728303    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:56.834005 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:56.833962    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"]
Jul 27 19:04:56.834543 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:56.834211    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8" podUID="009dd976-f563-4f9f-a081-94a64df766c8" containerName="maas-api" containerID="cri-o://1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8" gracePeriod=30
Jul 27 19:04:56.894213 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:56.894098    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"]
Jul 27 19:04:56.894743 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:56.894683    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh" podUID="0a9c1bf1-3c1f-4e0a-a144-23809cf2494e" containerName="payload-pre-processing" containerID="cri-o://9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919" gracePeriod=30
Jul 27 19:04:57.152926 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.152902    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:57.192409 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.192369    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:57.229590 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.229559    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfr9p\" (UniqueName: \"kubernetes.io/projected/009dd976-f563-4f9f-a081-94a64df766c8-kube-api-access-mfr9p\") pod \"009dd976-f563-4f9f-a081-94a64df766c8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") "
Jul 27 19:04:57.229780 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.229616    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009dd976-f563-4f9f-a081-94a64df766c8-openshift-service-ca\") pod \"009dd976-f563-4f9f-a081-94a64df766c8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") "
Jul 27 19:04:57.229780 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.229648    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsb5m\" (UniqueName: \"kubernetes.io/projected/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-kube-api-access-nsb5m\") pod \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\" (UID: \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\") "
Jul 27 19:04:57.229780 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.229684    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-plugins-config-volume\") pod \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\" (UID: \"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e\") "
Jul 27 19:04:57.229780 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.229772    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009dd976-f563-4f9f-a081-94a64df766c8-maas-api-tls\") pod \"009dd976-f563-4f9f-a081-94a64df766c8\" (UID: \"009dd976-f563-4f9f-a081-94a64df766c8\") "
Jul 27 19:04:57.230011 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.229965    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/009dd976-f563-4f9f-a081-94a64df766c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "009dd976-f563-4f9f-a081-94a64df766c8" (UID: "009dd976-f563-4f9f-a081-94a64df766c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:04:57.230191 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.230165    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009dd976-f563-4f9f-a081-94a64df766c8-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:04:57.230275 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.230210    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a9c1bf1-3c1f-4e0a-a144-23809cf2494e" (UID: "0a9c1bf1-3c1f-4e0a-a144-23809cf2494e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:04:57.231892 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.231870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009dd976-f563-4f9f-a081-94a64df766c8-kube-api-access-mfr9p" (OuterVolumeSpecName: "kube-api-access-mfr9p") pod "009dd976-f563-4f9f-a081-94a64df766c8" (UID: "009dd976-f563-4f9f-a081-94a64df766c8"). InnerVolumeSpecName "kube-api-access-mfr9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:04:57.232358 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.232339    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-kube-api-access-nsb5m" (OuterVolumeSpecName: "kube-api-access-nsb5m") pod "0a9c1bf1-3c1f-4e0a-a144-23809cf2494e" (UID: "0a9c1bf1-3c1f-4e0a-a144-23809cf2494e"). InnerVolumeSpecName "kube-api-access-nsb5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:04:57.232414 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.232358    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/009dd976-f563-4f9f-a081-94a64df766c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "009dd976-f563-4f9f-a081-94a64df766c8" (UID: "009dd976-f563-4f9f-a081-94a64df766c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:04:57.330989 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.330951    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfr9p\" (UniqueName: \"kubernetes.io/projected/009dd976-f563-4f9f-a081-94a64df766c8-kube-api-access-mfr9p\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:04:57.330989 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.330983    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsb5m\" (UniqueName: \"kubernetes.io/projected/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-kube-api-access-nsb5m\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:04:57.330989 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.330997    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:04:57.331227 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.331006    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009dd976-f563-4f9f-a081-94a64df766c8-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:04:57.848843 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.848805    2577 generic.go:356] "Generic (PLEG): container finished" podID="009dd976-f563-4f9f-a081-94a64df766c8" containerID="1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8" exitCode=0
Jul 27 19:04:57.849282 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.848865    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"
Jul 27 19:04:57.849282 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.848891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8" event={"ID":"009dd976-f563-4f9f-a081-94a64df766c8","Type":"ContainerDied","Data":"1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8"}
Jul 27 19:04:57.849282 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.848942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8" event={"ID":"009dd976-f563-4f9f-a081-94a64df766c8","Type":"ContainerDied","Data":"1abce04fc8d006ca0bbc4f6dba1d22f8e67a3f05744b6e0091137daf7b41667a"}
Jul 27 19:04:57.849282 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.848975    2577 scope.go:117] "RemoveContainer" containerID="1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8"
Jul 27 19:04:57.850902 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.850511    2577 generic.go:356] "Generic (PLEG): container finished" podID="0a9c1bf1-3c1f-4e0a-a144-23809cf2494e" containerID="9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919" exitCode=0
Jul 27 19:04:57.850902 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.850540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh" event={"ID":"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e","Type":"ContainerDied","Data":"9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919"}
Jul 27 19:04:57.850902 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.850561    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"
Jul 27 19:04:57.850902 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.850599    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh" event={"ID":"0a9c1bf1-3c1f-4e0a-a144-23809cf2494e","Type":"ContainerDied","Data":"6917947f995b8b4f46f200f0fd0543e7a2740873ae598850f29df9c88d2524fd"}
Jul 27 19:04:57.860799 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.860773    2577 scope.go:117] "RemoveContainer" containerID="1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8"
Jul 27 19:04:57.861092 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:04:57.861073    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8\": container with ID starting with 1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8 not found: ID does not exist" containerID="1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8"
Jul 27 19:04:57.861209 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.861104    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8"} err="failed to get container status \"1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8\": rpc error: code = NotFound desc = could not find container \"1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8\": container with ID starting with 1cd245babe3ab8764657e0634981c01f5a2d4a0e47ec8751c3ef88ba905681e8 not found: ID does not exist"
Jul 27 19:04:57.861209 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.861129    2577 scope.go:117] "RemoveContainer" containerID="9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919"
Jul 27 19:04:57.869626 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.869609    2577 scope.go:117] "RemoveContainer" containerID="9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919"
Jul 27 19:04:57.869876 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:04:57.869858    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919\": container with ID starting with 9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919 not found: ID does not exist" containerID="9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919"
Jul 27 19:04:57.869921 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.869882    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919"} err="failed to get container status \"9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919\": rpc error: code = NotFound desc = could not find container \"9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919\": container with ID starting with 9e00da071abb70bc109556d68c30ed1ec896776c4496a0a6e909c06021f5e919 not found: ID does not exist"
Jul 27 19:04:57.876532 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.876510    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"]
Jul 27 19:04:57.879701 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.879681    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5863a6bc-68cbb7568d-xm7dh"]
Jul 27 19:04:57.890158 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.890138    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"]
Jul 27 19:04:57.894483 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:57.894463    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5863a6bc-6b65cf64cd-7jfl8"]
Jul 27 19:04:58.511208 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:58.511177    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="009dd976-f563-4f9f-a081-94a64df766c8" path="/var/lib/kubelet/pods/009dd976-f563-4f9f-a081-94a64df766c8/volumes"
Jul 27 19:04:58.511560 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:58.511546    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9c1bf1-3c1f-4e0a-a144-23809cf2494e" path="/var/lib/kubelet/pods/0a9c1bf1-3c1f-4e0a-a144-23809cf2494e/volumes"
Jul 27 19:04:59.686313 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:04:59.686276    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:05:31.854553 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.854523    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"]
Jul 27 19:05:31.855161 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.855142    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009dd976-f563-4f9f-a081-94a64df766c8" containerName="maas-api"
Jul 27 19:05:31.855266 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.855164    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="009dd976-f563-4f9f-a081-94a64df766c8" containerName="maas-api"
Jul 27 19:05:31.855266 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.855183    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9c1bf1-3c1f-4e0a-a144-23809cf2494e" containerName="payload-pre-processing"
Jul 27 19:05:31.855266 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.855193    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9c1bf1-3c1f-4e0a-a144-23809cf2494e" containerName="payload-pre-processing"
Jul 27 19:05:31.855446 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.855295    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="009dd976-f563-4f9f-a081-94a64df766c8" containerName="maas-api"
Jul 27 19:05:31.855446 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.855310    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9c1bf1-3c1f-4e0a-a144-23809cf2494e" containerName="payload-pre-processing"
Jul 27 19:05:31.858704 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.858686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:31.862485 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.862467    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5c8w7\""
Jul 27 19:05:31.862597 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.862511    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:05:31.863323 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.863305    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:05:31.863420 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.863356    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-dcc83a9c-serving-cert\""
Jul 27 19:05:31.870588 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.870567    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"]
Jul 27 19:05:31.953846 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.953813    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:31.954048 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.953886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751265e1-e421-4f35-b999-097b4dcbfc02-openshift-service-ca\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:31.954048 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:31.954020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjg6\" (UniqueName: \"kubernetes.io/projected/751265e1-e421-4f35-b999-097b4dcbfc02-kube-api-access-zpjg6\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.054480 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.054449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjg6\" (UniqueName: \"kubernetes.io/projected/751265e1-e421-4f35-b999-097b4dcbfc02-kube-api-access-zpjg6\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.054675 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.054544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.054675 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.054605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751265e1-e421-4f35-b999-097b4dcbfc02-openshift-service-ca\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.054791 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:05:32.054692    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-serving-cert: secret "maas-api-e2e-mt-dcc83a9c-serving-cert" not found
Jul 27 19:05:32.054791 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:05:32.054753    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls podName:751265e1-e421-4f35-b999-097b4dcbfc02 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:32.554737068 +0000 UTC m=+2030.638019897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls") pod "maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv" (UID: "751265e1-e421-4f35-b999-097b4dcbfc02") : secret "maas-api-e2e-mt-dcc83a9c-serving-cert" not found
Jul 27 19:05:32.055244 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.055221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751265e1-e421-4f35-b999-097b4dcbfc02-openshift-service-ca\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.063976 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.063951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjg6\" (UniqueName: \"kubernetes.io/projected/751265e1-e421-4f35-b999-097b4dcbfc02-kube-api-access-zpjg6\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.559131 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.559092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.561747 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.561728    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls\") pod \"maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.769802 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.769776    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:32.916853 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.916824    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"]
Jul 27 19:05:32.918173 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:05:32.918140    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751265e1_e421_4f35_b999_097b4dcbfc02.slice/crio-2fa8159fb06265fcfa5d34a00473a76d9e120b12d75112a62040fbecaa43c6ff WatchSource:0}: Error finding container 2fa8159fb06265fcfa5d34a00473a76d9e120b12d75112a62040fbecaa43c6ff: Status 404 returned error can't find the container with id 2fa8159fb06265fcfa5d34a00473a76d9e120b12d75112a62040fbecaa43c6ff
Jul 27 19:05:32.919509 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:32.919491    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:05:33.057129 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:33.057092    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv" event={"ID":"751265e1-e421-4f35-b999-097b4dcbfc02","Type":"ContainerStarted","Data":"2fa8159fb06265fcfa5d34a00473a76d9e120b12d75112a62040fbecaa43c6ff"}
Jul 27 19:05:34.064619 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:34.064586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv" event={"ID":"751265e1-e421-4f35-b999-097b4dcbfc02","Type":"ContainerStarted","Data":"3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5"}
Jul 27 19:05:34.065007 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:34.064647    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:34.091614 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:34.091548    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv" podStartSLOduration=2.547820493 podStartE2EDuration="3.091530792s" totalImagesPullingTime="543.710299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:34.090688175 +0000 UTC m=+2032.173971027" watchObservedRunningTime="2026-07-27 19:05:34.091530792 +0000 UTC m=+2032.174813662"
Jul 27 19:05:38.591373 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:38.591338    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:05:40.075814 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:40.075787    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:05:47.283867 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:05:47.283829    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:06:11.385550 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:06:11.385468    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:06:42.672873 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:06:42.672842    2577 scope.go:117] "RemoveContainer" containerID="55a0b0ca70d0e79080fe88e1cf70c347b97c9d7d7daab7d9f3eb8a2e7128dd05"
Jul 27 19:09:19.113646 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.113552    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"]
Jul 27 19:09:19.117501 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.117476    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"
Jul 27 19:09:19.120397 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.120376    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gwtlm\""
Jul 27 19:09:19.133037 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.133013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"]
Jul 27 19:09:19.213789 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.213745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8674b633-d624-4e3f-a321-8209d5017243-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz\" (UID: \"8674b633-d624-4e3f-a321-8209d5017243\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"
Jul 27 19:09:19.314743 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.314688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8674b633-d624-4e3f-a321-8209d5017243-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz\" (UID: \"8674b633-d624-4e3f-a321-8209d5017243\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"
Jul 27 19:09:19.315314 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.315291    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8674b633-d624-4e3f-a321-8209d5017243-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz\" (UID: \"8674b633-d624-4e3f-a321-8209d5017243\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"
Jul 27 19:09:19.427894 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.427814    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"
Jul 27 19:09:19.567570 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:19.567542    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"]
Jul 27 19:09:19.569292 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:09:19.569264    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8674b633_d624_4e3f_a321_8209d5017243.slice/crio-cec9d0bb1e376e196910cd5b0d7ee7a92d273f9b6aebeb1548866d75d3ed18f4 WatchSource:0}: Error finding container cec9d0bb1e376e196910cd5b0d7ee7a92d273f9b6aebeb1548866d75d3ed18f4: Status 404 returned error can't find the container with id cec9d0bb1e376e196910cd5b0d7ee7a92d273f9b6aebeb1548866d75d3ed18f4
Jul 27 19:09:20.388214 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:20.388183    2577 generic.go:356] "Generic (PLEG): container finished" podID="8674b633-d624-4e3f-a321-8209d5017243" containerID="d95c22e2689c3c5e685ae58c42a65f91f6af67dcf5340749967c4f39b5c64c03" exitCode=0
Jul 27 19:09:20.388591 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:20.388277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz" event={"ID":"8674b633-d624-4e3f-a321-8209d5017243","Type":"ContainerDied","Data":"d95c22e2689c3c5e685ae58c42a65f91f6af67dcf5340749967c4f39b5c64c03"}
Jul 27 19:09:20.388591 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:20.388333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz" event={"ID":"8674b633-d624-4e3f-a321-8209d5017243","Type":"ContainerStarted","Data":"cec9d0bb1e376e196910cd5b0d7ee7a92d273f9b6aebeb1548866d75d3ed18f4"}
Jul 27 19:09:21.528746 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:21.528719    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"
Jul 27 19:09:21.636361 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:21.636326    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8674b633-d624-4e3f-a321-8209d5017243-maas-api-service-ca\") pod \"8674b633-d624-4e3f-a321-8209d5017243\" (UID: \"8674b633-d624-4e3f-a321-8209d5017243\") "
Jul 27 19:09:21.636740 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:21.636717    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8674b633-d624-4e3f-a321-8209d5017243-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8674b633-d624-4e3f-a321-8209d5017243" (UID: "8674b633-d624-4e3f-a321-8209d5017243"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:09:21.737687 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:21.737601    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8674b633-d624-4e3f-a321-8209d5017243-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:09:22.401007 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:22.400975    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"
Jul 27 19:09:22.401007 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:22.400982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz" event={"ID":"8674b633-d624-4e3f-a321-8209d5017243","Type":"ContainerDied","Data":"cec9d0bb1e376e196910cd5b0d7ee7a92d273f9b6aebeb1548866d75d3ed18f4"}
Jul 27 19:09:22.401220 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:22.401065    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cec9d0bb1e376e196910cd5b0d7ee7a92d273f9b6aebeb1548866d75d3ed18f4"
Jul 27 19:09:32.804632 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:32.804597    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:09:34.561157 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.561123    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"]
Jul 27 19:09:34.561659 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.561350    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv" podUID="751265e1-e421-4f35-b999-097b4dcbfc02" containerName="maas-api" containerID="cri-o://3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5" gracePeriod=30
Jul 27 19:09:34.817944 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.817875    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:09:34.851584 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.851557    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751265e1-e421-4f35-b999-097b4dcbfc02-openshift-service-ca\") pod \"751265e1-e421-4f35-b999-097b4dcbfc02\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") "
Jul 27 19:09:34.851584 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.851593    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpjg6\" (UniqueName: \"kubernetes.io/projected/751265e1-e421-4f35-b999-097b4dcbfc02-kube-api-access-zpjg6\") pod \"751265e1-e421-4f35-b999-097b4dcbfc02\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") "
Jul 27 19:09:34.851849 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.851743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls\") pod \"751265e1-e421-4f35-b999-097b4dcbfc02\" (UID: \"751265e1-e421-4f35-b999-097b4dcbfc02\") "
Jul 27 19:09:34.851970 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.851941    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751265e1-e421-4f35-b999-097b4dcbfc02-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "751265e1-e421-4f35-b999-097b4dcbfc02" (UID: "751265e1-e421-4f35-b999-097b4dcbfc02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:09:34.852080 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.852057    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/751265e1-e421-4f35-b999-097b4dcbfc02-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:09:34.853897 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.853868    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751265e1-e421-4f35-b999-097b4dcbfc02-kube-api-access-zpjg6" (OuterVolumeSpecName: "kube-api-access-zpjg6") pod "751265e1-e421-4f35-b999-097b4dcbfc02" (UID: "751265e1-e421-4f35-b999-097b4dcbfc02"). InnerVolumeSpecName "kube-api-access-zpjg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:09:34.853983 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.853890    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "751265e1-e421-4f35-b999-097b4dcbfc02" (UID: "751265e1-e421-4f35-b999-097b4dcbfc02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:09:34.952550 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.952514    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/751265e1-e421-4f35-b999-097b4dcbfc02-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:09:34.952550 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:34.952545    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpjg6\" (UniqueName: \"kubernetes.io/projected/751265e1-e421-4f35-b999-097b4dcbfc02-kube-api-access-zpjg6\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:09:35.473511 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.473476    2577 generic.go:356] "Generic (PLEG): container finished" podID="751265e1-e421-4f35-b999-097b4dcbfc02" containerID="3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5" exitCode=0
Jul 27 19:09:35.473689 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.473525    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"
Jul 27 19:09:35.473689 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.473564    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv" event={"ID":"751265e1-e421-4f35-b999-097b4dcbfc02","Type":"ContainerDied","Data":"3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5"}
Jul 27 19:09:35.473689 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.473644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv" event={"ID":"751265e1-e421-4f35-b999-097b4dcbfc02","Type":"ContainerDied","Data":"2fa8159fb06265fcfa5d34a00473a76d9e120b12d75112a62040fbecaa43c6ff"}
Jul 27 19:09:35.473689 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.473667    2577 scope.go:117] "RemoveContainer" containerID="3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5"
Jul 27 19:09:35.483717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.483699    2577 scope.go:117] "RemoveContainer" containerID="3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5"
Jul 27 19:09:35.483966 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:09:35.483952    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5\": container with ID starting with 3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5 not found: ID does not exist" containerID="3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5"
Jul 27 19:09:35.484032 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.483974    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5"} err="failed to get container status \"3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5\": rpc error: code = NotFound desc = could not find container \"3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5\": container with ID starting with 3b4ddb543dfca647885cc923f1c8be8ac8d40e5a1db115e79c2a3545da5a44d5 not found: ID does not exist"
Jul 27 19:09:35.496665 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.496642    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"]
Jul 27 19:09:35.500713 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:35.500694    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcc83a9c-6bc95c8f4-56kdv"]
Jul 27 19:09:36.512041 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:36.512007    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751265e1-e421-4f35-b999-097b4dcbfc02" path="/var/lib/kubelet/pods/751265e1-e421-4f35-b999-097b4dcbfc02/volumes"
Jul 27 19:09:39.196992 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:39.196949    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"]
Jul 27 19:09:39.200000 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:39.199977    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcc83a9c-s6mdz"]
Jul 27 19:09:40.510183 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:40.510150    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8674b633-d624-4e3f-a321-8209d5017243" path="/var/lib/kubelet/pods/8674b633-d624-4e3f-a321-8209d5017243/volumes"
Jul 27 19:09:43.088776 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:09:43.088737    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:10:41.301142 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:10:41.301065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:10:54.888163 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:10:54.888119    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:11:37.823538 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.823500    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"]
Jul 27 19:11:37.824296 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.824274    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8674b633-d624-4e3f-a321-8209d5017243" containerName="revoke-keys"
Jul 27 19:11:37.824396 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.824300    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8674b633-d624-4e3f-a321-8209d5017243" containerName="revoke-keys"
Jul 27 19:11:37.824396 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.824315    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751265e1-e421-4f35-b999-097b4dcbfc02" containerName="maas-api"
Jul 27 19:11:37.824396 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.824324    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="751265e1-e421-4f35-b999-097b4dcbfc02" containerName="maas-api"
Jul 27 19:11:37.824606 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.824422    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8674b633-d624-4e3f-a321-8209d5017243" containerName="revoke-keys"
Jul 27 19:11:37.824606 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.824475    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="751265e1-e421-4f35-b999-097b4dcbfc02" containerName="maas-api"
Jul 27 19:11:37.828020 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.828001    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:37.831173 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.831063    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:11:37.831173 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.831118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7aabc5-serving-cert\""
Jul 27 19:11:37.831173 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.831141    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:11:37.832052 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.832036    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5c8w7\""
Jul 27 19:11:37.838821 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.838800    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"]
Jul 27 19:11:37.994767 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.994735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:37.994979 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.994794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d409b87-5692-4e3a-a5aa-c727f1586313-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:37.994979 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:37.994870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp47l\" (UniqueName: \"kubernetes.io/projected/8d409b87-5692-4e3a-a5aa-c727f1586313-kube-api-access-wp47l\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.096097 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.096061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.096261 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.096109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d409b87-5692-4e3a-a5aa-c727f1586313-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.096261 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.096129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp47l\" (UniqueName: \"kubernetes.io/projected/8d409b87-5692-4e3a-a5aa-c727f1586313-kube-api-access-wp47l\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.096261 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:11:38.096232    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-serving-cert: secret "maas-api-e2e-inf-a-7aabc5-serving-cert" not found
Jul 27 19:11:38.096375 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:11:38.096315    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls podName:8d409b87-5692-4e3a-a5aa-c727f1586313 nodeName:}" failed. No retries permitted until 2026-07-27 19:11:38.596293943 +0000 UTC m=+2396.679576780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls") pod "maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2" (UID: "8d409b87-5692-4e3a-a5aa-c727f1586313") : secret "maas-api-e2e-inf-a-7aabc5-serving-cert" not found
Jul 27 19:11:38.096791 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.096774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d409b87-5692-4e3a-a5aa-c727f1586313-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.105085 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.105061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp47l\" (UniqueName: \"kubernetes.io/projected/8d409b87-5692-4e3a-a5aa-c727f1586313-kube-api-access-wp47l\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.600715 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.600668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.603477 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.603449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls\") pod \"maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.740602 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.740562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:38.898936 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.898909    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"]
Jul 27 19:11:38.900317 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:11:38.900284    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d409b87_5692_4e3a_a5aa_c727f1586313.slice/crio-bed3daaead567f921c5edec6bb46e0cde132bbb2af34bffae83f8f441c798652 WatchSource:0}: Error finding container bed3daaead567f921c5edec6bb46e0cde132bbb2af34bffae83f8f441c798652: Status 404 returned error can't find the container with id bed3daaead567f921c5edec6bb46e0cde132bbb2af34bffae83f8f441c798652
Jul 27 19:11:38.901702 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:38.901684    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:11:39.204978 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:39.204897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2" event={"ID":"8d409b87-5692-4e3a-a5aa-c727f1586313","Type":"ContainerStarted","Data":"bed3daaead567f921c5edec6bb46e0cde132bbb2af34bffae83f8f441c798652"}
Jul 27 19:11:40.212668 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:40.212624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2" event={"ID":"8d409b87-5692-4e3a-a5aa-c727f1586313","Type":"ContainerStarted","Data":"58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5"}
Jul 27 19:11:40.213108 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:40.212721    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:40.237896 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:40.237836    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2" podStartSLOduration=2.895276192 podStartE2EDuration="3.237815647s" totalImagesPullingTime="342.539455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:40.233359698 +0000 UTC m=+2398.316642543" watchObservedRunningTime="2026-07-27 19:11:40.237815647 +0000 UTC m=+2398.321098499"
Jul 27 19:11:42.808015 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.807977    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"]
Jul 27 19:11:42.812028 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.812008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.814908 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.814890    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-954977-openshift-default-dockercfg-kvmjf\""
Jul 27 19:11:42.829144 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.829117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"]
Jul 27 19:11:42.944967 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.944934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98tkd\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-kube-api-access-98tkd\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.945203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.944976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-data\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.945203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.944999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-credential-socket\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.945203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.945113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-socket\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.945203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.945141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-podinfo\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.945203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.945161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istiod-ca-cert\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.945203 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.945177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-envoy\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.945442 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.945235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-token\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:42.945442 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:42.945261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-certs\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.046890 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.046852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-token\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.046890 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.046897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-certs\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047177 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.046938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tkd\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-kube-api-access-98tkd\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047177 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.046961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-data\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047177 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.046988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-credential-socket\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047177 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.047080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-socket\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047177 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.047104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-podinfo\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047177 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.047135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istiod-ca-cert\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047177 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.047160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-envoy\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047582 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.047380    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-certs\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047582 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.047536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-data\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047700 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.047633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-socket\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.047700 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.047656    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-credential-socket\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.048275 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.048245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istiod-ca-cert\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.049934 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.049906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-envoy\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.050036 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.049980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-podinfo\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.057591 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.057565    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-token\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.057717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.057697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tkd\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-kube-api-access-98tkd\") pod \"e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") " pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.122607 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.122573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:43.262999 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.262962    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:11:43.308610 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.308585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"]
Jul 27 19:11:43.310655 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:11:43.310628    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99bcb28e_5793_464b_ba2c_3bf4e41be17b.slice/crio-3cddff0613cd0e189d5aed9c81a1d21e60b45692423a63ae5bdb767baa6226b6 WatchSource:0}: Error finding container 3cddff0613cd0e189d5aed9c81a1d21e60b45692423a63ae5bdb767baa6226b6: Status 404 returned error can't find the container with id 3cddff0613cd0e189d5aed9c81a1d21e60b45692423a63ae5bdb767baa6226b6
Jul 27 19:11:43.313138 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.313103    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:11:43.313238 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.313167    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:11:43.313238 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:43.313192    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:11:44.251279 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:44.251195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" event={"ID":"99bcb28e-5793-464b-ba2c-3bf4e41be17b","Type":"ContainerStarted","Data":"92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156"}
Jul 27 19:11:44.251801 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:44.251328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" event={"ID":"99bcb28e-5793-464b-ba2c-3bf4e41be17b","Type":"ContainerStarted","Data":"3cddff0613cd0e189d5aed9c81a1d21e60b45692423a63ae5bdb767baa6226b6"}
Jul 27 19:11:44.274996 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:44.274950    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" podStartSLOduration=2.274935347 podStartE2EDuration="2.274935347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:44.272531116 +0000 UTC m=+2402.355813969" watchObservedRunningTime="2026-07-27 19:11:44.274935347 +0000 UTC m=+2402.358218198"
Jul 27 19:11:45.123359 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:45.123316    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:45.130057 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:45.130027    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:45.257290 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:45.257253    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:45.258371 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:45.258353    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:11:46.224719 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:46.224685    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:11:47.787178 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.787140    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"]
Jul 27 19:11:47.790977 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.790956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:47.793749 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.793727    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-954977\""
Jul 27 19:11:47.793861 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.793727    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-954977-dockercfg-rmrtq\""
Jul 27 19:11:47.801694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.801664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"]
Jul 27 19:11:47.890560 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.890522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f74mc\" (UniqueName: \"kubernetes.io/projected/4b685c92-68eb-4647-98e2-486c03356d9f-kube-api-access-f74mc\") pod \"payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt\" (UID: \"4b685c92-68eb-4647-98e2-486c03356d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:47.890734 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.890594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b685c92-68eb-4647-98e2-486c03356d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt\" (UID: \"4b685c92-68eb-4647-98e2-486c03356d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:47.991073 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.991041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f74mc\" (UniqueName: \"kubernetes.io/projected/4b685c92-68eb-4647-98e2-486c03356d9f-kube-api-access-f74mc\") pod \"payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt\" (UID: \"4b685c92-68eb-4647-98e2-486c03356d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:47.991241 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.991104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b685c92-68eb-4647-98e2-486c03356d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt\" (UID: \"4b685c92-68eb-4647-98e2-486c03356d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:47.991825 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:47.991807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b685c92-68eb-4647-98e2-486c03356d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt\" (UID: \"4b685c92-68eb-4647-98e2-486c03356d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:48.000047 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:48.000025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f74mc\" (UniqueName: \"kubernetes.io/projected/4b685c92-68eb-4647-98e2-486c03356d9f-kube-api-access-f74mc\") pod \"payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt\" (UID: \"4b685c92-68eb-4647-98e2-486c03356d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:48.103735 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:48.103704    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:48.246769 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:11:48.246738    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b685c92_68eb_4647_98e2_486c03356d9f.slice/crio-470822307b6e68492027fd1f863cf5eced8721a93ac7c10fdfc528b528584165 WatchSource:0}: Error finding container 470822307b6e68492027fd1f863cf5eced8721a93ac7c10fdfc528b528584165: Status 404 returned error can't find the container with id 470822307b6e68492027fd1f863cf5eced8721a93ac7c10fdfc528b528584165
Jul 27 19:11:48.247515 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:48.247482    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"]
Jul 27 19:11:48.278795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:48.278764    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt" event={"ID":"4b685c92-68eb-4647-98e2-486c03356d9f","Type":"ContainerStarted","Data":"470822307b6e68492027fd1f863cf5eced8721a93ac7c10fdfc528b528584165"}
Jul 27 19:11:49.285758 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:49.285720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt" event={"ID":"4b685c92-68eb-4647-98e2-486c03356d9f","Type":"ContainerStarted","Data":"bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83"}
Jul 27 19:11:49.286132 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:49.285786    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:11:49.304931 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:49.304856    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt" podStartSLOduration=2.30483555 podStartE2EDuration="2.30483555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:49.302340954 +0000 UTC m=+2407.385623805" watchObservedRunningTime="2026-07-27 19:11:49.30483555 +0000 UTC m=+2407.388118403"
Jul 27 19:11:54.597037 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:11:54.597000    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:12:00.294149 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:00.294108    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:12:01.299628 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:01.299591    2577 patch_prober.go:28] interesting pod/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 19:12:01.300007 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:01.299663    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:12:02.377482 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:02.377448    2577 generic.go:356] "Generic (PLEG): container finished" podID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerID="92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156" exitCode=0
Jul 27 19:12:02.377482 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:02.377467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" event={"ID":"99bcb28e-5793-464b-ba2c-3bf4e41be17b","Type":"ContainerDied","Data":"92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156"}
Jul 27 19:12:02.378079 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:02.377986    2577 scope.go:117] "RemoveContainer" containerID="92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156"
Jul 27 19:12:02.379113 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:02.379083    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:12:02.379259 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:02.379167    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:12:02.379259 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:02.379215    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:12:03.385802 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:03.385771    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" event={"ID":"99bcb28e-5793-464b-ba2c-3bf4e41be17b","Type":"ContainerStarted","Data":"e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec"}
Jul 27 19:12:04.124214 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:04.124159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:12:04.124440 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:04.124230    2577 patch_prober.go:28] interesting pod/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 27 19:12:04.124440 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:04.124293    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 27 19:12:05.123463 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:05.123386    2577 patch_prober.go:28] interesting pod/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 27 19:12:05.123988 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:05.123494    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 27 19:12:06.124174 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:06.124127    2577 patch_prober.go:28] interesting pod/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 27 19:12:06.124707 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:06.124197    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 27 19:12:06.496717 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:06.496630    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:12:07.123264 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:07.123227    2577 patch_prober.go:28] interesting pod/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 27 19:12:07.123996 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:07.123580    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 27 19:12:08.127612 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:08.127580    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:12:08.128106 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:08.128064    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:12:08.128903 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:08.128882    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:12:21.482881 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:21.482844    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:12:33.088201 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:33.088160    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:12:50.983294 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:12:50.983257    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:13:32.869387 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:32.869299    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"]
Jul 27 19:13:32.873391 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:32.873372    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"
Jul 27 19:13:32.876023 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:32.876004    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gwtlm\""
Jul 27 19:13:32.884762 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:32.884721    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"]
Jul 27 19:13:33.021477 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:33.021416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a2b3ef-9d79-4957-b1cf-f7bbe166b726-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm\" (UID: \"82a2b3ef-9d79-4957-b1cf-f7bbe166b726\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"
Jul 27 19:13:33.122094 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:33.122011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a2b3ef-9d79-4957-b1cf-f7bbe166b726-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm\" (UID: \"82a2b3ef-9d79-4957-b1cf-f7bbe166b726\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"
Jul 27 19:13:33.122694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:33.122668    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a2b3ef-9d79-4957-b1cf-f7bbe166b726-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm\" (UID: \"82a2b3ef-9d79-4957-b1cf-f7bbe166b726\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"
Jul 27 19:13:33.184577 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:33.184545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"
Jul 27 19:13:33.330493 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:33.329607    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"]
Jul 27 19:13:33.331087 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:13:33.331053    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a2b3ef_9d79_4957_b1cf_f7bbe166b726.slice/crio-123d7990f336b3f6f238debb48ab7e2ba5ab0e53bd1d2cadf01015bafdab1b05 WatchSource:0}: Error finding container 123d7990f336b3f6f238debb48ab7e2ba5ab0e53bd1d2cadf01015bafdab1b05: Status 404 returned error can't find the container with id 123d7990f336b3f6f238debb48ab7e2ba5ab0e53bd1d2cadf01015bafdab1b05
Jul 27 19:13:33.938273 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:33.938165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm" event={"ID":"82a2b3ef-9d79-4957-b1cf-f7bbe166b726","Type":"ContainerStarted","Data":"b5b847675c7a713eaa93d5f395ad54bde296dd372ae58e3e509cae688b78bf8d"}
Jul 27 19:13:33.938273 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:33.938255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm" event={"ID":"82a2b3ef-9d79-4957-b1cf-f7bbe166b726","Type":"ContainerStarted","Data":"123d7990f336b3f6f238debb48ab7e2ba5ab0e53bd1d2cadf01015bafdab1b05"}
Jul 27 19:13:33.954356 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:33.954303    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm" podStartSLOduration=1.954288697 podStartE2EDuration="1.954288697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:33.953228671 +0000 UTC m=+2512.036511516" watchObservedRunningTime="2026-07-27 19:13:33.954288697 +0000 UTC m=+2512.037571547"
Jul 27 19:13:34.947905 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:34.947871    2577 generic.go:356] "Generic (PLEG): container finished" podID="82a2b3ef-9d79-4957-b1cf-f7bbe166b726" containerID="b5b847675c7a713eaa93d5f395ad54bde296dd372ae58e3e509cae688b78bf8d" exitCode=0
Jul 27 19:13:34.948292 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:34.947945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm" event={"ID":"82a2b3ef-9d79-4957-b1cf-f7bbe166b726","Type":"ContainerDied","Data":"b5b847675c7a713eaa93d5f395ad54bde296dd372ae58e3e509cae688b78bf8d"}
Jul 27 19:13:36.089185 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:36.089161    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"
Jul 27 19:13:36.250678 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:36.250587    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a2b3ef-9d79-4957-b1cf-f7bbe166b726-maas-api-service-ca\") pod \"82a2b3ef-9d79-4957-b1cf-f7bbe166b726\" (UID: \"82a2b3ef-9d79-4957-b1cf-f7bbe166b726\") "
Jul 27 19:13:36.250966 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:36.250945    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a2b3ef-9d79-4957-b1cf-f7bbe166b726-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "82a2b3ef-9d79-4957-b1cf-f7bbe166b726" (UID: "82a2b3ef-9d79-4957-b1cf-f7bbe166b726"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:13:36.352207 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:36.352172    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a2b3ef-9d79-4957-b1cf-f7bbe166b726-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:13:36.690971 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:36.690923    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:13:36.960060 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:36.960031    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"
Jul 27 19:13:36.960249 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:36.960073    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm" event={"ID":"82a2b3ef-9d79-4957-b1cf-f7bbe166b726","Type":"ContainerDied","Data":"123d7990f336b3f6f238debb48ab7e2ba5ab0e53bd1d2cadf01015bafdab1b05"}
Jul 27 19:13:36.960249 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:36.960118    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="123d7990f336b3f6f238debb48ab7e2ba5ab0e53bd1d2cadf01015bafdab1b05"
Jul 27 19:13:44.490544 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.490498    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"]
Jul 27 19:13:44.490967 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.490706    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2" podUID="8d409b87-5692-4e3a-a5aa-c727f1586313" containerName="maas-api" containerID="cri-o://58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5" gracePeriod=30
Jul 27 19:13:44.747390 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.747330    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:13:44.834513 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.834477    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp47l\" (UniqueName: \"kubernetes.io/projected/8d409b87-5692-4e3a-a5aa-c727f1586313-kube-api-access-wp47l\") pod \"8d409b87-5692-4e3a-a5aa-c727f1586313\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") "
Jul 27 19:13:44.834702 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.834532    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls\") pod \"8d409b87-5692-4e3a-a5aa-c727f1586313\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") "
Jul 27 19:13:44.834702 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.834554    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d409b87-5692-4e3a-a5aa-c727f1586313-openshift-service-ca\") pod \"8d409b87-5692-4e3a-a5aa-c727f1586313\" (UID: \"8d409b87-5692-4e3a-a5aa-c727f1586313\") "
Jul 27 19:13:44.834962 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.834931    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d409b87-5692-4e3a-a5aa-c727f1586313-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8d409b87-5692-4e3a-a5aa-c727f1586313" (UID: "8d409b87-5692-4e3a-a5aa-c727f1586313"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:13:44.836785 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.836759    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8d409b87-5692-4e3a-a5aa-c727f1586313" (UID: "8d409b87-5692-4e3a-a5aa-c727f1586313"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:13:44.836995 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.836972    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d409b87-5692-4e3a-a5aa-c727f1586313-kube-api-access-wp47l" (OuterVolumeSpecName: "kube-api-access-wp47l") pod "8d409b87-5692-4e3a-a5aa-c727f1586313" (UID: "8d409b87-5692-4e3a-a5aa-c727f1586313"). InnerVolumeSpecName "kube-api-access-wp47l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:44.935573 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.935539    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp47l\" (UniqueName: \"kubernetes.io/projected/8d409b87-5692-4e3a-a5aa-c727f1586313-kube-api-access-wp47l\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:13:44.935573 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.935567    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d409b87-5692-4e3a-a5aa-c727f1586313-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:13:44.935573 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:44.935576    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d409b87-5692-4e3a-a5aa-c727f1586313-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:13:45.009206 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.009118    2577 generic.go:356] "Generic (PLEG): container finished" podID="8d409b87-5692-4e3a-a5aa-c727f1586313" containerID="58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5" exitCode=0
Jul 27 19:13:45.009206 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.009163    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"
Jul 27 19:13:45.009206 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.009183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2" event={"ID":"8d409b87-5692-4e3a-a5aa-c727f1586313","Type":"ContainerDied","Data":"58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5"}
Jul 27 19:13:45.009485 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.009227    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2" event={"ID":"8d409b87-5692-4e3a-a5aa-c727f1586313","Type":"ContainerDied","Data":"bed3daaead567f921c5edec6bb46e0cde132bbb2af34bffae83f8f441c798652"}
Jul 27 19:13:45.009485 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.009252    2577 scope.go:117] "RemoveContainer" containerID="58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5"
Jul 27 19:13:45.020176 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.020156    2577 scope.go:117] "RemoveContainer" containerID="58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5"
Jul 27 19:13:45.020471 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:13:45.020452    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5\": container with ID starting with 58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5 not found: ID does not exist" containerID="58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5"
Jul 27 19:13:45.020522 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.020480    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5"} err="failed to get container status \"58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5\": rpc error: code = NotFound desc = could not find container \"58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5\": container with ID starting with 58463dafc916912630ca0cba40b88481e9780d9b9fd03eb3bc5bc612f3c76cf5 not found: ID does not exist"
Jul 27 19:13:45.033974 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.033946    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"]
Jul 27 19:13:45.037718 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:45.037688    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aabc5-7576f65f5-2q7x2"]
Jul 27 19:13:46.510820 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:46.510776    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d409b87-5692-4e3a-a5aa-c727f1586313" path="/var/lib/kubelet/pods/8d409b87-5692-4e3a-a5aa-c727f1586313/volumes"
Jul 27 19:13:47.993075 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:47.993045    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"]
Jul 27 19:13:47.999889 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:47.999858    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7aabc5-q2tjm"]
Jul 27 19:13:48.515570 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:48.512795    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a2b3ef-9d79-4957-b1cf-f7bbe166b726" path="/var/lib/kubelet/pods/82a2b3ef-9d79-4957-b1cf-f7bbe166b726/volumes"
Jul 27 19:13:48.898003 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:13:48.897966    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:14:07.362148 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.362101    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"]
Jul 27 19:14:07.362756 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.362371    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt" podUID="4b685c92-68eb-4647-98e2-486c03356d9f" containerName="payload-pre-processing" containerID="cri-o://bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83" gracePeriod=30
Jul 27 19:14:07.640726 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.640702    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:14:07.751118 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.751087    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f74mc\" (UniqueName: \"kubernetes.io/projected/4b685c92-68eb-4647-98e2-486c03356d9f-kube-api-access-f74mc\") pod \"4b685c92-68eb-4647-98e2-486c03356d9f\" (UID: \"4b685c92-68eb-4647-98e2-486c03356d9f\") "
Jul 27 19:14:07.751311 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.751158    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b685c92-68eb-4647-98e2-486c03356d9f-plugins-config-volume\") pod \"4b685c92-68eb-4647-98e2-486c03356d9f\" (UID: \"4b685c92-68eb-4647-98e2-486c03356d9f\") "
Jul 27 19:14:07.751556 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.751534    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b685c92-68eb-4647-98e2-486c03356d9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b685c92-68eb-4647-98e2-486c03356d9f" (UID: "4b685c92-68eb-4647-98e2-486c03356d9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:14:07.753360 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.753338    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b685c92-68eb-4647-98e2-486c03356d9f-kube-api-access-f74mc" (OuterVolumeSpecName: "kube-api-access-f74mc") pod "4b685c92-68eb-4647-98e2-486c03356d9f" (UID: "4b685c92-68eb-4647-98e2-486c03356d9f"). InnerVolumeSpecName "kube-api-access-f74mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:14:07.852967 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.852926    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b685c92-68eb-4647-98e2-486c03356d9f-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:07.852967 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:07.852959    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f74mc\" (UniqueName: \"kubernetes.io/projected/4b685c92-68eb-4647-98e2-486c03356d9f-kube-api-access-f74mc\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:08.153730 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.153693    2577 generic.go:356] "Generic (PLEG): container finished" podID="4b685c92-68eb-4647-98e2-486c03356d9f" containerID="bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83" exitCode=0
Jul 27 19:14:08.153934 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.153742    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"
Jul 27 19:14:08.153934 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.153785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt" event={"ID":"4b685c92-68eb-4647-98e2-486c03356d9f","Type":"ContainerDied","Data":"bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83"}
Jul 27 19:14:08.153934 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.153849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt" event={"ID":"4b685c92-68eb-4647-98e2-486c03356d9f","Type":"ContainerDied","Data":"470822307b6e68492027fd1f863cf5eced8721a93ac7c10fdfc528b528584165"}
Jul 27 19:14:08.153934 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.153881    2577 scope.go:117] "RemoveContainer" containerID="bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83"
Jul 27 19:14:08.164273 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.164254    2577 scope.go:117] "RemoveContainer" containerID="bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83"
Jul 27 19:14:08.164580 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:14:08.164562    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83\": container with ID starting with bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83 not found: ID does not exist" containerID="bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83"
Jul 27 19:14:08.164661 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.164592    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83"} err="failed to get container status \"bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83\": rpc error: code = NotFound desc = could not find container \"bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83\": container with ID starting with bf51920834b19a6eafb8ef31fdbc8b5f52d0f5a8242eba4af55fdb6fb7047d83 not found: ID does not exist"
Jul 27 19:14:08.192023 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.191994    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"]
Jul 27 19:14:08.200328 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.200298    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-954977-6c8cb7b8cb-dcddt"]
Jul 27 19:14:08.511828 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:08.511737    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b685c92-68eb-4647-98e2-486c03356d9f" path="/var/lib/kubelet/pods/4b685c92-68eb-4647-98e2-486c03356d9f/volumes"
Jul 27 19:14:10.293631 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:10.293595    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:14:18.618787 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:18.618746    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"]
Jul 27 19:14:18.619271 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:18.619027    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy" containerID="cri-o://e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec" gracePeriod=30
Jul 27 19:14:23.130825 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.130788    2577 patch_prober.go:28] interesting pod/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:14:23.131184 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.130862    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:14:23.690135 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690102    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"]
Jul 27 19:14:23.690546 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690533    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b685c92-68eb-4647-98e2-486c03356d9f" containerName="payload-pre-processing"
Jul 27 19:14:23.690601 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690548    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b685c92-68eb-4647-98e2-486c03356d9f" containerName="payload-pre-processing"
Jul 27 19:14:23.690601 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690562    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d409b87-5692-4e3a-a5aa-c727f1586313" containerName="maas-api"
Jul 27 19:14:23.690601 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690568    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d409b87-5692-4e3a-a5aa-c727f1586313" containerName="maas-api"
Jul 27 19:14:23.690601 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690574    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a2b3ef-9d79-4957-b1cf-f7bbe166b726" containerName="revoke-keys"
Jul 27 19:14:23.690601 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690579    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a2b3ef-9d79-4957-b1cf-f7bbe166b726" containerName="revoke-keys"
Jul 27 19:14:23.690754 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690649    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a2b3ef-9d79-4957-b1cf-f7bbe166b726" containerName="revoke-keys"
Jul 27 19:14:23.690754 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690660    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b685c92-68eb-4647-98e2-486c03356d9f" containerName="payload-pre-processing"
Jul 27 19:14:23.690754 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.690668    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d409b87-5692-4e3a-a5aa-c727f1586313" containerName="maas-api"
Jul 27 19:14:23.693780 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.693763    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:23.696979 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.696956    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-cad7f7-dockercfg-tlwd5\""
Jul 27 19:14:23.697409 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.697394    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-cad7f7\""
Jul 27 19:14:23.707210 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.707188    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"]
Jul 27 19:14:23.803133 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.803104    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pwq6\" (UniqueName: \"kubernetes.io/projected/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-kube-api-access-5pwq6\") pod \"payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f\" (UID: \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:23.803310 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.803283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f\" (UID: \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:23.881967 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.881911    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:14:23.904838 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.904815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f\" (UID: \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:23.904928 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.904869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pwq6\" (UniqueName: \"kubernetes.io/projected/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-kube-api-access-5pwq6\") pod \"payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f\" (UID: \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:23.905477 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.905459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f\" (UID: \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:23.922805 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:23.922773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pwq6\" (UniqueName: \"kubernetes.io/projected/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-kube-api-access-5pwq6\") pod \"payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f\" (UID: \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\") " pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:24.005941 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.005909    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98tkd\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-kube-api-access-98tkd\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006120 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.005963    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-podinfo\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006120 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.005983    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-credential-socket\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006120 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006004    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istiod-ca-cert\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006120 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006024    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-socket\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006120 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006046    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-token\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006120 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006071    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-envoy\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006468 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006149    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-certs\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006468 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006187    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-data\") pod \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\" (UID: \"99bcb28e-5793-464b-ba2c-3bf4e41be17b\") "
Jul 27 19:14:24.006468 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006270    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:24.006647 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006502    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:14:24.006647 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006620    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.006763 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006745    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.006763 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006679    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:24.006875 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.006781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:24.007132 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.007073    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-data" (OuterVolumeSpecName: "istio-data") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:24.008341 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.008319    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-kube-api-access-98tkd" (OuterVolumeSpecName: "kube-api-access-98tkd") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "kube-api-access-98tkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:14:24.008704 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.008682    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-token" (OuterVolumeSpecName: "istio-token") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:14:24.008907 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.008891    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:14:24.008968 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.008886    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99bcb28e-5793-464b-ba2c-3bf4e41be17b" (UID: "99bcb28e-5793-464b-ba2c-3bf4e41be17b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:24.016104 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.016084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:24.107359 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.107305    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.107359 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.107339    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98tkd\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-kube-api-access-98tkd\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.107359 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.107356    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.107587 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.107368    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.107587 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.107380    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.107587 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.107391    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.107587 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.107402    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99bcb28e-5793-464b-ba2c-3bf4e41be17b-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:14:24.174978 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.174951    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"]
Jul 27 19:14:24.176186 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:14:24.176153    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92a4d1c_fe64_4f16_a459_7e0a0f2b80e3.slice/crio-6a121a8fc223d30fb5cedbd9c9b55555c994dc8c0ba53c836b6cb9bc423bfd4e WatchSource:0}: Error finding container 6a121a8fc223d30fb5cedbd9c9b55555c994dc8c0ba53c836b6cb9bc423bfd4e: Status 404 returned error can't find the container with id 6a121a8fc223d30fb5cedbd9c9b55555c994dc8c0ba53c836b6cb9bc423bfd4e
Jul 27 19:14:24.261845 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.261809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f" event={"ID":"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3","Type":"ContainerStarted","Data":"fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c"}
Jul 27 19:14:24.262031 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.261875    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f" event={"ID":"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3","Type":"ContainerStarted","Data":"6a121a8fc223d30fb5cedbd9c9b55555c994dc8c0ba53c836b6cb9bc423bfd4e"}
Jul 27 19:14:24.262031 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.262001    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:24.263745 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.263717    2577 generic.go:356] "Generic (PLEG): container finished" podID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerID="e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec" exitCode=0
Jul 27 19:14:24.263868 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.263746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" event={"ID":"99bcb28e-5793-464b-ba2c-3bf4e41be17b","Type":"ContainerDied","Data":"e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec"}
Jul 27 19:14:24.263868 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.263805    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"
Jul 27 19:14:24.263868 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.263821    2577 scope.go:117] "RemoveContainer" containerID="e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec"
Jul 27 19:14:24.264041 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.263805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl" event={"ID":"99bcb28e-5793-464b-ba2c-3bf4e41be17b","Type":"ContainerDied","Data":"3cddff0613cd0e189d5aed9c81a1d21e60b45692423a63ae5bdb767baa6226b6"}
Jul 27 19:14:24.274600 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.274580    2577 scope.go:117] "RemoveContainer" containerID="92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156"
Jul 27 19:14:24.281396 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.281353    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f" podStartSLOduration=1.281337754 podStartE2EDuration="1.281337754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:24.278953196 +0000 UTC m=+2562.362236051" watchObservedRunningTime="2026-07-27 19:14:24.281337754 +0000 UTC m=+2562.364620605"
Jul 27 19:14:24.284330 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.284310    2577 scope.go:117] "RemoveContainer" containerID="e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec"
Jul 27 19:14:24.284667 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:14:24.284647    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec\": container with ID starting with e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec not found: ID does not exist" containerID="e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec"
Jul 27 19:14:24.284734 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.284677    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec"} err="failed to get container status \"e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec\": rpc error: code = NotFound desc = could not find container \"e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec\": container with ID starting with e4f6ba8a014095de96847d9dc209f96645ab722da43e40c51de0f4ee4ae8c9ec not found: ID does not exist"
Jul 27 19:14:24.284734 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.284696    2577 scope.go:117] "RemoveContainer" containerID="92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156"
Jul 27 19:14:24.284967 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:14:24.284948    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156\": container with ID starting with 92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156 not found: ID does not exist" containerID="92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156"
Jul 27 19:14:24.285035 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.284973    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156"} err="failed to get container status \"92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156\": rpc error: code = NotFound desc = could not find container \"92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156\": container with ID starting with 92999d39166c13ed2f8de581e212cc0cdf117b1ed19a19b35773f30223e49156 not found: ID does not exist"
Jul 27 19:14:24.299382 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.299348    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"]
Jul 27 19:14:24.304606 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.304577    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-954977-openshift-default-ffdc9896b-r64rl"]
Jul 27 19:14:24.512107 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:24.512032    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" path="/var/lib/kubelet/pods/99bcb28e-5793-464b-ba2c-3bf4e41be17b/volumes"
Jul 27 19:14:27.918312 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.918280    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"]
Jul 27 19:14:27.918733 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.918720    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy"
Jul 27 19:14:27.918779 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.918735    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy"
Jul 27 19:14:27.918779 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.918754    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy"
Jul 27 19:14:27.918779 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.918759    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy"
Jul 27 19:14:27.918868 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.918821    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy"
Jul 27 19:14:27.918868 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.918828    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="99bcb28e-5793-464b-ba2c-3bf4e41be17b" containerName="istio-proxy"
Jul 27 19:14:27.923408 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.923387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:27.931378 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.931359    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5b0fac-openshift-default-dockercfg-w84bp\""
Jul 27 19:14:27.956098 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:27.956065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"]
Jul 27 19:14:28.041757 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.041726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-token\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.041942 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.041768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-envoy\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.041942 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.041791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-credential-socket\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.041942 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.041812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-podinfo\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.041942 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.041924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-certs\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.042152 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.041973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-data\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.042152 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.042080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxl8s\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-kube-api-access-mxl8s\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.042152 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.042131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-socket\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.042286 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.042161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istiod-ca-cert\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143083 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-certs\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143245 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-data\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143245 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxl8s\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-kube-api-access-mxl8s\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143245 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-socket\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143245 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istiod-ca-cert\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143245 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-token\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143584 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-envoy\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143584 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-credential-socket\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143584 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-podinfo\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143584 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-certs\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143768 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-data\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143885 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-socket\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.143940 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.143911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-credential-socket\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.144024 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.144004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istiod-ca-cert\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.145790 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.145768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-envoy\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.145910 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.145894    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-podinfo\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.157492 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.157467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-token\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.157595 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.157581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxl8s\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-kube-api-access-mxl8s\") pod \"e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") " pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.235157 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.235082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:28.395945 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.395921    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"]
Jul 27 19:14:28.397082 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:14:28.397057    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33cf4856_1e7f_4fd7_a37d_7255d1663c0e.slice/crio-d73eda5d4adeb3ab7dfc91f712e3cbdd13a571838158fa2fc663ba7ff26a6da6 WatchSource:0}: Error finding container d73eda5d4adeb3ab7dfc91f712e3cbdd13a571838158fa2fc663ba7ff26a6da6: Status 404 returned error can't find the container with id d73eda5d4adeb3ab7dfc91f712e3cbdd13a571838158fa2fc663ba7ff26a6da6
Jul 27 19:14:28.399280 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.399253    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:14:28.399341 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.399314    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:14:28.399377 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:28.399341    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:14:29.299078 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:29.299042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" event={"ID":"33cf4856-1e7f-4fd7-a37d-7255d1663c0e","Type":"ContainerStarted","Data":"6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9"}
Jul 27 19:14:29.299554 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:29.299103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" event={"ID":"33cf4856-1e7f-4fd7-a37d-7255d1663c0e","Type":"ContainerStarted","Data":"d73eda5d4adeb3ab7dfc91f712e3cbdd13a571838158fa2fc663ba7ff26a6da6"}
Jul 27 19:14:29.336886 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:29.336827    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" podStartSLOduration=2.336809341 podStartE2EDuration="2.336809341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:29.334260223 +0000 UTC m=+2567.417543075" watchObservedRunningTime="2026-07-27 19:14:29.336809341 +0000 UTC m=+2567.420092191"
Jul 27 19:14:30.138350 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:30.138312    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:14:30.236109 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:30.236074    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:30.241333 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:30.241310    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:30.306026 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:30.305996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:30.307021 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:30.307002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:33.140738 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.140702    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"]
Jul 27 19:14:33.145753 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.145736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:33.151223 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.151201    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5b0fac\""
Jul 27 19:14:33.171696 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.171664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"]
Jul 27 19:14:33.294384 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.294344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs\" (UID: \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:33.294580 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.294409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sk9b\" (UniqueName: \"kubernetes.io/projected/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-kube-api-access-2sk9b\") pod \"payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs\" (UID: \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:33.395266 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.395185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs\" (UID: \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:33.395266 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.395242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sk9b\" (UniqueName: \"kubernetes.io/projected/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-kube-api-access-2sk9b\") pod \"payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs\" (UID: \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:33.395918 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.395896    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs\" (UID: \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:33.422261 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.422230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sk9b\" (UniqueName: \"kubernetes.io/projected/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-kube-api-access-2sk9b\") pod \"payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs\" (UID: \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:33.457300 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.457270    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:33.613931 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:33.613900    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"]
Jul 27 19:14:33.615150 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:14:33.615115    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1f7692_d9fa_4bdc_8ca5_147e9bd0ee65.slice/crio-007d5f40ff99fab382ecb7e01cdbd5708b9c242b2e00f066e42073346133dfbd WatchSource:0}: Error finding container 007d5f40ff99fab382ecb7e01cdbd5708b9c242b2e00f066e42073346133dfbd: Status 404 returned error can't find the container with id 007d5f40ff99fab382ecb7e01cdbd5708b9c242b2e00f066e42073346133dfbd
Jul 27 19:14:34.331629 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:34.331590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs" event={"ID":"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65","Type":"ContainerStarted","Data":"cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e"}
Jul 27 19:14:34.332055 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:34.331654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs" event={"ID":"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65","Type":"ContainerStarted","Data":"007d5f40ff99fab382ecb7e01cdbd5708b9c242b2e00f066e42073346133dfbd"}
Jul 27 19:14:34.332055 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:34.331692    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:34.352966 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:34.352915    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs" podStartSLOduration=1.352894615 podStartE2EDuration="1.352894615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:34.352857901 +0000 UTC m=+2572.436140768" watchObservedRunningTime="2026-07-27 19:14:34.352894615 +0000 UTC m=+2572.436177466"
Jul 27 19:14:35.275296 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:35.275265    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:14:43.696097 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:43.696058    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:14:45.341062 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:45.341024    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:14:45.674579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:45.674370    2577 patch_prober.go:28] interesting pod/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": read tcp 10.134.0.2:54062->10.134.0.75:15021: read: connection reset by peer" start-of-body=
Jul 27 19:14:45.674579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:45.674450    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": read tcp 10.134.0.2:54062->10.134.0.75:15021: read: connection reset by peer"
Jul 27 19:14:46.405174 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:46.405140    2577 generic.go:356] "Generic (PLEG): container finished" podID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerID="6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9" exitCode=0
Jul 27 19:14:46.405568 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:46.405219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" event={"ID":"33cf4856-1e7f-4fd7-a37d-7255d1663c0e","Type":"ContainerDied","Data":"6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9"}
Jul 27 19:14:46.405658 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:46.405642    2577 scope.go:117] "RemoveContainer" containerID="6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9"
Jul 27 19:14:46.406656 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:46.406630    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:14:46.406718 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:46.406695    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:14:46.406754 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:46.406725    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:14:47.412404 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:47.412368    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" event={"ID":"33cf4856-1e7f-4fd7-a37d-7255d1663c0e","Type":"ContainerStarted","Data":"aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717"}
Jul 27 19:14:48.235918 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:48.235875    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:48.236223 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:48.235926    2577 patch_prober.go:28] interesting pod/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 27 19:14:48.236403 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:48.236381    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 27 19:14:49.236356 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:49.236318    2577 patch_prober.go:28] interesting pod/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 27 19:14:49.237033 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:49.237001    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 27 19:14:50.235974 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:50.235934    2577 patch_prober.go:28] interesting pod/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 27 19:14:50.236275 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:50.236247    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 27 19:14:51.236379 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:51.236346    2577 patch_prober.go:28] interesting pod/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 27 19:14:51.236816 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:51.236453    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 27 19:14:52.239619 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:52.239583    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:52.240094 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:52.239913    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:14:52.240881 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:14:52.240862    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:15:00.414698 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.414663    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"]
Jul 27 19:15:00.415116 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.414869    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f" podUID="e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3" containerName="payload-processing" containerID="cri-o://fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c" gracePeriod=30
Jul 27 19:15:00.671028 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.670963    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:15:00.752358 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.752305    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pwq6\" (UniqueName: \"kubernetes.io/projected/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-kube-api-access-5pwq6\") pod \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\" (UID: \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\") "
Jul 27 19:15:00.752613 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.752409    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-plugins-config-volume\") pod \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\" (UID: \"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3\") "
Jul 27 19:15:00.752800 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.752775    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3" (UID: "e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:15:00.754574 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.754539    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-kube-api-access-5pwq6" (OuterVolumeSpecName: "kube-api-access-5pwq6") pod "e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3" (UID: "e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3"). InnerVolumeSpecName "kube-api-access-5pwq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:00.853307 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.853274    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pwq6\" (UniqueName: \"kubernetes.io/projected/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-kube-api-access-5pwq6\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:00.853307 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:00.853300    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:01.502137 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.502102    2577 generic.go:356] "Generic (PLEG): container finished" podID="e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3" containerID="fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c" exitCode=0
Jul 27 19:15:01.502608 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.502170    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"
Jul 27 19:15:01.502608 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.502176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f" event={"ID":"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3","Type":"ContainerDied","Data":"fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c"}
Jul 27 19:15:01.502608 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.502256    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f" event={"ID":"e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3","Type":"ContainerDied","Data":"6a121a8fc223d30fb5cedbd9c9b55555c994dc8c0ba53c836b6cb9bc423bfd4e"}
Jul 27 19:15:01.502608 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.502286    2577 scope.go:117] "RemoveContainer" containerID="fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c"
Jul 27 19:15:01.512266 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.512241    2577 scope.go:117] "RemoveContainer" containerID="fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c"
Jul 27 19:15:01.512561 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:15:01.512531    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c\": container with ID starting with fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c not found: ID does not exist" containerID="fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c"
Jul 27 19:15:01.512644 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.512570    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c"} err="failed to get container status \"fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c\": rpc error: code = NotFound desc = could not find container \"fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c\": container with ID starting with fd0115417b444668facf80bff6da6304d3d9a90bc10a6ae221b4d686c3cf156c not found: ID does not exist"
Jul 27 19:15:01.526937 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.526903    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"]
Jul 27 19:15:01.531954 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:01.531926    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-cad7f7-77674f44c6-zj42f"]
Jul 27 19:15:02.512123 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:02.512050    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3" path="/var/lib/kubelet/pods/e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3/volumes"
Jul 27 19:15:03.392564 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:03.392523    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:15:27.583197 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:27.583157    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"]
Jul 27 19:15:27.583702 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:27.583471    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs" podUID="aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65" containerName="payload-pre-processing" containerID="cri-o://cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e" gracePeriod=30
Jul 27 19:15:27.859797 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:27.859771    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:15:28.011677 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.011642    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-plugins-config-volume\") pod \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\" (UID: \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\") "
Jul 27 19:15:28.011860 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.011692    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sk9b\" (UniqueName: \"kubernetes.io/projected/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-kube-api-access-2sk9b\") pod \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\" (UID: \"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65\") "
Jul 27 19:15:28.012070 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.012047    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65" (UID: "aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:15:28.013943 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.013916    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-kube-api-access-2sk9b" (OuterVolumeSpecName: "kube-api-access-2sk9b") pod "aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65" (UID: "aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65"). InnerVolumeSpecName "kube-api-access-2sk9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:28.113156 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.113079    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:28.113156 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.113108    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sk9b\" (UniqueName: \"kubernetes.io/projected/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65-kube-api-access-2sk9b\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:28.672995 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.672961    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65" containerID="cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e" exitCode=0
Jul 27 19:15:28.673505 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.673019    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"
Jul 27 19:15:28.673505 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.673053    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs" event={"ID":"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65","Type":"ContainerDied","Data":"cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e"}
Jul 27 19:15:28.673505 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.673114    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs" event={"ID":"aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65","Type":"ContainerDied","Data":"007d5f40ff99fab382ecb7e01cdbd5708b9c242b2e00f066e42073346133dfbd"}
Jul 27 19:15:28.673505 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.673137    2577 scope.go:117] "RemoveContainer" containerID="cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e"
Jul 27 19:15:28.682289 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.682271    2577 scope.go:117] "RemoveContainer" containerID="cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e"
Jul 27 19:15:28.682580 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:15:28.682558    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e\": container with ID starting with cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e not found: ID does not exist" containerID="cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e"
Jul 27 19:15:28.682660 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.682591    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e"} err="failed to get container status \"cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e\": rpc error: code = NotFound desc = could not find container \"cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e\": container with ID starting with cb702205e3b17023af69f3006af467273c58c2c0b968038291a81685df972d0e not found: ID does not exist"
Jul 27 19:15:28.692121 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.692096    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"]
Jul 27 19:15:28.698381 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:28.698360    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5b0fac-6d6774c564-hltqs"]
Jul 27 19:15:30.510939 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:30.510905    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65" path="/var/lib/kubelet/pods/aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65/volumes"
Jul 27 19:15:32.395354 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:32.395320    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:15:38.672136 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:38.672103    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"]
Jul 27 19:15:38.672622 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:38.672323    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy" containerID="cri-o://aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717" gracePeriod=30
Jul 27 19:15:42.791568 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:42.791539    2577 scope.go:117] "RemoveContainer" containerID="d95c22e2689c3c5e685ae58c42a65f91f6af67dcf5340749967c4f39b5c64c03"
Jul 27 19:15:43.937627 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.937560    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968543    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-data\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-certs\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968642    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istiod-ca-cert\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968701    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-podinfo\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968732    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-socket\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968802    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxl8s\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-kube-api-access-mxl8s\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968847    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-token\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968892    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-credential-socket\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.969694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.968935    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-envoy\") pod \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\" (UID: \"33cf4856-1e7f-4fd7-a37d-7255d1663c0e\") "
Jul 27 19:15:43.971131 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.971099    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:43.971388 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.971358    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:15:43.972319 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.972216    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:43.972319 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.972245    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:43.972876 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.972689    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:43.973113 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.973060    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:43.974035 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.974010    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:15:43.974119 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.974023    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:43.974119 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:43.974105    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-kube-api-access-mxl8s" (OuterVolumeSpecName: "kube-api-access-mxl8s") pod "33cf4856-1e7f-4fd7-a37d-7255d1663c0e" (UID: "33cf4856-1e7f-4fd7-a37d-7255d1663c0e"). InnerVolumeSpecName "kube-api-access-mxl8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:44.070028 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.069998    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.070028 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.070024    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.070028 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.070034    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.070263 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.070041    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.070263 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.070049    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.070263 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.070058    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxl8s\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-kube-api-access-mxl8s\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.070263 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.070067    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.070263 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.070076    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.070263 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.070083    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33cf4856-1e7f-4fd7-a37d-7255d1663c0e-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:15:44.771510 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.771387    2577 generic.go:356] "Generic (PLEG): container finished" podID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerID="aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717" exitCode=0
Jul 27 19:15:44.771510 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.771481    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"
Jul 27 19:15:44.771759 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.771475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" event={"ID":"33cf4856-1e7f-4fd7-a37d-7255d1663c0e","Type":"ContainerDied","Data":"aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717"}
Jul 27 19:15:44.771759 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.771606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl" event={"ID":"33cf4856-1e7f-4fd7-a37d-7255d1663c0e","Type":"ContainerDied","Data":"d73eda5d4adeb3ab7dfc91f712e3cbdd13a571838158fa2fc663ba7ff26a6da6"}
Jul 27 19:15:44.771759 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.771642    2577 scope.go:117] "RemoveContainer" containerID="aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717"
Jul 27 19:15:44.780886 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.780871    2577 scope.go:117] "RemoveContainer" containerID="6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9"
Jul 27 19:15:44.789305 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.789291    2577 scope.go:117] "RemoveContainer" containerID="aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717"
Jul 27 19:15:44.789622 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:15:44.789605    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717\": container with ID starting with aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717 not found: ID does not exist" containerID="aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717"
Jul 27 19:15:44.789677 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.789629    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717"} err="failed to get container status \"aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717\": rpc error: code = NotFound desc = could not find container \"aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717\": container with ID starting with aa7e88754cedaab62630fe4565106a4673e7c8e66ee04fa20418b98642619717 not found: ID does not exist"
Jul 27 19:15:44.789677 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.789644    2577 scope.go:117] "RemoveContainer" containerID="6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9"
Jul 27 19:15:44.789888 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:15:44.789872    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9\": container with ID starting with 6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9 not found: ID does not exist" containerID="6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9"
Jul 27 19:15:44.789933 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.789893    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9"} err="failed to get container status \"6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9\": rpc error: code = NotFound desc = could not find container \"6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9\": container with ID starting with 6f404db98b55d5b3c75a01888fc18342631d01ac8831b478ba1c1057416510e9 not found: ID does not exist"
Jul 27 19:15:44.802751 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.802724    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"]
Jul 27 19:15:44.814044 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:44.814024    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5b0fac-openshift-default-84fcd5888d-4lpwl"]
Jul 27 19:15:46.510924 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:46.510880    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" path="/var/lib/kubelet/pods/33cf4856-1e7f-4fd7-a37d-7255d1663c0e/volumes"
Jul 27 19:15:47.971960 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.971920    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"]
Jul 27 19:15:47.972371 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972348    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy"
Jul 27 19:15:47.972371 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972360    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy"
Jul 27 19:15:47.972486 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972375    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy"
Jul 27 19:15:47.972486 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972381    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy"
Jul 27 19:15:47.972486 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972388    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65" containerName="payload-pre-processing"
Jul 27 19:15:47.972486 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972394    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65" containerName="payload-pre-processing"
Jul 27 19:15:47.972486 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972411    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3" containerName="payload-processing"
Jul 27 19:15:47.972486 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972416    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3" containerName="payload-processing"
Jul 27 19:15:47.972696 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972498    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92a4d1c-fe64-4f16-a459-7e0a0f2b80e3" containerName="payload-processing"
Jul 27 19:15:47.972696 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972508    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy"
Jul 27 19:15:47.972696 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972513    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="33cf4856-1e7f-4fd7-a37d-7255d1663c0e" containerName="istio-proxy"
Jul 27 19:15:47.972696 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.972521    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1f7692-d9fa-4bdc-8ca5-147e9bd0ee65" containerName="payload-pre-processing"
Jul 27 19:15:47.975711 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.975695    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:47.980487 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.980463    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ab99e9-openshift-default-dockercfg-f9ks5\""
Jul 27 19:15:47.990827 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:47.990803    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"]
Jul 27 19:15:48.109599 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-data\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.109795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqjd5\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-kube-api-access-qqjd5\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.109795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-credential-socket\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.109795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-socket\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.109795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-token\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.109795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-certs\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.109795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-podinfo\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.109795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istiod-ca-cert\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.109795 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.109794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-envoy\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211048 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-data\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211219 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqjd5\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-kube-api-access-qqjd5\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211219 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-credential-socket\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211219 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-socket\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211219 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-token\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211219 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-certs\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211549 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-podinfo\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211549 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istiod-ca-cert\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211549 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-envoy\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211549 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-data\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211734 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211567    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-certs\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211734 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-credential-socket\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.211819 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.211802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-socket\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.212052 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.212036    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istiod-ca-cert\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.213688 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.213668    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-envoy\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.213913 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.213890    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-podinfo\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.219406 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.219379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-token\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.219570 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.219552    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqjd5\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-kube-api-access-qqjd5\") pod \"e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") " pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.286996 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.286894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:48.432039 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.432014    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"]
Jul 27 19:15:48.434077 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:15:48.434049    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119f40fe_a8dc_4f4f_8e70_b05af9b107ec.slice/crio-9f22bb887d257d61f3d477c6e82d9fb8b0b7ab994fad419f0b6a54ce141e6b37 WatchSource:0}: Error finding container 9f22bb887d257d61f3d477c6e82d9fb8b0b7ab994fad419f0b6a54ce141e6b37: Status 404 returned error can't find the container with id 9f22bb887d257d61f3d477c6e82d9fb8b0b7ab994fad419f0b6a54ce141e6b37
Jul 27 19:15:48.436179 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.436145    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:15:48.436268 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.436212    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:15:48.436268 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.436240    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:15:48.797310 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.797262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" event={"ID":"119f40fe-a8dc-4f4f-8e70-b05af9b107ec","Type":"ContainerStarted","Data":"08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7"}
Jul 27 19:15:48.797547 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.797333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" event={"ID":"119f40fe-a8dc-4f4f-8e70-b05af9b107ec","Type":"ContainerStarted","Data":"9f22bb887d257d61f3d477c6e82d9fb8b0b7ab994fad419f0b6a54ce141e6b37"}
Jul 27 19:15:48.820485 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:48.820416    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" podStartSLOduration=1.820400107 podStartE2EDuration="1.820400107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:48.817883159 +0000 UTC m=+2646.901166012" watchObservedRunningTime="2026-07-27 19:15:48.820400107 +0000 UTC m=+2646.903682952"
Jul 27 19:15:49.287098 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:49.287061    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:49.292130 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:49.292104    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:49.803111 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:49.803074    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:49.804074 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:49.804055    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:15:50.479246 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:50.479210    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:15:50.927251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:50.927212    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"]
Jul 27 19:15:50.931205 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:50.931182    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:50.933899 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:50.933870    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-ab99e9-serving-cert\""
Jul 27 19:15:50.934033 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:50.934013    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5c8w7\""
Jul 27 19:15:50.934136 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:50.934113    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:15:50.934895 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:50.934873    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:15:50.940980 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:50.940960    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"]
Jul 27 19:15:51.041210 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.041177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fffd963-aba1-4f30-ba8b-826451c7760c-maas-api-tls\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.041210 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.041213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fffd963-aba1-4f30-ba8b-826451c7760c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.041446 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.041343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9dqr\" (UniqueName: \"kubernetes.io/projected/2fffd963-aba1-4f30-ba8b-826451c7760c-kube-api-access-p9dqr\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.142896 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.142857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9dqr\" (UniqueName: \"kubernetes.io/projected/2fffd963-aba1-4f30-ba8b-826451c7760c-kube-api-access-p9dqr\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.143082 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.142958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fffd963-aba1-4f30-ba8b-826451c7760c-maas-api-tls\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.143082 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.142992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fffd963-aba1-4f30-ba8b-826451c7760c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.143682 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.143663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fffd963-aba1-4f30-ba8b-826451c7760c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.145468 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.145447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fffd963-aba1-4f30-ba8b-826451c7760c-maas-api-tls\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.151611 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.151587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9dqr\" (UniqueName: \"kubernetes.io/projected/2fffd963-aba1-4f30-ba8b-826451c7760c-kube-api-access-p9dqr\") pod \"maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.243981 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.243895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:51.390954 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.390912    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"]
Jul 27 19:15:51.392008 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:15:51.391983    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fffd963_aba1_4f30_ba8b_826451c7760c.slice/crio-cad6e2ed414de30a812b97e145d985c7c6b97294bc6a60845cc14f5fe9fa6d7d WatchSource:0}: Error finding container cad6e2ed414de30a812b97e145d985c7c6b97294bc6a60845cc14f5fe9fa6d7d: Status 404 returned error can't find the container with id cad6e2ed414de30a812b97e145d985c7c6b97294bc6a60845cc14f5fe9fa6d7d
Jul 27 19:15:51.630113 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.630075    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"]
Jul 27 19:15:51.635362 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.635341    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:51.638027 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.638002    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-ab99e9-dockercfg-zkqr4\""
Jul 27 19:15:51.638219 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.638200    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-ab99e9\""
Jul 27 19:15:51.648696 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.648672    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"]
Jul 27 19:15:51.749392 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.749358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqmht\" (UniqueName: \"kubernetes.io/projected/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-kube-api-access-sqmht\") pod \"payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh\" (UID: \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:51.749665 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.749401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh\" (UID: \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:51.816187 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.816151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn" event={"ID":"2fffd963-aba1-4f30-ba8b-826451c7760c","Type":"ContainerStarted","Data":"cad6e2ed414de30a812b97e145d985c7c6b97294bc6a60845cc14f5fe9fa6d7d"}
Jul 27 19:15:51.850131 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.850108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqmht\" (UniqueName: \"kubernetes.io/projected/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-kube-api-access-sqmht\") pod \"payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh\" (UID: \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:51.850222 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.850137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh\" (UID: \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:51.850812 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.850795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh\" (UID: \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:51.860885 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.860865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqmht\" (UniqueName: \"kubernetes.io/projected/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-kube-api-access-sqmht\") pod \"payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh\" (UID: \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:51.948471 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:51.948421    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:52.097233 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:52.097202    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"]
Jul 27 19:15:52.098645 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:15:52.098624    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65008e59_5357_40b8_ba5c_c5ba1f51eaa1.slice/crio-dd4fb31730d9b98ebad20aed8b318d51b05f3f51b5cd722e851b11f9db58bd0d WatchSource:0}: Error finding container dd4fb31730d9b98ebad20aed8b318d51b05f3f51b5cd722e851b11f9db58bd0d: Status 404 returned error can't find the container with id dd4fb31730d9b98ebad20aed8b318d51b05f3f51b5cd722e851b11f9db58bd0d
Jul 27 19:15:52.831968 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:52.831923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn" event={"ID":"2fffd963-aba1-4f30-ba8b-826451c7760c","Type":"ContainerStarted","Data":"62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d"}
Jul 27 19:15:52.832658 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:52.832633    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:15:52.834207 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:52.834178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh" event={"ID":"65008e59-5357-40b8-ba5c-c5ba1f51eaa1","Type":"ContainerStarted","Data":"0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48"}
Jul 27 19:15:52.834321 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:52.834223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh" event={"ID":"65008e59-5357-40b8-ba5c-c5ba1f51eaa1","Type":"ContainerStarted","Data":"dd4fb31730d9b98ebad20aed8b318d51b05f3f51b5cd722e851b11f9db58bd0d"}
Jul 27 19:15:52.834396 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:52.834335    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:15:52.851649 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:52.851599    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn" podStartSLOduration=2.41947163 podStartE2EDuration="2.851571817s" totalImagesPullingTime="432.100187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:52.850373288 +0000 UTC m=+2650.933656140" watchObservedRunningTime="2026-07-27 19:15:52.851571817 +0000 UTC m=+2650.934854668"
Jul 27 19:15:52.868766 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:52.868718    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh" podStartSLOduration=1.868703834 podStartE2EDuration="1.868703834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:52.866533951 +0000 UTC m=+2650.949816814" watchObservedRunningTime="2026-07-27 19:15:52.868703834 +0000 UTC m=+2650.951986684"
Jul 27 19:15:59.852466 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:15:59.852407    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:16:03.481331 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:03.481286    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:16:03.842986 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:03.842959    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:16:05.321007 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:05.320970    2577 patch_prober.go:28] interesting pod/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": read tcp 10.134.0.2:52432->10.134.0.77:15021: read: connection reset by peer" start-of-body=
Jul 27 19:16:05.321484 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:05.321028    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": read tcp 10.134.0.2:52432->10.134.0.77:15021: read: connection reset by peer"
Jul 27 19:16:05.915664 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:05.915628    2577 generic.go:356] "Generic (PLEG): container finished" podID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerID="08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7" exitCode=0
Jul 27 19:16:05.915849 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:05.915708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" event={"ID":"119f40fe-a8dc-4f4f-8e70-b05af9b107ec","Type":"ContainerDied","Data":"08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7"}
Jul 27 19:16:05.916143 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:05.916129    2577 scope.go:117] "RemoveContainer" containerID="08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7"
Jul 27 19:16:05.917176 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:05.917151    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:16:05.917239 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:05.917216    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:16:05.917275 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:05.917247    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 19:16:06.923743 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:06.923700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" event={"ID":"119f40fe-a8dc-4f4f-8e70-b05af9b107ec","Type":"ContainerStarted","Data":"ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a"}
Jul 27 19:16:07.287588 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:07.287494    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:16:07.287784 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:07.287763    2577 patch_prober.go:28] interesting pod/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:16:07.287832 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:07.287812    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 27 19:16:08.287777 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:08.287741    2577 patch_prober.go:28] interesting pod/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:16:08.288164 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:08.287827    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 27 19:16:09.287488 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:09.287411    2577 patch_prober.go:28] interesting pod/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:16:09.287669 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:09.287507    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 27 19:16:10.287862 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:10.287823    2577 patch_prober.go:28] interesting pod/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:16:10.288332 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:10.287892    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 27 19:16:11.290807 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:11.290779    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:16:11.291237 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:11.291041    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:16:11.291740 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:11.291718    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:16:13.889583 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:13.889544    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:16:41.712671 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:16:41.712628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:17:06.993760 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:17:06.993727    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:17:32.809496 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:17:32.809454    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:17:51.297458 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:17:51.297414    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:18:14.697104 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:18:14.697016    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:18:31.400063 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:18:31.400028    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:18:58.318002 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:18:58.317964    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:19:16.295678 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:19:16.295640    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:19:42.856948 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:19:42.856871    2577 scope.go:117] "RemoveContainer" containerID="b5b847675c7a713eaa93d5f395ad54bde296dd372ae58e3e509cae688b78bf8d"
Jul 27 19:19:52.736858 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:19:52.736816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:20:09.996125 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:20:09.996094    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:20:35.590016 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:20:35.589978    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:20:52.304443 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:20:52.304397    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:21:18.692269 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:21:18.692232    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:21:34.795099 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:21:34.795063    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:21:51.704267 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:21:51.704228    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:22:15.717747 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:22:15.717706    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:22:47.206016 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:22:47.205983    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:23:06.806381 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:06.806342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:23:22.320704 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.320668    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7d6d"]
Jul 27 19:23:22.324549 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.324526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:22.337961 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.337937    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7d6d"]
Jul 27 19:23:22.389226 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.389189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jzd\" (UniqueName: \"kubernetes.io/projected/f688f25d-2b1f-46f6-9758-a79a9f64dfc1-kube-api-access-r2jzd\") pod \"kuadrant-operator-catalog-j7d6d\" (UID: \"f688f25d-2b1f-46f6-9758-a79a9f64dfc1\") " pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:22.490467 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.490416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jzd\" (UniqueName: \"kubernetes.io/projected/f688f25d-2b1f-46f6-9758-a79a9f64dfc1-kube-api-access-r2jzd\") pod \"kuadrant-operator-catalog-j7d6d\" (UID: \"f688f25d-2b1f-46f6-9758-a79a9f64dfc1\") " pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:22.501109 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.501080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jzd\" (UniqueName: \"kubernetes.io/projected/f688f25d-2b1f-46f6-9758-a79a9f64dfc1-kube-api-access-r2jzd\") pod \"kuadrant-operator-catalog-j7d6d\" (UID: \"f688f25d-2b1f-46f6-9758-a79a9f64dfc1\") " pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:22.635394 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.635354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:22.784075 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.784042    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7d6d"]
Jul 27 19:23:22.786030 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:23:22.786006    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf688f25d_2b1f_46f6_9758_a79a9f64dfc1.slice/crio-5965a396615e3d2bc66e8e9f5e3b64d8ae29f5b91f1d53695f83152e2fc7cf9a WatchSource:0}: Error finding container 5965a396615e3d2bc66e8e9f5e3b64d8ae29f5b91f1d53695f83152e2fc7cf9a: Status 404 returned error can't find the container with id 5965a396615e3d2bc66e8e9f5e3b64d8ae29f5b91f1d53695f83152e2fc7cf9a
Jul 27 19:23:22.787303 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:22.787285    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:23:23.534055 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:23.533979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d" event={"ID":"f688f25d-2b1f-46f6-9758-a79a9f64dfc1","Type":"ContainerStarted","Data":"25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a"}
Jul 27 19:23:23.534055 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:23.534032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d" event={"ID":"f688f25d-2b1f-46f6-9758-a79a9f64dfc1","Type":"ContainerStarted","Data":"5965a396615e3d2bc66e8e9f5e3b64d8ae29f5b91f1d53695f83152e2fc7cf9a"}
Jul 27 19:23:23.564790 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:23.564741    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d" podStartSLOduration=1.0949155 podStartE2EDuration="1.564723636s" totalImagesPullingTime="469.808136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:23:23.563921794 +0000 UTC m=+3101.647204647" watchObservedRunningTime="2026-07-27 19:23:23.564723636 +0000 UTC m=+3101.648006487"
Jul 27 19:23:25.215580 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:25.215544    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:23:32.635785 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:32.635749    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:32.636186 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:32.635809    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:32.657801 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:32.657776    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:33.613725 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:33.613695    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:33.663451 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:33.663407    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7d6d"]
Jul 27 19:23:35.602917 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:35.602878    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d" podUID="f688f25d-2b1f-46f6-9758-a79a9f64dfc1" containerName="registry-server" containerID="cri-o://25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a" gracePeriod=2
Jul 27 19:23:35.866176 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:35.866124    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:35.930413 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:35.930383    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2jzd\" (UniqueName: \"kubernetes.io/projected/f688f25d-2b1f-46f6-9758-a79a9f64dfc1-kube-api-access-r2jzd\") pod \"f688f25d-2b1f-46f6-9758-a79a9f64dfc1\" (UID: \"f688f25d-2b1f-46f6-9758-a79a9f64dfc1\") "
Jul 27 19:23:35.932554 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:35.932524    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f688f25d-2b1f-46f6-9758-a79a9f64dfc1-kube-api-access-r2jzd" (OuterVolumeSpecName: "kube-api-access-r2jzd") pod "f688f25d-2b1f-46f6-9758-a79a9f64dfc1" (UID: "f688f25d-2b1f-46f6-9758-a79a9f64dfc1"). InnerVolumeSpecName "kube-api-access-r2jzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:23:36.031615 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.031577    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2jzd\" (UniqueName: \"kubernetes.io/projected/f688f25d-2b1f-46f6-9758-a79a9f64dfc1-kube-api-access-r2jzd\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:23:36.609617 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.609586    2577 generic.go:356] "Generic (PLEG): container finished" podID="f688f25d-2b1f-46f6-9758-a79a9f64dfc1" containerID="25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a" exitCode=0
Jul 27 19:23:36.610090 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.609659    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d"
Jul 27 19:23:36.610090 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.609676    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d" event={"ID":"f688f25d-2b1f-46f6-9758-a79a9f64dfc1","Type":"ContainerDied","Data":"25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a"}
Jul 27 19:23:36.610090 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.609765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j7d6d" event={"ID":"f688f25d-2b1f-46f6-9758-a79a9f64dfc1","Type":"ContainerDied","Data":"5965a396615e3d2bc66e8e9f5e3b64d8ae29f5b91f1d53695f83152e2fc7cf9a"}
Jul 27 19:23:36.610090 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.609795    2577 scope.go:117] "RemoveContainer" containerID="25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a"
Jul 27 19:23:36.619517 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.619491    2577 scope.go:117] "RemoveContainer" containerID="25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a"
Jul 27 19:23:36.619737 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:23:36.619720    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a\": container with ID starting with 25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a not found: ID does not exist" containerID="25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a"
Jul 27 19:23:36.619788 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.619747    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a"} err="failed to get container status \"25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a\": rpc error: code = NotFound desc = could not find container \"25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a\": container with ID starting with 25c9d486a3dc9c8821d876411ed0bff7b18135378603ccdbd68930148a578e0a not found: ID does not exist"
Jul 27 19:23:36.633116 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.633092    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7d6d"]
Jul 27 19:23:36.636265 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:36.636243    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j7d6d"]
Jul 27 19:23:38.510877 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:23:38.510845    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f688f25d-2b1f-46f6-9758-a79a9f64dfc1" path="/var/lib/kubelet/pods/f688f25d-2b1f-46f6-9758-a79a9f64dfc1/volumes"
Jul 27 19:24:06.699046 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:24:06.698968    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:24:37.254442 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:24:37.254387    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:24:59.203786 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:24:59.203748    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:25:17.557755 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:17.557719    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:25:26.946376 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:26.946342    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7574-140135786278704"]
Jul 27 19:25:26.946856 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:26.946786    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f688f25d-2b1f-46f6-9758-a79a9f64dfc1" containerName="registry-server"
Jul 27 19:25:26.946856 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:26.946798    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f688f25d-2b1f-46f6-9758-a79a9f64dfc1" containerName="registry-server"
Jul 27 19:25:26.946936 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:26.946876    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f688f25d-2b1f-46f6-9758-a79a9f64dfc1" containerName="registry-server"
Jul 27 19:25:26.949973 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:26.949957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135786278704"
Jul 27 19:25:26.952897 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:26.952872    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w5rhc\""
Jul 27 19:25:26.958694 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:26.958673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135786278704"]
Jul 27 19:25:27.100697 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:27.100666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpvk9\" (UniqueName: \"kubernetes.io/projected/651de454-a1d6-4c60-99bf-e4003b13002b-kube-api-access-wpvk9\") pod \"test-curl-7574-140135786278704\" (UID: \"651de454-a1d6-4c60-99bf-e4003b13002b\") " pod="opendatahub/test-curl-7574-140135786278704"
Jul 27 19:25:27.201669 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:27.201569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpvk9\" (UniqueName: \"kubernetes.io/projected/651de454-a1d6-4c60-99bf-e4003b13002b-kube-api-access-wpvk9\") pod \"test-curl-7574-140135786278704\" (UID: \"651de454-a1d6-4c60-99bf-e4003b13002b\") " pod="opendatahub/test-curl-7574-140135786278704"
Jul 27 19:25:27.212070 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:27.212046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpvk9\" (UniqueName: \"kubernetes.io/projected/651de454-a1d6-4c60-99bf-e4003b13002b-kube-api-access-wpvk9\") pod \"test-curl-7574-140135786278704\" (UID: \"651de454-a1d6-4c60-99bf-e4003b13002b\") " pod="opendatahub/test-curl-7574-140135786278704"
Jul 27 19:25:27.261276 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:27.261252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135786278704"
Jul 27 19:25:27.404358 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:27.404325    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135786278704"]
Jul 27 19:25:27.406018 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:25:27.405989    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod651de454_a1d6_4c60_99bf_e4003b13002b.slice/crio-4246d73b8fe9f3bb865dac36a1fd33598674f6139109cbb7692a08e5066d6097 WatchSource:0}: Error finding container 4246d73b8fe9f3bb865dac36a1fd33598674f6139109cbb7692a08e5066d6097: Status 404 returned error can't find the container with id 4246d73b8fe9f3bb865dac36a1fd33598674f6139109cbb7692a08e5066d6097
Jul 27 19:25:28.266988 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:28.266956    2577 generic.go:356] "Generic (PLEG): container finished" podID="651de454-a1d6-4c60-99bf-e4003b13002b" containerID="5438ca240be86bb1023b2fefc068b170ce4f246daa3a20d344e7da1ee70b5439" exitCode=0
Jul 27 19:25:28.267315 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:28.266999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135786278704" event={"ID":"651de454-a1d6-4c60-99bf-e4003b13002b","Type":"ContainerDied","Data":"5438ca240be86bb1023b2fefc068b170ce4f246daa3a20d344e7da1ee70b5439"}
Jul 27 19:25:28.267315 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:28.267031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135786278704" event={"ID":"651de454-a1d6-4c60-99bf-e4003b13002b","Type":"ContainerStarted","Data":"4246d73b8fe9f3bb865dac36a1fd33598674f6139109cbb7692a08e5066d6097"}
Jul 27 19:25:29.417779 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.417756    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135786278704"
Jul 27 19:25:29.456838 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.456815    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7574-140135786278704_651de454-a1d6-4c60-99bf-e4003b13002b/test-curl-7574-140135786278704/0.log"
Jul 27 19:25:29.483789 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.483756    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7574-140135786278704"]
Jul 27 19:25:29.487872 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.487851    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7574-140135786278704"]
Jul 27 19:25:29.523321 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.523295    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpvk9\" (UniqueName: \"kubernetes.io/projected/651de454-a1d6-4c60-99bf-e4003b13002b-kube-api-access-wpvk9\") pod \"651de454-a1d6-4c60-99bf-e4003b13002b\" (UID: \"651de454-a1d6-4c60-99bf-e4003b13002b\") "
Jul 27 19:25:29.526088 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.526021    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651de454-a1d6-4c60-99bf-e4003b13002b-kube-api-access-wpvk9" (OuterVolumeSpecName: "kube-api-access-wpvk9") pod "651de454-a1d6-4c60-99bf-e4003b13002b" (UID: "651de454-a1d6-4c60-99bf-e4003b13002b"). InnerVolumeSpecName "kube-api-access-wpvk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:25:29.606785 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.606750    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7574-140135786278576"]
Jul 27 19:25:29.607172 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.607160    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651de454-a1d6-4c60-99bf-e4003b13002b" containerName="test-curl-7574-140135786278704"
Jul 27 19:25:29.607216 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.607174    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="651de454-a1d6-4c60-99bf-e4003b13002b" containerName="test-curl-7574-140135786278704"
Jul 27 19:25:29.607281 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.607270    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="651de454-a1d6-4c60-99bf-e4003b13002b" containerName="test-curl-7574-140135786278704"
Jul 27 19:25:29.610413 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.610399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:29.617221 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.617168    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135786278576"]
Jul 27 19:25:29.624599 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.624575    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpvk9\" (UniqueName: \"kubernetes.io/projected/651de454-a1d6-4c60-99bf-e4003b13002b-kube-api-access-wpvk9\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:25:29.726116 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.726079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbhhz\" (UniqueName: \"kubernetes.io/projected/f67f7321-ad27-40c3-942f-b2db6af2d779-kube-api-access-hbhhz\") pod \"test-curl-7574-140135786278576\" (UID: \"f67f7321-ad27-40c3-942f-b2db6af2d779\") " pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:29.827756 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.827641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbhhz\" (UniqueName: \"kubernetes.io/projected/f67f7321-ad27-40c3-942f-b2db6af2d779-kube-api-access-hbhhz\") pod \"test-curl-7574-140135786278576\" (UID: \"f67f7321-ad27-40c3-942f-b2db6af2d779\") " pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:29.837383 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.837353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbhhz\" (UniqueName: \"kubernetes.io/projected/f67f7321-ad27-40c3-942f-b2db6af2d779-kube-api-access-hbhhz\") pod \"test-curl-7574-140135786278576\" (UID: \"f67f7321-ad27-40c3-942f-b2db6af2d779\") " pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:29.921917 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:29.921877    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:30.072158 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:30.072131    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135786278576"]
Jul 27 19:25:30.073679 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:25:30.073652    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf67f7321_ad27_40c3_942f_b2db6af2d779.slice/crio-994bd119d1c92782775e6b43a9b7f8bf45b574d0c57bc7a7d1f713a9b2393c45 WatchSource:0}: Error finding container 994bd119d1c92782775e6b43a9b7f8bf45b574d0c57bc7a7d1f713a9b2393c45: Status 404 returned error can't find the container with id 994bd119d1c92782775e6b43a9b7f8bf45b574d0c57bc7a7d1f713a9b2393c45
Jul 27 19:25:30.281600 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:30.281572    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135786278704"
Jul 27 19:25:30.281772 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:30.281612    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4246d73b8fe9f3bb865dac36a1fd33598674f6139109cbb7692a08e5066d6097"
Jul 27 19:25:30.282896 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:30.282870    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135786278576" event={"ID":"f67f7321-ad27-40c3-942f-b2db6af2d779","Type":"ContainerStarted","Data":"994bd119d1c92782775e6b43a9b7f8bf45b574d0c57bc7a7d1f713a9b2393c45"}
Jul 27 19:25:30.297550 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:25:30.297525    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140135786278704\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="651de454-a1d6-4c60-99bf-e4003b13002b" pod="opendatahub/test-curl-7574-140135786278704"
Jul 27 19:25:30.512956 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:30.512923    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="651de454-a1d6-4c60-99bf-e4003b13002b" path="/var/lib/kubelet/pods/651de454-a1d6-4c60-99bf-e4003b13002b/volumes"
Jul 27 19:25:31.290386 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:31.290351    2577 generic.go:356] "Generic (PLEG): container finished" podID="f67f7321-ad27-40c3-942f-b2db6af2d779" containerID="8038aeccb63bfeb48991bd16c54f2199cd48aaa078472ae9bc7dcffdefddbe6f" exitCode=0
Jul 27 19:25:31.290595 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:31.290464    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135786278576" event={"ID":"f67f7321-ad27-40c3-942f-b2db6af2d779","Type":"ContainerDied","Data":"8038aeccb63bfeb48991bd16c54f2199cd48aaa078472ae9bc7dcffdefddbe6f"}
Jul 27 19:25:32.447981 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.447955    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:32.479745 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.479708    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7574-140135786278576_f67f7321-ad27-40c3-942f-b2db6af2d779/test-curl-7574-140135786278576/0.log"
Jul 27 19:25:32.514111 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.514084    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7574-140135786278576"]
Jul 27 19:25:32.518164 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.518140    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7574-140135786278576"]
Jul 27 19:25:32.551043 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.550973    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbhhz\" (UniqueName: \"kubernetes.io/projected/f67f7321-ad27-40c3-942f-b2db6af2d779-kube-api-access-hbhhz\") pod \"f67f7321-ad27-40c3-942f-b2db6af2d779\" (UID: \"f67f7321-ad27-40c3-942f-b2db6af2d779\") "
Jul 27 19:25:32.553220 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.553197    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f67f7321-ad27-40c3-942f-b2db6af2d779-kube-api-access-hbhhz" (OuterVolumeSpecName: "kube-api-access-hbhhz") pod "f67f7321-ad27-40c3-942f-b2db6af2d779" (UID: "f67f7321-ad27-40c3-942f-b2db6af2d779"). InnerVolumeSpecName "kube-api-access-hbhhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:25:32.652041 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.652008    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbhhz\" (UniqueName: \"kubernetes.io/projected/f67f7321-ad27-40c3-942f-b2db6af2d779-kube-api-access-hbhhz\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:25:32.685634 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.685604    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:32.686034 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.686020    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67f7321-ad27-40c3-942f-b2db6af2d779" containerName="test-curl-7574-140135786278576"
Jul 27 19:25:32.686078 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.686036    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67f7321-ad27-40c3-942f-b2db6af2d779" containerName="test-curl-7574-140135786278576"
Jul 27 19:25:32.686117 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.686110    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67f7321-ad27-40c3-942f-b2db6af2d779" containerName="test-curl-7574-140135786278576"
Jul 27 19:25:32.689111 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.689095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:32.697221 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.697196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:32.854466 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.854408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thb5s\" (UniqueName: \"kubernetes.io/projected/d43bc3af-5c92-4609-bb5b-88aae46c633b-kube-api-access-thb5s\") pod \"test-curl-7574-140135784499216\" (UID: \"d43bc3af-5c92-4609-bb5b-88aae46c633b\") " pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:32.955978 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.955943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thb5s\" (UniqueName: \"kubernetes.io/projected/d43bc3af-5c92-4609-bb5b-88aae46c633b-kube-api-access-thb5s\") pod \"test-curl-7574-140135784499216\" (UID: \"d43bc3af-5c92-4609-bb5b-88aae46c633b\") " pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:32.965978 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.965956    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thb5s\" (UniqueName: \"kubernetes.io/projected/d43bc3af-5c92-4609-bb5b-88aae46c633b-kube-api-access-thb5s\") pod \"test-curl-7574-140135784499216\" (UID: \"d43bc3af-5c92-4609-bb5b-88aae46c633b\") " pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:32.999115 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:32.999087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:33.144839 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:33.144816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:33.146617 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:25:33.146590    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd43bc3af_5c92_4609_bb5b_88aae46c633b.slice/crio-415371561e9d47afb005acaa132cb075a370c783cd166b892d4cfff2bf56a309 WatchSource:0}: Error finding container 415371561e9d47afb005acaa132cb075a370c783cd166b892d4cfff2bf56a309: Status 404 returned error can't find the container with id 415371561e9d47afb005acaa132cb075a370c783cd166b892d4cfff2bf56a309
Jul 27 19:25:33.303863 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:33.303834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:25:33.306091 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:33.306061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135784499216" event={"ID":"d43bc3af-5c92-4609-bb5b-88aae46c633b","Type":"ContainerStarted","Data":"415371561e9d47afb005acaa132cb075a370c783cd166b892d4cfff2bf56a309"}
Jul 27 19:25:33.307255 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:33.307238    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="994bd119d1c92782775e6b43a9b7f8bf45b574d0c57bc7a7d1f713a9b2393c45"
Jul 27 19:25:33.307342 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:33.307261    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:33.320485 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:25:33.320460    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140135786278576\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="f67f7321-ad27-40c3-942f-b2db6af2d779" pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:34.314879 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:34.314843    2577 generic.go:356] "Generic (PLEG): container finished" podID="d43bc3af-5c92-4609-bb5b-88aae46c633b" containerID="3b8589bf72a617dc0d5b7b2957ddc8dca3d3c7dc7981da411f1514ec2ea7b796" exitCode=0
Jul 27 19:25:34.315327 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:34.314938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135784499216" event={"ID":"d43bc3af-5c92-4609-bb5b-88aae46c633b","Type":"ContainerDied","Data":"3b8589bf72a617dc0d5b7b2957ddc8dca3d3c7dc7981da411f1514ec2ea7b796"}
Jul 27 19:25:34.317287 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:25:34.317263    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140135786278576\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="f67f7321-ad27-40c3-942f-b2db6af2d779" pod="opendatahub/test-curl-7574-140135786278576"
Jul 27 19:25:34.510860 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:34.510817    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67f7321-ad27-40c3-942f-b2db6af2d779" path="/var/lib/kubelet/pods/f67f7321-ad27-40c3-942f-b2db6af2d779/volumes"
Jul 27 19:25:35.463593 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.463567    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:35.487254 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.487224    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7574-140135784499216_d43bc3af-5c92-4609-bb5b-88aae46c633b/test-curl-7574-140135784499216/0.log"
Jul 27 19:25:35.515811 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.515783    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:35.523651 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.523625    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:35.582090 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.582009    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thb5s\" (UniqueName: \"kubernetes.io/projected/d43bc3af-5c92-4609-bb5b-88aae46c633b-kube-api-access-thb5s\") pod \"d43bc3af-5c92-4609-bb5b-88aae46c633b\" (UID: \"d43bc3af-5c92-4609-bb5b-88aae46c633b\") "
Jul 27 19:25:35.584222 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.584195    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d43bc3af-5c92-4609-bb5b-88aae46c633b-kube-api-access-thb5s" (OuterVolumeSpecName: "kube-api-access-thb5s") pod "d43bc3af-5c92-4609-bb5b-88aae46c633b" (UID: "d43bc3af-5c92-4609-bb5b-88aae46c633b"). InnerVolumeSpecName "kube-api-access-thb5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:25:35.646085 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.646036    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:35.646580 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.646564    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43bc3af-5c92-4609-bb5b-88aae46c633b" containerName="test-curl-7574-140135784499216"
Jul 27 19:25:35.646631 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.646583    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43bc3af-5c92-4609-bb5b-88aae46c633b" containerName="test-curl-7574-140135784499216"
Jul 27 19:25:35.646668 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.646662    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d43bc3af-5c92-4609-bb5b-88aae46c633b" containerName="test-curl-7574-140135784499216"
Jul 27 19:25:35.649815 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.649801    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:35.659481 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.659455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:35.683343 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.683309    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thb5s\" (UniqueName: \"kubernetes.io/projected/d43bc3af-5c92-4609-bb5b-88aae46c633b-kube-api-access-thb5s\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:25:35.784636 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.784599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphg9\" (UniqueName: \"kubernetes.io/projected/33ac3238-0eb9-4d38-931a-6e1fa2c3750e-kube-api-access-tphg9\") pod \"test-curl-7574-140135784499216\" (UID: \"33ac3238-0eb9-4d38-931a-6e1fa2c3750e\") " pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:35.885284 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.885248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tphg9\" (UniqueName: \"kubernetes.io/projected/33ac3238-0eb9-4d38-931a-6e1fa2c3750e-kube-api-access-tphg9\") pod \"test-curl-7574-140135784499216\" (UID: \"33ac3238-0eb9-4d38-931a-6e1fa2c3750e\") " pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:35.898021 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.897995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphg9\" (UniqueName: \"kubernetes.io/projected/33ac3238-0eb9-4d38-931a-6e1fa2c3750e-kube-api-access-tphg9\") pod \"test-curl-7574-140135784499216\" (UID: \"33ac3238-0eb9-4d38-931a-6e1fa2c3750e\") " pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:35.960050 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:35.960015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:36.104241 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:36.104217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:36.106375 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:25:36.106349    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33ac3238_0eb9_4d38_931a_6e1fa2c3750e.slice/crio-7039e0c6f15b067ed35cea2d5bea1288a6510f9800d3a00cd82c90d3046a9ac5 WatchSource:0}: Error finding container 7039e0c6f15b067ed35cea2d5bea1288a6510f9800d3a00cd82c90d3046a9ac5: Status 404 returned error can't find the container with id 7039e0c6f15b067ed35cea2d5bea1288a6510f9800d3a00cd82c90d3046a9ac5
Jul 27 19:25:36.328997 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:36.328969    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:36.329182 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:36.329002    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="415371561e9d47afb005acaa132cb075a370c783cd166b892d4cfff2bf56a309"
Jul 27 19:25:36.330174 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:36.330148    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135784499216" event={"ID":"33ac3238-0eb9-4d38-931a-6e1fa2c3750e","Type":"ContainerStarted","Data":"7039e0c6f15b067ed35cea2d5bea1288a6510f9800d3a00cd82c90d3046a9ac5"}
Jul 27 19:25:36.344681 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:36.344654    2577 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7574-140135784499216" oldPodUID="d43bc3af-5c92-4609-bb5b-88aae46c633b" podUID="33ac3238-0eb9-4d38-931a-6e1fa2c3750e"
Jul 27 19:25:36.512735 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:36.512708    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d43bc3af-5c92-4609-bb5b-88aae46c633b" path="/var/lib/kubelet/pods/d43bc3af-5c92-4609-bb5b-88aae46c633b/volumes"
Jul 27 19:25:37.339057 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:37.339020    2577 generic.go:356] "Generic (PLEG): container finished" podID="33ac3238-0eb9-4d38-931a-6e1fa2c3750e" containerID="75305a8b5c82b3b3031835446a139fdab0c4e5fb24810c67f555bf2ebe908fa4" exitCode=0
Jul 27 19:25:37.339227 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:37.339106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135784499216" event={"ID":"33ac3238-0eb9-4d38-931a-6e1fa2c3750e","Type":"ContainerDied","Data":"75305a8b5c82b3b3031835446a139fdab0c4e5fb24810c67f555bf2ebe908fa4"}
Jul 27 19:25:38.486331 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.486309    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:38.510828 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.510801    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tphg9\" (UniqueName: \"kubernetes.io/projected/33ac3238-0eb9-4d38-931a-6e1fa2c3750e-kube-api-access-tphg9\") pod \"33ac3238-0eb9-4d38-931a-6e1fa2c3750e\" (UID: \"33ac3238-0eb9-4d38-931a-6e1fa2c3750e\") "
Jul 27 19:25:38.513496 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.513469    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33ac3238-0eb9-4d38-931a-6e1fa2c3750e-kube-api-access-tphg9" (OuterVolumeSpecName: "kube-api-access-tphg9") pod "33ac3238-0eb9-4d38-931a-6e1fa2c3750e" (UID: "33ac3238-0eb9-4d38-931a-6e1fa2c3750e"). InnerVolumeSpecName "kube-api-access-tphg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:25:38.519392 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.519373    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7574-140135784499216_33ac3238-0eb9-4d38-931a-6e1fa2c3750e/test-curl-7574-140135784499216/0.log"
Jul 27 19:25:38.562285 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.562256    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:38.573691 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.573665    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7574-140135784499216"]
Jul 27 19:25:38.611803 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.611745    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tphg9\" (UniqueName: \"kubernetes.io/projected/33ac3238-0eb9-4d38-931a-6e1fa2c3750e-kube-api-access-tphg9\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:25:38.693695 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.693664    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7574-140135784500224"]
Jul 27 19:25:38.694164 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.694146    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33ac3238-0eb9-4d38-931a-6e1fa2c3750e" containerName="test-curl-7574-140135784499216"
Jul 27 19:25:38.694258 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.694166    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="33ac3238-0eb9-4d38-931a-6e1fa2c3750e" containerName="test-curl-7574-140135784499216"
Jul 27 19:25:38.694314 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.694285    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="33ac3238-0eb9-4d38-931a-6e1fa2c3750e" containerName="test-curl-7574-140135784499216"
Jul 27 19:25:38.697278 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.697258    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:38.708563 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.708540    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135784500224"]
Jul 27 19:25:38.712169 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.712150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx7gk\" (UniqueName: \"kubernetes.io/projected/e726e52e-66b6-4129-8961-d53ac2a527aa-kube-api-access-xx7gk\") pod \"test-curl-7574-140135784500224\" (UID: \"e726e52e-66b6-4129-8961-d53ac2a527aa\") " pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:38.813473 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.813416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx7gk\" (UniqueName: \"kubernetes.io/projected/e726e52e-66b6-4129-8961-d53ac2a527aa-kube-api-access-xx7gk\") pod \"test-curl-7574-140135784500224\" (UID: \"e726e52e-66b6-4129-8961-d53ac2a527aa\") " pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:38.824055 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:38.824031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx7gk\" (UniqueName: \"kubernetes.io/projected/e726e52e-66b6-4129-8961-d53ac2a527aa-kube-api-access-xx7gk\") pod \"test-curl-7574-140135784500224\" (UID: \"e726e52e-66b6-4129-8961-d53ac2a527aa\") " pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:39.007017 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:39.006940    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:39.148327 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:39.147393    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7574-140135784500224"]
Jul 27 19:25:39.351501 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:39.351460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135784500224" event={"ID":"e726e52e-66b6-4129-8961-d53ac2a527aa","Type":"ContainerStarted","Data":"4cce58359c2cd413bbc5cca2629236f107086b2a4953438bf0715369d59cb4ab"}
Jul 27 19:25:39.352752 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:39.352730    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:39.352881 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:39.352757    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7039e0c6f15b067ed35cea2d5bea1288a6510f9800d3a00cd82c90d3046a9ac5"
Jul 27 19:25:39.363401 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:25:39.363371    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140135784499216\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="33ac3238-0eb9-4d38-931a-6e1fa2c3750e" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:40.360626 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:40.360593    2577 generic.go:356] "Generic (PLEG): container finished" podID="e726e52e-66b6-4129-8961-d53ac2a527aa" containerID="feeceb10ee5d9e2420ae9de311e96487a44a5f1f9127f192adc7e431bddcd5db" exitCode=0
Jul 27 19:25:40.361017 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:40.360679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7574-140135784500224" event={"ID":"e726e52e-66b6-4129-8961-d53ac2a527aa","Type":"ContainerDied","Data":"feeceb10ee5d9e2420ae9de311e96487a44a5f1f9127f192adc7e431bddcd5db"}
Jul 27 19:25:40.363751 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:25:40.363728    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140135784499216\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="33ac3238-0eb9-4d38-931a-6e1fa2c3750e" pod="opendatahub/test-curl-7574-140135784499216"
Jul 27 19:25:40.511574 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:40.511538    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33ac3238-0eb9-4d38-931a-6e1fa2c3750e" path="/var/lib/kubelet/pods/33ac3238-0eb9-4d38-931a-6e1fa2c3750e/volumes"
Jul 27 19:25:41.509475 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:41.509454    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:41.533993 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:41.533965    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7574-140135784500224_e726e52e-66b6-4129-8961-d53ac2a527aa/test-curl-7574-140135784500224/0.log"
Jul 27 19:25:41.540500 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:41.540477    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx7gk\" (UniqueName: \"kubernetes.io/projected/e726e52e-66b6-4129-8961-d53ac2a527aa-kube-api-access-xx7gk\") pod \"e726e52e-66b6-4129-8961-d53ac2a527aa\" (UID: \"e726e52e-66b6-4129-8961-d53ac2a527aa\") "
Jul 27 19:25:41.542636 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:41.542610    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e726e52e-66b6-4129-8961-d53ac2a527aa-kube-api-access-xx7gk" (OuterVolumeSpecName: "kube-api-access-xx7gk") pod "e726e52e-66b6-4129-8961-d53ac2a527aa" (UID: "e726e52e-66b6-4129-8961-d53ac2a527aa"). InnerVolumeSpecName "kube-api-access-xx7gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:25:41.563112 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:41.563086    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7574-140135784500224"]
Jul 27 19:25:41.568572 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:41.568552    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7574-140135784500224"]
Jul 27 19:25:41.642503 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:41.642394    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx7gk\" (UniqueName: \"kubernetes.io/projected/e726e52e-66b6-4129-8961-d53ac2a527aa-kube-api-access-xx7gk\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:25:42.373581 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:42.373548    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:42.373581 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:42.373571    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cce58359c2cd413bbc5cca2629236f107086b2a4953438bf0715369d59cb4ab"
Jul 27 19:25:42.383572 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:25:42.383546    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140135784500224\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="e726e52e-66b6-4129-8961-d53ac2a527aa" pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:42.511552 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:42.511521    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e726e52e-66b6-4129-8961-d53ac2a527aa" path="/var/lib/kubelet/pods/e726e52e-66b6-4129-8961-d53ac2a527aa/volumes"
Jul 27 19:25:42.513179 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:25:42.513157    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7574-140135784500224\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="e726e52e-66b6-4129-8961-d53ac2a527aa" pod="opendatahub/test-curl-7574-140135784500224"
Jul 27 19:25:53.849837 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.849807    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"]
Jul 27 19:25:53.850278 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.850239    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e726e52e-66b6-4129-8961-d53ac2a527aa" containerName="test-curl-7574-140135784500224"
Jul 27 19:25:53.850278 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.850251    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e726e52e-66b6-4129-8961-d53ac2a527aa" containerName="test-curl-7574-140135784500224"
Jul 27 19:25:53.850357 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.850322    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e726e52e-66b6-4129-8961-d53ac2a527aa" containerName="test-curl-7574-140135784500224"
Jul 27 19:25:53.852971 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.852952    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:53.856273 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.856251    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d4857a\""
Jul 27 19:25:53.856356 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.856301    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-d4857a-dockercfg-8d5rb\""
Jul 27 19:25:53.867345 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.867318    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"]
Jul 27 19:25:53.957243 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.957203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96ef9115-b875-40b9-a31c-9897f56296d9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj\" (UID: \"96ef9115-b875-40b9-a31c-9897f56296d9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:53.957416 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:53.957315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qp8x\" (UniqueName: \"kubernetes.io/projected/96ef9115-b875-40b9-a31c-9897f56296d9-kube-api-access-2qp8x\") pod \"payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj\" (UID: \"96ef9115-b875-40b9-a31c-9897f56296d9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:54.058807 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.058769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qp8x\" (UniqueName: \"kubernetes.io/projected/96ef9115-b875-40b9-a31c-9897f56296d9-kube-api-access-2qp8x\") pod \"payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj\" (UID: \"96ef9115-b875-40b9-a31c-9897f56296d9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:54.059000 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.058858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96ef9115-b875-40b9-a31c-9897f56296d9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj\" (UID: \"96ef9115-b875-40b9-a31c-9897f56296d9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:54.059575 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.059555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96ef9115-b875-40b9-a31c-9897f56296d9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj\" (UID: \"96ef9115-b875-40b9-a31c-9897f56296d9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:54.068410 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.068388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qp8x\" (UniqueName: \"kubernetes.io/projected/96ef9115-b875-40b9-a31c-9897f56296d9-kube-api-access-2qp8x\") pod \"payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj\" (UID: \"96ef9115-b875-40b9-a31c-9897f56296d9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:54.163238 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.163120    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:54.312510 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.312483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"]
Jul 27 19:25:54.313902 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:25:54.313875    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ef9115_b875_40b9_a31c_9897f56296d9.slice/crio-59ddc0e1b66e32d56f9ec1c1e4558eb7696f6db5a351018e417e52ed122c2e21 WatchSource:0}: Error finding container 59ddc0e1b66e32d56f9ec1c1e4558eb7696f6db5a351018e417e52ed122c2e21: Status 404 returned error can't find the container with id 59ddc0e1b66e32d56f9ec1c1e4558eb7696f6db5a351018e417e52ed122c2e21
Jul 27 19:25:54.454596 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.454508    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj" event={"ID":"96ef9115-b875-40b9-a31c-9897f56296d9","Type":"ContainerStarted","Data":"b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d"}
Jul 27 19:25:54.454596 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.454567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj" event={"ID":"96ef9115-b875-40b9-a31c-9897f56296d9","Type":"ContainerStarted","Data":"59ddc0e1b66e32d56f9ec1c1e4558eb7696f6db5a351018e417e52ed122c2e21"}
Jul 27 19:25:54.454804 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.454686    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:25:54.476358 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:54.476296    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj" podStartSLOduration=1.476275815 podStartE2EDuration="1.476275815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:54.474031936 +0000 UTC m=+3252.557314791" watchObservedRunningTime="2026-07-27 19:25:54.476275815 +0000 UTC m=+3252.559558667"
Jul 27 19:25:57.385844 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:25:57.385806    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:26:05.463364 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:05.463330    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:26:12.082651 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.082609    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"]
Jul 27 19:26:12.086893 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.086874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.092296 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.092273    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-2d7b97-serving-cert\""
Jul 27 19:26:12.103240 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.103216    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"]
Jul 27 19:26:12.233666 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.233627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1451d4a-eb4b-49d7-9e61-c0857300516e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.233666 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.233667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1451d4a-eb4b-49d7-9e61-c0857300516e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.233887 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.233855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42q6t\" (UniqueName: \"kubernetes.io/projected/c1451d4a-eb4b-49d7-9e61-c0857300516e-kube-api-access-42q6t\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.335156 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.335122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1451d4a-eb4b-49d7-9e61-c0857300516e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.335156 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.335160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1451d4a-eb4b-49d7-9e61-c0857300516e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.335421 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.335232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42q6t\" (UniqueName: \"kubernetes.io/projected/c1451d4a-eb4b-49d7-9e61-c0857300516e-kube-api-access-42q6t\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.336083 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.336055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1451d4a-eb4b-49d7-9e61-c0857300516e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.338135 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.338109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1451d4a-eb4b-49d7-9e61-c0857300516e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.355830 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.355809    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42q6t\" (UniqueName: \"kubernetes.io/projected/c1451d4a-eb4b-49d7-9e61-c0857300516e-kube-api-access-42q6t\") pod \"maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.398660 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.398629    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:12.758598 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:12.758568    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"]
Jul 27 19:26:12.759407 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:26:12.759373    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1451d4a_eb4b_49d7_9e61_c0857300516e.slice/crio-0fe1df241a677c82b12026bb15e4da0ffcdf3d61899cc6af4427224ac530e0f1 WatchSource:0}: Error finding container 0fe1df241a677c82b12026bb15e4da0ffcdf3d61899cc6af4427224ac530e0f1: Status 404 returned error can't find the container with id 0fe1df241a677c82b12026bb15e4da0ffcdf3d61899cc6af4427224ac530e0f1
Jul 27 19:26:13.570163 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:13.570078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c" event={"ID":"c1451d4a-eb4b-49d7-9e61-c0857300516e","Type":"ContainerStarted","Data":"8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e"}
Jul 27 19:26:13.570163 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:13.570129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c" event={"ID":"c1451d4a-eb4b-49d7-9e61-c0857300516e","Type":"ContainerStarted","Data":"0fe1df241a677c82b12026bb15e4da0ffcdf3d61899cc6af4427224ac530e0f1"}
Jul 27 19:26:13.570584 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:13.570171    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:13.607759 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:13.607711    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c" podStartSLOduration=1.250051311 podStartE2EDuration="1.607696885s" totalImagesPullingTime="357.645574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:13.606069592 +0000 UTC m=+3271.689352443" watchObservedRunningTime="2026-07-27 19:26:13.607696885 +0000 UTC m=+3271.690979714"
Jul 27 19:26:15.394258 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:15.394221    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:26:19.582261 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:19.582221    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:26:45.887588 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:26:45.887549    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:27:13.199903 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:13.199822    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:27:23.817163 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:23.817123    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj_96ef9115-b875-40b9-a31c-9897f56296d9/payload-processing/0.log"
Jul 27 19:27:34.187699 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:34.187658    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:27:43.865003 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:43.864964    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"]
Jul 27 19:27:43.868801 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:43.868784    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"
Jul 27 19:27:43.873579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:43.873557    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gwtlm\""
Jul 27 19:27:43.888508 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:43.888476    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"]
Jul 27 19:27:43.937980 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:43.937944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65b09f8-e6f4-4647-a23b-000e5acb7e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9\" (UID: \"d65b09f8-e6f4-4647-a23b-000e5acb7e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"
Jul 27 19:27:44.038564 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:44.038524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65b09f8-e6f4-4647-a23b-000e5acb7e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9\" (UID: \"d65b09f8-e6f4-4647-a23b-000e5acb7e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"
Jul 27 19:27:44.039140 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:44.039118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65b09f8-e6f4-4647-a23b-000e5acb7e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9\" (UID: \"d65b09f8-e6f4-4647-a23b-000e5acb7e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"
Jul 27 19:27:44.178761 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:44.178661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"
Jul 27 19:27:44.329887 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:44.329854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"]
Jul 27 19:27:44.331248 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:27:44.331223    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65b09f8_e6f4_4647_a23b_000e5acb7e13.slice/crio-03516a6f2c6af729b56b0df8b0fd822c557410bbdcdaf68838a7745df62b70be WatchSource:0}: Error finding container 03516a6f2c6af729b56b0df8b0fd822c557410bbdcdaf68838a7745df62b70be: Status 404 returned error can't find the container with id 03516a6f2c6af729b56b0df8b0fd822c557410bbdcdaf68838a7745df62b70be
Jul 27 19:27:45.141524 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:45.141489    2577 generic.go:356] "Generic (PLEG): container finished" podID="d65b09f8-e6f4-4647-a23b-000e5acb7e13" containerID="bcc42bb4bdcfea519b3a2b1e920ffd62b353cd2aae07e13a37a296a5ffc81d9b" exitCode=0
Jul 27 19:27:45.141910 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:45.141538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9" event={"ID":"d65b09f8-e6f4-4647-a23b-000e5acb7e13","Type":"ContainerDied","Data":"bcc42bb4bdcfea519b3a2b1e920ffd62b353cd2aae07e13a37a296a5ffc81d9b"}
Jul 27 19:27:45.141910 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:45.141590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9" event={"ID":"d65b09f8-e6f4-4647-a23b-000e5acb7e13","Type":"ContainerStarted","Data":"03516a6f2c6af729b56b0df8b0fd822c557410bbdcdaf68838a7745df62b70be"}
Jul 27 19:27:46.302912 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:46.302885    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"
Jul 27 19:27:46.360683 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:46.360653    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65b09f8-e6f4-4647-a23b-000e5acb7e13-maas-api-service-ca\") pod \"d65b09f8-e6f4-4647-a23b-000e5acb7e13\" (UID: \"d65b09f8-e6f4-4647-a23b-000e5acb7e13\") "
Jul 27 19:27:46.360995 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:46.360972    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65b09f8-e6f4-4647-a23b-000e5acb7e13-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d65b09f8-e6f4-4647-a23b-000e5acb7e13" (UID: "d65b09f8-e6f4-4647-a23b-000e5acb7e13"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:27:46.462190 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:46.462110    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d65b09f8-e6f4-4647-a23b-000e5acb7e13-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:27:47.161578 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:47.161551    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"
Jul 27 19:27:47.161761 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:47.161579    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9" event={"ID":"d65b09f8-e6f4-4647-a23b-000e5acb7e13","Type":"ContainerDied","Data":"03516a6f2c6af729b56b0df8b0fd822c557410bbdcdaf68838a7745df62b70be"}
Jul 27 19:27:47.161761 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:47.161636    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03516a6f2c6af729b56b0df8b0fd822c557410bbdcdaf68838a7745df62b70be"
Jul 27 19:27:58.927577 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:58.927533    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"]
Jul 27 19:27:58.930060 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:27:58.930034    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8eed25-wqfq9"]
Jul 27 19:28:00.517192 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:00.517162    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d65b09f8-e6f4-4647-a23b-000e5acb7e13" path="/var/lib/kubelet/pods/d65b09f8-e6f4-4647-a23b-000e5acb7e13/volumes"
Jul 27 19:28:01.102289 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:01.102255    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:28:09.831104 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:09.831065    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"]
Jul 27 19:28:09.831813 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:09.831542    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65b09f8-e6f4-4647-a23b-000e5acb7e13" containerName="revoke-keys"
Jul 27 19:28:09.831813 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:09.831554    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65b09f8-e6f4-4647-a23b-000e5acb7e13" containerName="revoke-keys"
Jul 27 19:28:09.831813 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:09.831641    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65b09f8-e6f4-4647-a23b-000e5acb7e13" containerName="revoke-keys"
Jul 27 19:28:09.835260 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:09.835242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"
Jul 27 19:28:09.839436 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:09.839402    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gwtlm\""
Jul 27 19:28:09.858553 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:09.858526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"]
Jul 27 19:28:09.980937 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:09.980886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c908e4-a812-4db3-8945-d22f501a87f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7\" (UID: \"f7c908e4-a812-4db3-8945-d22f501a87f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"
Jul 27 19:28:10.081797 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:10.081709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c908e4-a812-4db3-8945-d22f501a87f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7\" (UID: \"f7c908e4-a812-4db3-8945-d22f501a87f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"
Jul 27 19:28:10.082326 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:10.082307    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c908e4-a812-4db3-8945-d22f501a87f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7\" (UID: \"f7c908e4-a812-4db3-8945-d22f501a87f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"
Jul 27 19:28:10.145282 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:10.145248    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"
Jul 27 19:28:10.291304 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:10.291269    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"]
Jul 27 19:28:10.291472 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:28:10.291287    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c908e4_a812_4db3_8945_d22f501a87f8.slice/crio-626744bc78dd5d277a270cba7314204390c5b1ae539271ee977b3b06ecfc7e33 WatchSource:0}: Error finding container 626744bc78dd5d277a270cba7314204390c5b1ae539271ee977b3b06ecfc7e33: Status 404 returned error can't find the container with id 626744bc78dd5d277a270cba7314204390c5b1ae539271ee977b3b06ecfc7e33
Jul 27 19:28:10.302764 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:10.302739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7" event={"ID":"f7c908e4-a812-4db3-8945-d22f501a87f8","Type":"ContainerStarted","Data":"626744bc78dd5d277a270cba7314204390c5b1ae539271ee977b3b06ecfc7e33"}
Jul 27 19:28:11.310507 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:11.310472    2577 generic.go:356] "Generic (PLEG): container finished" podID="f7c908e4-a812-4db3-8945-d22f501a87f8" containerID="56ec265b6af6af1bfa8c3e657930e237648154b7d513b29b2fae3d7383da653d" exitCode=0
Jul 27 19:28:11.310875 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:11.310556    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7" event={"ID":"f7c908e4-a812-4db3-8945-d22f501a87f8","Type":"ContainerDied","Data":"56ec265b6af6af1bfa8c3e657930e237648154b7d513b29b2fae3d7383da653d"}
Jul 27 19:28:12.464832 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:12.464803    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"
Jul 27 19:28:12.603727 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:12.603698    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c908e4-a812-4db3-8945-d22f501a87f8-maas-api-service-ca\") pod \"f7c908e4-a812-4db3-8945-d22f501a87f8\" (UID: \"f7c908e4-a812-4db3-8945-d22f501a87f8\") "
Jul 27 19:28:12.604054 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:12.604033    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7c908e4-a812-4db3-8945-d22f501a87f8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f7c908e4-a812-4db3-8945-d22f501a87f8" (UID: "f7c908e4-a812-4db3-8945-d22f501a87f8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:12.705300 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:12.705273    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7c908e4-a812-4db3-8945-d22f501a87f8-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:28:13.325064 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:13.325032    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"
Jul 27 19:28:13.325249 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:13.325065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7" event={"ID":"f7c908e4-a812-4db3-8945-d22f501a87f8","Type":"ContainerDied","Data":"626744bc78dd5d277a270cba7314204390c5b1ae539271ee977b3b06ecfc7e33"}
Jul 27 19:28:13.325249 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:13.325148    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="626744bc78dd5d277a270cba7314204390c5b1ae539271ee977b3b06ecfc7e33"
Jul 27 19:28:25.326841 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:25.326800    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:28:28.438680 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.438632    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"]
Jul 27 19:28:28.439792 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.439747    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj" podUID="96ef9115-b875-40b9-a31c-9897f56296d9" containerName="payload-processing" containerID="cri-o://b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d" gracePeriod=30
Jul 27 19:28:28.702880 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.702813    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:28:28.768225 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.768192    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qp8x\" (UniqueName: \"kubernetes.io/projected/96ef9115-b875-40b9-a31c-9897f56296d9-kube-api-access-2qp8x\") pod \"96ef9115-b875-40b9-a31c-9897f56296d9\" (UID: \"96ef9115-b875-40b9-a31c-9897f56296d9\") "
Jul 27 19:28:28.768412 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.768287    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96ef9115-b875-40b9-a31c-9897f56296d9-plugins-config-volume\") pod \"96ef9115-b875-40b9-a31c-9897f56296d9\" (UID: \"96ef9115-b875-40b9-a31c-9897f56296d9\") "
Jul 27 19:28:28.768719 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.768693    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96ef9115-b875-40b9-a31c-9897f56296d9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96ef9115-b875-40b9-a31c-9897f56296d9" (UID: "96ef9115-b875-40b9-a31c-9897f56296d9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:28.770441 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.770395    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96ef9115-b875-40b9-a31c-9897f56296d9-kube-api-access-2qp8x" (OuterVolumeSpecName: "kube-api-access-2qp8x") pod "96ef9115-b875-40b9-a31c-9897f56296d9" (UID: "96ef9115-b875-40b9-a31c-9897f56296d9"). InnerVolumeSpecName "kube-api-access-2qp8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:28.869200 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.869165    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qp8x\" (UniqueName: \"kubernetes.io/projected/96ef9115-b875-40b9-a31c-9897f56296d9-kube-api-access-2qp8x\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:28:28.869200 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:28.869193    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96ef9115-b875-40b9-a31c-9897f56296d9-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:28:29.429783 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.429740    2577 generic.go:356] "Generic (PLEG): container finished" podID="96ef9115-b875-40b9-a31c-9897f56296d9" containerID="b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d" exitCode=0
Jul 27 19:28:29.429783 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.429788    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"
Jul 27 19:28:29.430046 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.429830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj" event={"ID":"96ef9115-b875-40b9-a31c-9897f56296d9","Type":"ContainerDied","Data":"b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d"}
Jul 27 19:28:29.430046 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.429895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj" event={"ID":"96ef9115-b875-40b9-a31c-9897f56296d9","Type":"ContainerDied","Data":"59ddc0e1b66e32d56f9ec1c1e4558eb7696f6db5a351018e417e52ed122c2e21"}
Jul 27 19:28:29.430046 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.429928    2577 scope.go:117] "RemoveContainer" containerID="b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d"
Jul 27 19:28:29.440772 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.440584    2577 scope.go:117] "RemoveContainer" containerID="b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d"
Jul 27 19:28:29.440993 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:28:29.440827    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d\": container with ID starting with b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d not found: ID does not exist" containerID="b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d"
Jul 27 19:28:29.440993 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.440860    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d"} err="failed to get container status \"b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d\": rpc error: code = NotFound desc = could not find container \"b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d\": container with ID starting with b6288fa1f4b4eb24a2f22ba9b9e44f08703bd8b34c7d38591698b6612797615d not found: ID does not exist"
Jul 27 19:28:29.453517 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.453495    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"]
Jul 27 19:28:29.456762 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:29.456742    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d4857a-869b4b57fb-qfcnj"]
Jul 27 19:28:30.132967 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:30.132933    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"]
Jul 27 19:28:30.135362 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:30.135336    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d4857a-cmpl7"]
Jul 27 19:28:30.510794 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:30.510723    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96ef9115-b875-40b9-a31c-9897f56296d9" path="/var/lib/kubelet/pods/96ef9115-b875-40b9-a31c-9897f56296d9/volumes"
Jul 27 19:28:30.511145 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:30.511073    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7c908e4-a812-4db3-8945-d22f501a87f8" path="/var/lib/kubelet/pods/f7c908e4-a812-4db3-8945-d22f501a87f8/volumes"
Jul 27 19:28:38.583369 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:28:38.583290    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:29:47.527723 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.527679    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"]
Jul 27 19:29:47.528361 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.527945    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c" podUID="c1451d4a-eb4b-49d7-9e61-c0857300516e" containerName="maas-api" containerID="cri-o://8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e" gracePeriod=30
Jul 27 19:29:47.786408 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.786343    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:29:47.835490 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.835454    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1451d4a-eb4b-49d7-9e61-c0857300516e-openshift-service-ca\") pod \"c1451d4a-eb4b-49d7-9e61-c0857300516e\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") "
Jul 27 19:29:47.835663 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.835515    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1451d4a-eb4b-49d7-9e61-c0857300516e-maas-api-tls\") pod \"c1451d4a-eb4b-49d7-9e61-c0857300516e\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") "
Jul 27 19:29:47.835663 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.835547    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42q6t\" (UniqueName: \"kubernetes.io/projected/c1451d4a-eb4b-49d7-9e61-c0857300516e-kube-api-access-42q6t\") pod \"c1451d4a-eb4b-49d7-9e61-c0857300516e\" (UID: \"c1451d4a-eb4b-49d7-9e61-c0857300516e\") "
Jul 27 19:29:47.835839 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.835813    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1451d4a-eb4b-49d7-9e61-c0857300516e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1451d4a-eb4b-49d7-9e61-c0857300516e" (UID: "c1451d4a-eb4b-49d7-9e61-c0857300516e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:29:47.837753 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.837728    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1451d4a-eb4b-49d7-9e61-c0857300516e-kube-api-access-42q6t" (OuterVolumeSpecName: "kube-api-access-42q6t") pod "c1451d4a-eb4b-49d7-9e61-c0857300516e" (UID: "c1451d4a-eb4b-49d7-9e61-c0857300516e"). InnerVolumeSpecName "kube-api-access-42q6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:47.837860 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.837831    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1451d4a-eb4b-49d7-9e61-c0857300516e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1451d4a-eb4b-49d7-9e61-c0857300516e" (UID: "c1451d4a-eb4b-49d7-9e61-c0857300516e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:47.912395 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.912364    2577 generic.go:356] "Generic (PLEG): container finished" podID="c1451d4a-eb4b-49d7-9e61-c0857300516e" containerID="8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e" exitCode=0
Jul 27 19:29:47.912561 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.912407    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"
Jul 27 19:29:47.912561 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.912418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c" event={"ID":"c1451d4a-eb4b-49d7-9e61-c0857300516e","Type":"ContainerDied","Data":"8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e"}
Jul 27 19:29:47.912561 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.912485    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c" event={"ID":"c1451d4a-eb4b-49d7-9e61-c0857300516e","Type":"ContainerDied","Data":"0fe1df241a677c82b12026bb15e4da0ffcdf3d61899cc6af4427224ac530e0f1"}
Jul 27 19:29:47.912561 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.912509    2577 scope.go:117] "RemoveContainer" containerID="8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e"
Jul 27 19:29:47.922714 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.922685    2577 scope.go:117] "RemoveContainer" containerID="8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e"
Jul 27 19:29:47.923015 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:29:47.922995    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e\": container with ID starting with 8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e not found: ID does not exist" containerID="8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e"
Jul 27 19:29:47.923104 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.923024    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e"} err="failed to get container status \"8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e\": rpc error: code = NotFound desc = could not find container \"8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e\": container with ID starting with 8778bae9e7bcfafad67f75ffb3f668d93820af044785b606a7693bebf8297c1e not found: ID does not exist"
Jul 27 19:29:47.936497 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.936476    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1451d4a-eb4b-49d7-9e61-c0857300516e-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:29:47.936497 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.936497    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42q6t\" (UniqueName: \"kubernetes.io/projected/c1451d4a-eb4b-49d7-9e61-c0857300516e-kube-api-access-42q6t\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:29:47.936497 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.936506    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1451d4a-eb4b-49d7-9e61-c0857300516e-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:29:47.938775 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.938757    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"]
Jul 27 19:29:47.943350 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:47.943327    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d7b97-657fcb4498-5ws8c"]
Jul 27 19:29:48.512119 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:48.512084    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1451d4a-eb4b-49d7-9e61-c0857300516e" path="/var/lib/kubelet/pods/c1451d4a-eb4b-49d7-9e61-c0857300516e/volumes"
Jul 27 19:29:50.794461 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:50.794403    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:29:58.767382 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767343    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"]
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767791    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c908e4-a812-4db3-8945-d22f501a87f8" containerName="revoke-keys"
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767804    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c908e4-a812-4db3-8945-d22f501a87f8" containerName="revoke-keys"
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767824    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1451d4a-eb4b-49d7-9e61-c0857300516e" containerName="maas-api"
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767829    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1451d4a-eb4b-49d7-9e61-c0857300516e" containerName="maas-api"
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767840    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ef9115-b875-40b9-a31c-9897f56296d9" containerName="payload-processing"
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767846    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ef9115-b875-40b9-a31c-9897f56296d9" containerName="payload-processing"
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767915    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1451d4a-eb4b-49d7-9e61-c0857300516e" containerName="maas-api"
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767924    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c908e4-a812-4db3-8945-d22f501a87f8" containerName="revoke-keys"
Jul 27 19:29:58.767930 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.767932    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="96ef9115-b875-40b9-a31c-9897f56296d9" containerName="payload-processing"
Jul 27 19:29:58.771270 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.771250    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"
Jul 27 19:29:58.773920 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.773905    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gwtlm\""
Jul 27 19:29:58.778527 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.778492    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"]
Jul 27 19:29:58.849097 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.849064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd25f45-f2dd-49dc-a238-357105a70461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9\" (UID: \"4fd25f45-f2dd-49dc-a238-357105a70461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"
Jul 27 19:29:58.949927 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.949886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd25f45-f2dd-49dc-a238-357105a70461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9\" (UID: \"4fd25f45-f2dd-49dc-a238-357105a70461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"
Jul 27 19:29:58.950534 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:58.950514    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd25f45-f2dd-49dc-a238-357105a70461-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9\" (UID: \"4fd25f45-f2dd-49dc-a238-357105a70461\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"
Jul 27 19:29:59.083500 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:59.083477    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"
Jul 27 19:29:59.229336 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:59.229301    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"]
Jul 27 19:29:59.229979 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:29:59.229952    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd25f45_f2dd_49dc_a238_357105a70461.slice/crio-35d02532d101e690482c82a87b383d8584806f3720c6b05e0aa8d787fdd75c53 WatchSource:0}: Error finding container 35d02532d101e690482c82a87b383d8584806f3720c6b05e0aa8d787fdd75c53: Status 404 returned error can't find the container with id 35d02532d101e690482c82a87b383d8584806f3720c6b05e0aa8d787fdd75c53
Jul 27 19:29:59.990726 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:59.990688    2577 generic.go:356] "Generic (PLEG): container finished" podID="4fd25f45-f2dd-49dc-a238-357105a70461" containerID="122ae29c2a6fd1208e5ccf23255a008c96b159ea4c96ec19d2288d5e74ee7277" exitCode=0
Jul 27 19:29:59.991130 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:59.990781    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9" event={"ID":"4fd25f45-f2dd-49dc-a238-357105a70461","Type":"ContainerDied","Data":"122ae29c2a6fd1208e5ccf23255a008c96b159ea4c96ec19d2288d5e74ee7277"}
Jul 27 19:29:59.991130 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:29:59.990837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9" event={"ID":"4fd25f45-f2dd-49dc-a238-357105a70461","Type":"ContainerStarted","Data":"35d02532d101e690482c82a87b383d8584806f3720c6b05e0aa8d787fdd75c53"}
Jul 27 19:30:01.142541 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:01.142511    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"
Jul 27 19:30:01.274488 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:01.274370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd25f45-f2dd-49dc-a238-357105a70461-maas-api-service-ca\") pod \"4fd25f45-f2dd-49dc-a238-357105a70461\" (UID: \"4fd25f45-f2dd-49dc-a238-357105a70461\") "
Jul 27 19:30:01.274786 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:01.274763    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd25f45-f2dd-49dc-a238-357105a70461-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4fd25f45-f2dd-49dc-a238-357105a70461" (UID: "4fd25f45-f2dd-49dc-a238-357105a70461"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:01.375708 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:01.375664    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd25f45-f2dd-49dc-a238-357105a70461-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:02.003882 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:02.003850    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"
Jul 27 19:30:02.004090 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:02.003887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9" event={"ID":"4fd25f45-f2dd-49dc-a238-357105a70461","Type":"ContainerDied","Data":"35d02532d101e690482c82a87b383d8584806f3720c6b05e0aa8d787fdd75c53"}
Jul 27 19:30:02.004090 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:02.003936    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35d02532d101e690482c82a87b383d8584806f3720c6b05e0aa8d787fdd75c53"
Jul 27 19:30:13.194329 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:13.194250    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:30:13.845504 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:13.845466    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"]
Jul 27 19:30:13.848127 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:13.848099    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-de344b-4jbb9"]
Jul 27 19:30:14.511658 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:14.511621    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fd25f45-f2dd-49dc-a238-357105a70461" path="/var/lib/kubelet/pods/4fd25f45-f2dd-49dc-a238-357105a70461/volumes"
Jul 27 19:30:32.717225 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:32.717188    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"]
Jul 27 19:30:32.717734 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:32.717479    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn" podUID="2fffd963-aba1-4f30-ba8b-826451c7760c" containerName="maas-api" containerID="cri-o://62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d" gracePeriod=30
Jul 27 19:30:32.773364 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:32.773328    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"]
Jul 27 19:30:32.773612 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:32.773584    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh" podUID="65008e59-5357-40b8-ba5c-c5ba1f51eaa1" containerName="payload-pre-processing" containerID="cri-o://0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48" gracePeriod=30
Jul 27 19:30:33.031408 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.031382    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:30:33.068581 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.068563    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:30:33.102441 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.102402    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fffd963-aba1-4f30-ba8b-826451c7760c-maas-api-tls\") pod \"2fffd963-aba1-4f30-ba8b-826451c7760c\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") "
Jul 27 19:30:33.102568 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.102528    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fffd963-aba1-4f30-ba8b-826451c7760c-openshift-service-ca\") pod \"2fffd963-aba1-4f30-ba8b-826451c7760c\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") "
Jul 27 19:30:33.102623 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.102590    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9dqr\" (UniqueName: \"kubernetes.io/projected/2fffd963-aba1-4f30-ba8b-826451c7760c-kube-api-access-p9dqr\") pod \"2fffd963-aba1-4f30-ba8b-826451c7760c\" (UID: \"2fffd963-aba1-4f30-ba8b-826451c7760c\") "
Jul 27 19:30:33.102860 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.102827    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fffd963-aba1-4f30-ba8b-826451c7760c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fffd963-aba1-4f30-ba8b-826451c7760c" (UID: "2fffd963-aba1-4f30-ba8b-826451c7760c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:33.102988 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.102946    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fffd963-aba1-4f30-ba8b-826451c7760c-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:33.104879 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.104849    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fffd963-aba1-4f30-ba8b-826451c7760c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fffd963-aba1-4f30-ba8b-826451c7760c" (UID: "2fffd963-aba1-4f30-ba8b-826451c7760c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:30:33.104980 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.104922    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fffd963-aba1-4f30-ba8b-826451c7760c-kube-api-access-p9dqr" (OuterVolumeSpecName: "kube-api-access-p9dqr") pod "2fffd963-aba1-4f30-ba8b-826451c7760c" (UID: "2fffd963-aba1-4f30-ba8b-826451c7760c"). InnerVolumeSpecName "kube-api-access-p9dqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:33.195980 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.195943    2577 generic.go:356] "Generic (PLEG): container finished" podID="2fffd963-aba1-4f30-ba8b-826451c7760c" containerID="62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d" exitCode=0
Jul 27 19:30:33.196136 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.195989    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"
Jul 27 19:30:33.196136 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.196036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn" event={"ID":"2fffd963-aba1-4f30-ba8b-826451c7760c","Type":"ContainerDied","Data":"62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d"}
Jul 27 19:30:33.196136 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.196088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn" event={"ID":"2fffd963-aba1-4f30-ba8b-826451c7760c","Type":"ContainerDied","Data":"cad6e2ed414de30a812b97e145d985c7c6b97294bc6a60845cc14f5fe9fa6d7d"}
Jul 27 19:30:33.196136 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.196119    2577 scope.go:117] "RemoveContainer" containerID="62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d"
Jul 27 19:30:33.197472 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.197409    2577 generic.go:356] "Generic (PLEG): container finished" podID="65008e59-5357-40b8-ba5c-c5ba1f51eaa1" containerID="0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48" exitCode=0
Jul 27 19:30:33.197472 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.197457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh" event={"ID":"65008e59-5357-40b8-ba5c-c5ba1f51eaa1","Type":"ContainerDied","Data":"0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48"}
Jul 27 19:30:33.197626 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.197475    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"
Jul 27 19:30:33.197626 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.197499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh" event={"ID":"65008e59-5357-40b8-ba5c-c5ba1f51eaa1","Type":"ContainerDied","Data":"dd4fb31730d9b98ebad20aed8b318d51b05f3f51b5cd722e851b11f9db58bd0d"}
Jul 27 19:30:33.203475 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.203444    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-plugins-config-volume\") pod \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\" (UID: \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\") "
Jul 27 19:30:33.203618 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.203598    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqmht\" (UniqueName: \"kubernetes.io/projected/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-kube-api-access-sqmht\") pod \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\" (UID: \"65008e59-5357-40b8-ba5c-c5ba1f51eaa1\") "
Jul 27 19:30:33.203848 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.203775    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "65008e59-5357-40b8-ba5c-c5ba1f51eaa1" (UID: "65008e59-5357-40b8-ba5c-c5ba1f51eaa1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:33.203926 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.203913    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-plugins-config-volume\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:33.204014 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.203934    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9dqr\" (UniqueName: \"kubernetes.io/projected/2fffd963-aba1-4f30-ba8b-826451c7760c-kube-api-access-p9dqr\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:33.204014 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.203949    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fffd963-aba1-4f30-ba8b-826451c7760c-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:33.206357 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.206336    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-kube-api-access-sqmht" (OuterVolumeSpecName: "kube-api-access-sqmht") pod "65008e59-5357-40b8-ba5c-c5ba1f51eaa1" (UID: "65008e59-5357-40b8-ba5c-c5ba1f51eaa1"). InnerVolumeSpecName "kube-api-access-sqmht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:33.207753 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.207737    2577 scope.go:117] "RemoveContainer" containerID="62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d"
Jul 27 19:30:33.208004 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:30:33.207981    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d\": container with ID starting with 62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d not found: ID does not exist" containerID="62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d"
Jul 27 19:30:33.208071 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.208014    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d"} err="failed to get container status \"62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d\": rpc error: code = NotFound desc = could not find container \"62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d\": container with ID starting with 62ad44a9f85376ba83cbfe6752b87e0d264e81b2a02f01b22ad1e7f1c9cb0c5d not found: ID does not exist"
Jul 27 19:30:33.208071 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.208029    2577 scope.go:117] "RemoveContainer" containerID="0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48"
Jul 27 19:30:33.216596 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.216576    2577 scope.go:117] "RemoveContainer" containerID="0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48"
Jul 27 19:30:33.216906 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:30:33.216885    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48\": container with ID starting with 0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48 not found: ID does not exist" containerID="0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48"
Jul 27 19:30:33.216969 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.216912    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48"} err="failed to get container status \"0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48\": rpc error: code = NotFound desc = could not find container \"0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48\": container with ID starting with 0789d8d7c0b30b31c6b3c0e85cbe5ab1d194a4cf0f21e861677950250b954e48 not found: ID does not exist"
Jul 27 19:30:33.218627 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.218609    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"]
Jul 27 19:30:33.222312 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.222292    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ab99e9-ddc49c95d-4mstn"]
Jul 27 19:30:33.304878 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.304808    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqmht\" (UniqueName: \"kubernetes.io/projected/65008e59-5357-40b8-ba5c-c5ba1f51eaa1-kube-api-access-sqmht\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:33.520353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.520321    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"]
Jul 27 19:30:33.523664 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:33.523638    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ab99e9-8b676597b-f5wmh"]
Jul 27 19:30:34.511127 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:34.511095    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fffd963-aba1-4f30-ba8b-826451c7760c" path="/var/lib/kubelet/pods/2fffd963-aba1-4f30-ba8b-826451c7760c/volumes"
Jul 27 19:30:34.511530 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:34.511482    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65008e59-5357-40b8-ba5c-c5ba1f51eaa1" path="/var/lib/kubelet/pods/65008e59-5357-40b8-ba5c-c5ba1f51eaa1/volumes"
Jul 27 19:30:35.987723 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:35.987680    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hnkcp"]
Jul 27 19:30:43.302079 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:43.301991    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"]
Jul 27 19:30:43.302450 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:43.302256    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy" containerID="cri-o://ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a" gracePeriod=30
Jul 27 19:30:43.972484 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:43.972451    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f4fc4b65f-8fgcs_1dc1439b-2a69-4d1d-a567-c40678a1df6f/authorino/0.log"
Jul 27 19:30:48.565213 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.565150    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:30:48.651170 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651131    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-data\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651170 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651169    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-envoy\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651457 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651241    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istiod-ca-cert\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651457 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651263    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-token\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651457 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651281    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-socket\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651457 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651317    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-podinfo\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651457 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651352    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-credential-socket\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651457 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651372    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqjd5\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-kube-api-access-qqjd5\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651457 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651399    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-certs\") pod \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\" (UID: \"119f40fe-a8dc-4f4f-8e70-b05af9b107ec\") "
Jul 27 19:30:48.651835 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651627    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:48.651835 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651728    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:48.651835 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651734    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:48.651989 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.651963    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:48.652266 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.652244    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:48.653665 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.653635    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:48.653920 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.653902    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-kube-api-access-qqjd5" (OuterVolumeSpecName: "kube-api-access-qqjd5") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "kube-api-access-qqjd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:48.654192 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.654171    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:48.654192 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.654181    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "119f40fe-a8dc-4f4f-8e70-b05af9b107ec" (UID: "119f40fe-a8dc-4f4f-8e70-b05af9b107ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:30:48.752523 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752488    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:48.752523 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752516    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:48.752523 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752524    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:48.752760 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752535    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:48.752760 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752543    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:48.752760 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752553    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqjd5\" (UniqueName: \"kubernetes.io/projected/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-kube-api-access-qqjd5\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:48.752760 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752562    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:48.752760 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752570    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:48.752760 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:48.752578    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119f40fe-a8dc-4f4f-8e70-b05af9b107ec-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 27 19:30:49.150189 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.150152    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r972m_b0b29033-f0ce-4330-b340-c141e2739b16/manager/0.log"
Jul 27 19:30:49.260393 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.260353    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j5pxg_8afed296-cb00-4e53-957a-3d2c6c5341dc/manager/0.log"
Jul 27 19:30:49.298059 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.298021    2577 generic.go:356] "Generic (PLEG): container finished" podID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerID="ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a" exitCode=0
Jul 27 19:30:49.298251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.298076    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"
Jul 27 19:30:49.298251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.298103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" event={"ID":"119f40fe-a8dc-4f4f-8e70-b05af9b107ec","Type":"ContainerDied","Data":"ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a"}
Jul 27 19:30:49.298251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.298155    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg" event={"ID":"119f40fe-a8dc-4f4f-8e70-b05af9b107ec","Type":"ContainerDied","Data":"9f22bb887d257d61f3d477c6e82d9fb8b0b7ab994fad419f0b6a54ce141e6b37"}
Jul 27 19:30:49.298251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.298177    2577 scope.go:117] "RemoveContainer" containerID="ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a"
Jul 27 19:30:49.308995 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.308975    2577 scope.go:117] "RemoveContainer" containerID="08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7"
Jul 27 19:30:49.317957 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.317936    2577 scope.go:117] "RemoveContainer" containerID="ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a"
Jul 27 19:30:49.318244 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:30:49.318223    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a\": container with ID starting with ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a not found: ID does not exist" containerID="ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a"
Jul 27 19:30:49.318315 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.318253    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a"} err="failed to get container status \"ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a\": rpc error: code = NotFound desc = could not find container \"ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a\": container with ID starting with ef68355a65629fde2a7765be96db1517ce545a7c02b4a24607d6c3fc25f91e1a not found: ID does not exist"
Jul 27 19:30:49.318315 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.318272    2577 scope.go:117] "RemoveContainer" containerID="08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7"
Jul 27 19:30:49.318569 ip-10-0-131-150 kubenswrapper[2577]: E0727 19:30:49.318519    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7\": container with ID starting with 08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7 not found: ID does not exist" containerID="08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7"
Jul 27 19:30:49.318569 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.318542    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7"} err="failed to get container status \"08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7\": rpc error: code = NotFound desc = could not find container \"08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7\": container with ID starting with 08dd2f76633f1f81170fb600331c7567ba2242516d7c2d295aa165e99a0205a7 not found: ID does not exist"
Jul 27 19:30:49.322336 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.322313    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"]
Jul 27 19:30:49.328962 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.328940    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ab99e9-openshift-default-696fc7b5f6-mj2zg"]
Jul 27 19:30:49.494769 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.494679    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7bdv9_46a35022-86b5-480d-aea1-f208711a62e2/server/0.log"
Jul 27 19:30:49.613817 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.613791    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dcjwm_4bbdfbcc-06eb-4f89-8070-74804ce88da8/manager/0.log"
Jul 27 19:30:49.719296 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.719268    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfd8c75b7-5d2px_12cd2737-eef3-4d00-b0ed-ecb9c112a8bb/copy-manifests/0.log"
Jul 27 19:30:49.732102 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:49.732067    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfd8c75b7-5d2px_12cd2737-eef3-4d00-b0ed-ecb9c112a8bb/manager/0.log"
Jul 27 19:30:50.511105 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:50.511071    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" path="/var/lib/kubelet/pods/119f40fe-a8dc-4f4f-8e70-b05af9b107ec/volumes"
Jul 27 19:30:51.170698 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.170669    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp_9023a0e6-dc74-4c73-b7d5-f6136071bb8d/util/0.log"
Jul 27 19:30:51.188568 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.188535    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp_9023a0e6-dc74-4c73-b7d5-f6136071bb8d/pull/0.log"
Jul 27 19:30:51.206186 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.206162    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp_9023a0e6-dc74-4c73-b7d5-f6136071bb8d/extract/0.log"
Jul 27 19:30:51.319453 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.319404    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42_9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4/util/0.log"
Jul 27 19:30:51.325482 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.325462    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42_9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4/pull/0.log"
Jul 27 19:30:51.331367 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.331350    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42_9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4/extract/0.log"
Jul 27 19:30:51.434975 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.434903    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4_007b3ae2-001d-4683-be40-ce18213745c3/util/0.log"
Jul 27 19:30:51.440564 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.440540    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4_007b3ae2-001d-4683-be40-ce18213745c3/pull/0.log"
Jul 27 19:30:51.449834 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.449811    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4_007b3ae2-001d-4683-be40-ce18213745c3/extract/0.log"
Jul 27 19:30:51.559180 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.559152    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq_27d9b599-3bff-43ec-8354-6633bbd06674/extract/0.log"
Jul 27 19:30:51.564368 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.564349    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq_27d9b599-3bff-43ec-8354-6633bbd06674/util/0.log"
Jul 27 19:30:51.569640 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.569622    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq_27d9b599-3bff-43ec-8354-6633bbd06674/pull/0.log"
Jul 27 19:30:51.686835 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.686742    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f4fc4b65f-8fgcs_1dc1439b-2a69-4d1d-a567-c40678a1df6f/authorino/0.log"
Jul 27 19:30:51.804851 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.804825    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-clv2p_87d1fe8d-59d7-4d9f-8e04-45beec435d2a/manager/0.log"
Jul 27 19:30:51.913018 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:51.912983    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fwxqc_68d84c2d-f462-4a47-89a9-1cb83fb0b3c6/manager/0.log"
Jul 27 19:30:52.133573 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:52.133542    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-shptk_7cf040ab-7f37-4db4-a3b9-25f58b082d65/registry-server/0.log"
Jul 27 19:30:52.245503 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:52.245476    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q2vbw_cc63d903-89e3-4e20-b65d-e9340fcc6634/manager/0.log"
Jul 27 19:30:52.351746 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:52.351711    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hnkcp_a76ebd8a-71df-4b68-8351-5fff9191968c/limitador/0.log"
Jul 27 19:30:52.460556 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:52.460486    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d2vnm_9e2653c9-d515-4ebe-98d3-f61b8d9d6bee/manager/0.log"
Jul 27 19:30:52.799050 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:52.798974    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799csftmj_5e87a6b8-027b-49cd-895c-fa368a9d595b/istio-proxy/0.log"
Jul 27 19:30:53.023004 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:53.022980    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55894cd494-6gdh8_6ca57049-13b6-438e-844f-65197e11a830/kube-auth-proxy/0.log"
Jul 27 19:30:53.585614 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:53.585586    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d6f6d9bc-nclnf_cf480830-7a43-4eb4-8af9-f13906b92ece/router/0.log"
Jul 27 19:30:59.443729 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.443684    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdk7g/must-gather-w9cc8"]
Jul 27 19:30:59.444149 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444133    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65008e59-5357-40b8-ba5c-c5ba1f51eaa1" containerName="payload-pre-processing"
Jul 27 19:30:59.444195 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444152    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="65008e59-5357-40b8-ba5c-c5ba1f51eaa1" containerName="payload-pre-processing"
Jul 27 19:30:59.444195 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444165    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy"
Jul 27 19:30:59.444195 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444171    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy"
Jul 27 19:30:59.444195 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444183    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd25f45-f2dd-49dc-a238-357105a70461" containerName="revoke-keys"
Jul 27 19:30:59.444195 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444188    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd25f45-f2dd-49dc-a238-357105a70461" containerName="revoke-keys"
Jul 27 19:30:59.444353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444208    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fffd963-aba1-4f30-ba8b-826451c7760c" containerName="maas-api"
Jul 27 19:30:59.444353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444214    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fffd963-aba1-4f30-ba8b-826451c7760c" containerName="maas-api"
Jul 27 19:30:59.444353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444272    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy"
Jul 27 19:30:59.444353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444280    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd25f45-f2dd-49dc-a238-357105a70461" containerName="revoke-keys"
Jul 27 19:30:59.444353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444288    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy"
Jul 27 19:30:59.444353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444295    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fffd963-aba1-4f30-ba8b-826451c7760c" containerName="maas-api"
Jul 27 19:30:59.444353 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444303    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="65008e59-5357-40b8-ba5c-c5ba1f51eaa1" containerName="payload-pre-processing"
Jul 27 19:30:59.444579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444363    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy"
Jul 27 19:30:59.444579 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.444369    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="119f40fe-a8dc-4f4f-8e70-b05af9b107ec" containerName="istio-proxy"
Jul 27 19:30:59.447360 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.447343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdk7g/must-gather-w9cc8"
Jul 27 19:30:59.450519 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.450493    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jdk7g\"/\"default-dockercfg-tdhxf\""
Jul 27 19:30:59.450627 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.450574    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdk7g\"/\"openshift-service-ca.crt\""
Jul 27 19:30:59.450627 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.450610    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdk7g\"/\"kube-root-ca.crt\""
Jul 27 19:30:59.455525 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.455500    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdk7g/must-gather-w9cc8"]
Jul 27 19:30:59.545851 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.545814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5d0d9d88-fb41-4d06-9777-adc4f90a1521-must-gather-output\") pod \"must-gather-w9cc8\" (UID: \"5d0d9d88-fb41-4d06-9777-adc4f90a1521\") " pod="openshift-must-gather-jdk7g/must-gather-w9cc8"
Jul 27 19:30:59.546028 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.545864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmxkg\" (UniqueName: \"kubernetes.io/projected/5d0d9d88-fb41-4d06-9777-adc4f90a1521-kube-api-access-bmxkg\") pod \"must-gather-w9cc8\" (UID: \"5d0d9d88-fb41-4d06-9777-adc4f90a1521\") " pod="openshift-must-gather-jdk7g/must-gather-w9cc8"
Jul 27 19:30:59.646698 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.646658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5d0d9d88-fb41-4d06-9777-adc4f90a1521-must-gather-output\") pod \"must-gather-w9cc8\" (UID: \"5d0d9d88-fb41-4d06-9777-adc4f90a1521\") " pod="openshift-must-gather-jdk7g/must-gather-w9cc8"
Jul 27 19:30:59.646868 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.646724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmxkg\" (UniqueName: \"kubernetes.io/projected/5d0d9d88-fb41-4d06-9777-adc4f90a1521-kube-api-access-bmxkg\") pod \"must-gather-w9cc8\" (UID: \"5d0d9d88-fb41-4d06-9777-adc4f90a1521\") " pod="openshift-must-gather-jdk7g/must-gather-w9cc8"
Jul 27 19:30:59.647029 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.647013    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5d0d9d88-fb41-4d06-9777-adc4f90a1521-must-gather-output\") pod \"must-gather-w9cc8\" (UID: \"5d0d9d88-fb41-4d06-9777-adc4f90a1521\") " pod="openshift-must-gather-jdk7g/must-gather-w9cc8"
Jul 27 19:30:59.655275 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.655246    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmxkg\" (UniqueName: \"kubernetes.io/projected/5d0d9d88-fb41-4d06-9777-adc4f90a1521-kube-api-access-bmxkg\") pod \"must-gather-w9cc8\" (UID: \"5d0d9d88-fb41-4d06-9777-adc4f90a1521\") " pod="openshift-must-gather-jdk7g/must-gather-w9cc8"
Jul 27 19:30:59.758312 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.758222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdk7g/must-gather-w9cc8"
Jul 27 19:30:59.899651 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.899622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdk7g/must-gather-w9cc8"]
Jul 27 19:30:59.900737 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:30:59.900712    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d0d9d88_fb41_4d06_9777_adc4f90a1521.slice/crio-695d493d1f2982da6c38f9b191a0b6afcdce14a3bcc60de026ecf37ec152ad0e WatchSource:0}: Error finding container 695d493d1f2982da6c38f9b191a0b6afcdce14a3bcc60de026ecf37ec152ad0e: Status 404 returned error can't find the container with id 695d493d1f2982da6c38f9b191a0b6afcdce14a3bcc60de026ecf37ec152ad0e
Jul 27 19:30:59.902609 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:30:59.902591    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:31:00.364994 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:00.364960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdk7g/must-gather-w9cc8" event={"ID":"5d0d9d88-fb41-4d06-9777-adc4f90a1521","Type":"ContainerStarted","Data":"695d493d1f2982da6c38f9b191a0b6afcdce14a3bcc60de026ecf37ec152ad0e"}
Jul 27 19:31:01.377769 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:01.377718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdk7g/must-gather-w9cc8" event={"ID":"5d0d9d88-fb41-4d06-9777-adc4f90a1521","Type":"ContainerStarted","Data":"bd274a86d8663544a828d3539faa4685ff1da3c7afab62e67fbfa02e7ff18dd8"}
Jul 27 19:31:01.378259 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:01.377788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdk7g/must-gather-w9cc8" event={"ID":"5d0d9d88-fb41-4d06-9777-adc4f90a1521","Type":"ContainerStarted","Data":"d22f25f4f3e3891f3c7ae8d41439dbe244cb1e0ad284ed3ac2a2d03a5223a06f"}
Jul 27 19:31:01.398134 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:01.398069    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jdk7g/must-gather-w9cc8" podStartSLOduration=1.6686420979999999 podStartE2EDuration="2.398047065s" totalImagesPullingTime="729.404967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:01.396417924 +0000 UTC m=+3559.479700777" watchObservedRunningTime="2026-07-27 19:31:01.398047065 +0000 UTC m=+3559.481329917"
Jul 27 19:31:02.218170 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:02.218139    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5ptpt_51c944a0-a2c5-4d5b-b6a7-319785065563/global-pull-secret-syncer/0.log"
Jul 27 19:31:02.509323 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:02.509206    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-st8t2_b29c9fff-aeed-4b9f-846d-8f4b8a1c5da4/konnectivity-agent/0.log"
Jul 27 19:31:02.531827 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:02.531792    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-150.ec2.internal_1188e37e92b4900d2886b98231ddef72/haproxy/0.log"
Jul 27 19:31:06.190792 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.190755    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp_9023a0e6-dc74-4c73-b7d5-f6136071bb8d/extract/0.log"
Jul 27 19:31:06.216236 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.216211    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp_9023a0e6-dc74-4c73-b7d5-f6136071bb8d/util/0.log"
Jul 27 19:31:06.245237 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.245212    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n6lqp_9023a0e6-dc74-4c73-b7d5-f6136071bb8d/pull/0.log"
Jul 27 19:31:06.272475 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.272447    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42_9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4/extract/0.log"
Jul 27 19:31:06.296156 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.296108    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42_9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4/util/0.log"
Jul 27 19:31:06.318386 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.318317    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pfn42_9c65be2a-3b7c-4e5f-9c0a-8c4fdf4a22b4/pull/0.log"
Jul 27 19:31:06.346359 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.346332    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4_007b3ae2-001d-4683-be40-ce18213745c3/extract/0.log"
Jul 27 19:31:06.371782 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.371755    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4_007b3ae2-001d-4683-be40-ce18213745c3/util/0.log"
Jul 27 19:31:06.395192 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.395161    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vk4t4_007b3ae2-001d-4683-be40-ce18213745c3/pull/0.log"
Jul 27 19:31:06.426521 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.426488    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq_27d9b599-3bff-43ec-8354-6633bbd06674/extract/0.log"
Jul 27 19:31:06.463534 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.463451    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq_27d9b599-3bff-43ec-8354-6633bbd06674/util/0.log"
Jul 27 19:31:06.485062 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:06.485037    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gl5hq_27d9b599-3bff-43ec-8354-6633bbd06674/pull/0.log"
Jul 27 19:31:07.002524 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:07.002491    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f4fc4b65f-8fgcs_1dc1439b-2a69-4d1d-a567-c40678a1df6f/authorino/0.log"
Jul 27 19:31:07.046566 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:07.046522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-clv2p_87d1fe8d-59d7-4d9f-8e04-45beec435d2a/manager/0.log"
Jul 27 19:31:07.072696 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:07.072638    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fwxqc_68d84c2d-f462-4a47-89a9-1cb83fb0b3c6/manager/0.log"
Jul 27 19:31:07.161706 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:07.161654    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-shptk_7cf040ab-7f37-4db4-a3b9-25f58b082d65/registry-server/0.log"
Jul 27 19:31:07.395974 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:07.395939    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q2vbw_cc63d903-89e3-4e20-b65d-e9340fcc6634/manager/0.log"
Jul 27 19:31:07.427499 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:07.427470    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hnkcp_a76ebd8a-71df-4b68-8351-5fff9191968c/limitador/0.log"
Jul 27 19:31:07.524587 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:07.524453    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d2vnm_9e2653c9-d515-4ebe-98d3-f61b8d9d6bee/manager/0.log"
Jul 27 19:31:09.395535 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.395501    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-v9rm8_7f73a47f-ed0f-4737-93d9-37d68157e388/kube-state-metrics/0.log"
Jul 27 19:31:09.414246 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.414164    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-v9rm8_7f73a47f-ed0f-4737-93d9-37d68157e388/kube-rbac-proxy-main/0.log"
Jul 27 19:31:09.437164 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.437131    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-v9rm8_7f73a47f-ed0f-4737-93d9-37d68157e388/kube-rbac-proxy-self/0.log"
Jul 27 19:31:09.467842 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.467798    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bbcd8d5bd-pq9vh_e000bdef-a886-4bc8-b199-aecf7928a518/metrics-server/0.log"
Jul 27 19:31:09.498693 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.498661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-xpl9g_e8a3d052-a123-4927-828a-13a89de61c9b/monitoring-plugin/0.log"
Jul 27 19:31:09.618330 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.618299    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97j9d_d22adf8f-5aa5-4c9b-a87f-48c601238259/node-exporter/0.log"
Jul 27 19:31:09.645656 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.645544    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97j9d_d22adf8f-5aa5-4c9b-a87f-48c601238259/kube-rbac-proxy/0.log"
Jul 27 19:31:09.665575 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.665541    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97j9d_d22adf8f-5aa5-4c9b-a87f-48c601238259/init-textfile/0.log"
Jul 27 19:31:09.843805 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.843774    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-fsjhr_fcb13f38-24d7-4bdb-9f87-a1034c642ddc/kube-rbac-proxy-main/0.log"
Jul 27 19:31:09.911266 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.911150    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-fsjhr_fcb13f38-24d7-4bdb-9f87-a1034c642ddc/kube-rbac-proxy-self/0.log"
Jul 27 19:31:09.953144 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:09.953062    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-fsjhr_fcb13f38-24d7-4bdb-9f87-a1034c642ddc/openshift-state-metrics/0.log"
Jul 27 19:31:10.173957 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.173874    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-6h7sd_0affa3e2-2ab7-410d-921c-f7caedbd11d7/prometheus-operator/0.log"
Jul 27 19:31:10.196397 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.196360    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-6h7sd_0affa3e2-2ab7-410d-921c-f7caedbd11d7/kube-rbac-proxy/0.log"
Jul 27 19:31:10.254775 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.254737    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d4978cbd5-zgw9g_d1a8189e-45ea-4862-8689-320bea1297b2/telemeter-client/0.log"
Jul 27 19:31:10.277995 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.277962    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d4978cbd5-zgw9g_d1a8189e-45ea-4862-8689-320bea1297b2/reload/0.log"
Jul 27 19:31:10.298915 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.298881    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d4978cbd5-zgw9g_d1a8189e-45ea-4862-8689-320bea1297b2/kube-rbac-proxy/0.log"
Jul 27 19:31:10.368981 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.368949    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7794d7dd9f-7qzfb_7104f9d5-f368-48fe-aa8e-4a7b9d626f3b/thanos-query/0.log"
Jul 27 19:31:10.391104 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.391071    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7794d7dd9f-7qzfb_7104f9d5-f368-48fe-aa8e-4a7b9d626f3b/kube-rbac-proxy-web/0.log"
Jul 27 19:31:10.419079 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.419045    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7794d7dd9f-7qzfb_7104f9d5-f368-48fe-aa8e-4a7b9d626f3b/kube-rbac-proxy/0.log"
Jul 27 19:31:10.446664 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.446593    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7794d7dd9f-7qzfb_7104f9d5-f368-48fe-aa8e-4a7b9d626f3b/prom-label-proxy/0.log"
Jul 27 19:31:10.468873 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.468846    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7794d7dd9f-7qzfb_7104f9d5-f368-48fe-aa8e-4a7b9d626f3b/kube-rbac-proxy-rules/0.log"
Jul 27 19:31:10.490319 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:10.490283    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7794d7dd9f-7qzfb_7104f9d5-f368-48fe-aa8e-4a7b9d626f3b/kube-rbac-proxy-metrics/0.log"
Jul 27 19:31:12.797301 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:12.797267    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"]
Jul 27 19:31:12.800469 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:12.800446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:12.808221 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:12.808197    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"]
Jul 27 19:31:12.926250 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:12.926207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-lib-modules\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:12.926476 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:12.926343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-proc\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:12.926476 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:12.926380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-podres\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:12.926476 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:12.926410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-sys\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:12.926670 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:12.926483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc9mj\" (UniqueName: \"kubernetes.io/projected/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-kube-api-access-sc9mj\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.027803 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.027754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-proc\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.028001 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.027820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-podres\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.028001 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.027853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-sys\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.028001 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.027896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc9mj\" (UniqueName: \"kubernetes.io/projected/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-kube-api-access-sc9mj\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.028001 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.027949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-lib-modules\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.028220 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.028189    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-lib-modules\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.028278 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.028250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-proc\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.028346 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.028324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-podres\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.028400 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.028384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-sys\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.039317 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.039038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc9mj\" (UniqueName: \"kubernetes.io/projected/fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe-kube-api-access-sc9mj\") pod \"perf-node-gather-daemonset-nqhbg\" (UID: \"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.078169 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.078096    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f8fd5bb9b-jschq_e3c7e0a9-64a4-444e-b1a0-ff5d2b414701/console/0.log"
Jul 27 19:31:13.117752 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.117721    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-s6rc7_df32777f-f9f3-4b31-9bc4-3a69cec6047f/download-server/0.log"
Jul 27 19:31:13.117752 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.117729    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.314568 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.314538    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"]
Jul 27 19:31:13.317249 ip-10-0-131-150 kubenswrapper[2577]: W0727 19:31:13.317219    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfdefa60a_75d1_4c20_bf9c_70e0f14b7ffe.slice/crio-d86f34340ad4830bd885382d5e5d534e6c43c2b387976a46cac266cc7c7d881f WatchSource:0}: Error finding container d86f34340ad4830bd885382d5e5d534e6c43c2b387976a46cac266cc7c7d881f: Status 404 returned error can't find the container with id d86f34340ad4830bd885382d5e5d534e6c43c2b387976a46cac266cc7c7d881f
Jul 27 19:31:13.493718 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.493677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg" event={"ID":"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe","Type":"ContainerStarted","Data":"33821ef382bf0eefa572e8f873f203cab389b8ac5cc565d1ab067d11db584264"}
Jul 27 19:31:13.493937 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.493745    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg" event={"ID":"fdefa60a-75d1-4c20-bf9c-70e0f14b7ffe","Type":"ContainerStarted","Data":"d86f34340ad4830bd885382d5e5d534e6c43c2b387976a46cac266cc7c7d881f"}
Jul 27 19:31:13.494170 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.494147    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:13.511849 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:13.511768    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg" podStartSLOduration=1.511744405 podStartE2EDuration="1.511744405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:13.510368999 +0000 UTC m=+3571.593651851" watchObservedRunningTime="2026-07-27 19:31:13.511744405 +0000 UTC m=+3571.595027257"
Jul 27 19:31:14.778751 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:14.778711    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ss2h2_40cb2b19-a295-4478-982e-b36ff0580035/dns/0.log"
Jul 27 19:31:14.798619 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:14.798578    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ss2h2_40cb2b19-a295-4478-982e-b36ff0580035/kube-rbac-proxy/0.log"
Jul 27 19:31:14.933975 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:14.933945    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hsjf_f1f8451a-5cfb-4406-bddf-f5d36e4b02eb/dns-node-resolver/0.log"
Jul 27 19:31:15.507728 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:15.507696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-784b6d6fd5-kjwfl_5dad04e5-18b9-41ae-9e93-b0f73b0f760c/registry/0.log"
Jul 27 19:31:15.530324 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:15.530273    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8n6m_81b20ee1-9827-4fbe-9fa8-c8bc2825eb3f/node-ca/0.log"
Jul 27 19:31:16.589399 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:16.589367    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799csftmj_5e87a6b8-027b-49cd-895c-fa368a9d595b/istio-proxy/0.log"
Jul 27 19:31:16.834037 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:16.834013    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55894cd494-6gdh8_6ca57049-13b6-438e-844f-65197e11a830/kube-auth-proxy/0.log"
Jul 27 19:31:17.084448 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:17.084396    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d6f6d9bc-nclnf_cf480830-7a43-4eb4-8af9-f13906b92ece/router/0.log"
Jul 27 19:31:17.973541 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:17.973507    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j2zlr_67da426f-7a87-4387-a1d6-4b7b573e9449/serve-healthcheck-canary/0.log"
Jul 27 19:31:18.567011 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:18.566979    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gqfk5_d62bb39d-a949-4a30-9c1c-5319e80934ef/kube-rbac-proxy/0.log"
Jul 27 19:31:18.588218 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:18.588163    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gqfk5_d62bb39d-a949-4a30-9c1c-5319e80934ef/exporter/0.log"
Jul 27 19:31:18.608547 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:18.608518    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gqfk5_d62bb39d-a949-4a30-9c1c-5319e80934ef/extractor/0.log"
Jul 27 19:31:19.512727 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:19.512700    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-nqhbg"
Jul 27 19:31:20.794200 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:20.794168    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r972m_b0b29033-f0ce-4330-b340-c141e2739b16/manager/0.log"
Jul 27 19:31:21.100809 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:21.100536    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j5pxg_8afed296-cb00-4e53-957a-3d2c6c5341dc/manager/0.log"
Jul 27 19:31:21.313461 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:21.313010    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7bdv9_46a35022-86b5-480d-aea1-f208711a62e2/server/0.log"
Jul 27 19:31:21.419574 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:21.419452    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dcjwm_4bbdfbcc-06eb-4f89-8070-74804ce88da8/manager/0.log"
Jul 27 19:31:21.527255 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:21.527221    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfd8c75b7-5d2px_12cd2737-eef3-4d00-b0ed-ecb9c112a8bb/manager/0.log"
Jul 27 19:31:21.547291 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:21.547256    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfd8c75b7-5d2px_12cd2737-eef3-4d00-b0ed-ecb9c112a8bb/copy-manifests/0.log"
Jul 27 19:31:23.161154 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:23.161119    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gmjxl_d7883ccb-ed50-4d4e-b19c-bb9353fb19ed/openshift-lws-operator/0.log"
Jul 27 19:31:23.344876 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:23.344844    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799csftmj_5e87a6b8-027b-49cd-895c-fa368a9d595b/istio-proxy/0.log"
Jul 27 19:31:23.519287 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:23.519256    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55894cd494-6gdh8_6ca57049-13b6-438e-844f-65197e11a830/kube-auth-proxy/0.log"
Jul 27 19:31:23.638037 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:23.637956    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d6f6d9bc-nclnf_cf480830-7a43-4eb4-8af9-f13906b92ece/router/0.log"
Jul 27 19:31:25.058040 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:25.058014    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799csftmj_5e87a6b8-027b-49cd-895c-fa368a9d595b/istio-proxy/0.log"
Jul 27 19:31:25.218946 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:25.218881    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55894cd494-6gdh8_6ca57049-13b6-438e-844f-65197e11a830/kube-auth-proxy/0.log"
Jul 27 19:31:25.344558 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:25.344464    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79d6f6d9bc-nclnf_cf480830-7a43-4eb4-8af9-f13906b92ece/router/0.log"
Jul 27 19:31:28.555065 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:28.555033    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d_37586f43-d6b2-405a-91c3-0fd8d982b653/kube-storage-version-migrator-operator/1.log"
Jul 27 19:31:28.555877 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:28.555858    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-5cn5d_37586f43-d6b2-405a-91c3-0fd8d982b653/kube-storage-version-migrator-operator/0.log"
Jul 27 19:31:29.594412 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:29.594385    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmwqb_8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a/kube-multus-additional-cni-plugins/0.log"
Jul 27 19:31:29.614960 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:29.614935    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmwqb_8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a/egress-router-binary-copy/0.log"
Jul 27 19:31:29.640028 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:29.639998    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmwqb_8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a/cni-plugins/0.log"
Jul 27 19:31:29.665251 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:29.665222    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmwqb_8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a/bond-cni-plugin/0.log"
Jul 27 19:31:29.686935 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:29.686910    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmwqb_8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a/routeoverride-cni/0.log"
Jul 27 19:31:29.709345 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:29.709312    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmwqb_8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a/whereabouts-cni-bincopy/0.log"
Jul 27 19:31:29.731644 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:29.731610    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmwqb_8f7c1f68-3933-46d2-8c97-fce3ceb9cf1a/whereabouts-cni/0.log"
Jul 27 19:31:30.122031 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:30.121993    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tnskz_10448c7c-bc43-4b5e-9903-df965f107fd6/kube-multus/0.log"
Jul 27 19:31:30.265664 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:30.265636    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qpflx_7daab18b-6c87-4142-986f-fc177bd358f4/network-metrics-daemon/0.log"
Jul 27 19:31:30.287354 ip-10-0-131-150 kubenswrapper[2577]: I0727 19:31:30.287320    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qpflx_7daab18b-6c87-4142-986f-fc177bd358f4/kube-rbac-proxy/0.log"