Jul 27 19:03:09.424954 ip-10-0-142-171 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 19:03:09.424970 ip-10-0-142-171 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 19:03:09.424980 ip-10-0-142-171 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 19:03:09.425328 ip-10-0-142-171 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 19:03:19.591916 ip-10-0-142-171 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 19:03:19.591934 ip-10-0-142-171 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8d57bb02f6b74b419fb8843f004e8390 --
Jul 27 19:05:13.172081 ip-10-0-142-171 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 19:05:13.580509 ip-10-0-142-171 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:13.580509 ip-10-0-142-171 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 19:05:13.580509 ip-10-0-142-171 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:13.580509 ip-10-0-142-171 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 19:05:13.580509 ip-10-0-142-171 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:13.582146 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.582012    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 19:05:13.586524 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586508    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:13.586524 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586524    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586527    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586531    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586534    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586539    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586542    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586545    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586548    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586550    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586553    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586555    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586558    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586560    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586563    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586565    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586568    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586571    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586573    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586577    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586580    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:13.586583 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586582    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586585    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586587    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586590    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586593    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586596    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586598    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586601    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586604    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586607    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586609    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586611    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586616    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586619    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586622    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586625    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586638    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586641    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586644    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:13.587066 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586646    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586649    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586653    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586657    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586660    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586662    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586665    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586667    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586669    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586672    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586674    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586676    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586680    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586683    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586685    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586689    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586691    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586694    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586697    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586700    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:13.587519 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586702    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586705    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586707    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586710    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586714    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586717    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586719    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586722    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586725    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586727    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586730    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586733    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586735    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586737    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586740    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586743    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586746    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586748    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586750    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:13.588022 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586753    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586756    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586758    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586760    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586763    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586765    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586768    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586771    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586774    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586777    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586779    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586782    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586784    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586786    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586789    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586791    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586794    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586796    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586799    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.586801    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:13.588471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587492    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587499    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587502    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587505    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587508    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587511    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587513    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587516    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587518    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587523    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587527    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587530    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587533    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587536    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587539    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587541    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587544    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587547    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587550    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:13.588956 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587553    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587557    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587560    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587563    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587567    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587569    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587572    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587574    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587576    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587579    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587581    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587584    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587586    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587589    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587591    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587594    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587596    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587599    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587603    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587606    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:13.589449 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587608    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587611    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587613    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587615    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587618    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587620    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587623    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587625    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587628    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587630    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587632    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587635    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587638    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587642    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587644    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587647    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587649    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587652    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587654    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:13.589949 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587657    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587660    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587662    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587664    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587712    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587716    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587719    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587722    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587726    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587728    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587731    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587734    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587737    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587739    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587742    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587744    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587746    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587749    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587751    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587756    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587758    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:13.590410 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587761    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587763    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587765    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587768    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587770    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587773    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587776    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587779    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587782    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587784    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587787    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587791    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587794    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587797    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587799    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587802    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587820    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587823    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587825    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:13.590944 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.587828    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588181    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588185    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588188    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588191    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588193    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588196    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588199    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588201    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588204    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588206    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588209    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588212    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588214    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588216    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588219    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588221    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588224    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588227    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588230    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:13.591390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588232    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588235    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588237    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588240    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588244    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588248    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588251    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588253    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588256    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588259    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588261    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588265    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588269    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588272    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588275    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588278    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588281    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588283    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588286    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:13.591888 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588289    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588291    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588294    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588297    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588299    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588302    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588304    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588306    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588309    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588311    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588314    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588319    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588322    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588327    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588329    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588332    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588334    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588337    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588339    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588342    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:13.592334 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588344    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588346    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588350    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588353    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588356    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588361    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588363    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588366    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588369    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588371    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588374    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588376    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588379    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588381    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588384    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588386    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588389    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588391    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588394    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:13.592816 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588396    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588399    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588401    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588405    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588409    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588411    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588414    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588417    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588419    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588421    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588424    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588426    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588429    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588431    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588434    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588436    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588439    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588441    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588443    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588446    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:13.593279 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588448    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.588451    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588519    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588525    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588531    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588536    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588539    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588542    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588546    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588550    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588553    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588556    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588559    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588562    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588565    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588569    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588573    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588575    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588578    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588582    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588586    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588589    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588592    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588595    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 19:05:13.593854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588598    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588601    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588604    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588607    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588610    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588613    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588616    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588618    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588621    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588624    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588628    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588630    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588633    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588636    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588639    2557 flags.go:64] FLAG: --enable-server="true"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588641    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588646    2557 flags.go:64] FLAG: --event-burst="100"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588648    2557 flags.go:64] FLAG: --event-qps="50"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588651    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588654    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588657    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588660    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588663    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588667    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588670    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 27 19:05:13.594458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588673    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588676    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588679    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588682    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588685    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588688    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588691    2557 flags.go:64] FLAG: --feature-gates=""
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588694    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588697    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588700    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588703    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588706    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588709    2557 flags.go:64] FLAG: --help="false"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588711    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588714    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588717    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588720    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588724    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588727    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588730    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588732    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588735    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588738    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 19:05:13.595076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588741    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588743    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588746    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588749    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588752    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588754    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588757    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588761    2557 flags.go:64] FLAG: --lock-file=""
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588764    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588767    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588769    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588775    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588777    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588780    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588784    2557 flags.go:64] FLAG: --logging-format="text"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588786    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588789    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588792    2557 flags.go:64] FLAG: --manifest-url=""
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588795    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588799    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588802    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588819    2557 flags.go:64] FLAG: --max-pods="110"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588822    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588825    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588828    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 19:05:13.595644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588831    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588834    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588836    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588839    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588846    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588849    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588851    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588854    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588857    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588863    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588865    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588869    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588871    2557 flags.go:64] FLAG: --port="10250"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588874    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588878    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e074b6e051827e27"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588881    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588884    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588887    2557 flags.go:64] FLAG: --register-node="true"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588890    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588893    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588896    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588899    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588902    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588906    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588909    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 19:05:13.596262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588912    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588914    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588917    2557 flags.go:64] FLAG: --runonce="false"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588920    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588923    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588926    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588928    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588931    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588933    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588937    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588940    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588943    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588945    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588948    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588950    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588953    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588956    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588959    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588964    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588966    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588969    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588974    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588977    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588981    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588983    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 19:05:13.596881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588986    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588989    2557 flags.go:64] FLAG: --v="2"
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588993    2557 flags.go:64] FLAG: --version="false"
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.588996    2557 flags.go:64] FLAG: --vmodule=""
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.589000    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.589003    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589114    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589117    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589120    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589123    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589126    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589129    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589131    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589133    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589136    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589139    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589141    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589144    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589146    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589149    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589151    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:13.597484 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589153    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589156    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589158    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589161    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589163    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589165    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589168    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589171    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589174    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589179    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589182    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589184    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589187    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589189    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589191    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589194    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589196    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589199    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589202    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589206    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:13.598286 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589209    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589213    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589215    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589218    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589221    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589223    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589226    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589228    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589230    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589233    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589235    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589238    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589240    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589243    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589245    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589248    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589251    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589253    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589255    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:13.599086 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589259    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589261    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589265    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589267    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589270    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589272    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589275    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589277    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589280    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589283    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589285    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589289    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589292    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589296    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589298    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589301    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589305    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589308    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589311    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:13.599600 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589314    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589317    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589319    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589322    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589325    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589328    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589331    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589333    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589336    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589338    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589341    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589343    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589346    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589350    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589352    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589356    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589359    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589361    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589364    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589366    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:13.600145 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589369    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589371    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589374    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589376    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589379    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.589381    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.590236    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.596967    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.596980    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.597535    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.597545    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597874    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597887    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597893    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597898    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:13.600710 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597903    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597907    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597912    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597917    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597921    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597933    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597938    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597942    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597947    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597952    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597957    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597962    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597966    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597971    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597975    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597980    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597984    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597988    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.597997    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:13.601155 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598001    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598005    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598010    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598015    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598020    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598024    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598029    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598034    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598038    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598042    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598046    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598055    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598059    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598065    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598072    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598076    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598080    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598085    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598089    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:13.601696 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598093    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598100    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598106    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598110    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598115    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598125    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598129    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598134    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598138    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598142    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598147    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598151    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598156    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598160    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598164    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598169    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598173    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598613    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598619    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598624    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:13.602300 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598639    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598643    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598647    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598652    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598656    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598660    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598665    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598668    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598675    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598681    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598691    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598695    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598700    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598704    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598708    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598713    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598717    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598722    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598727    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:13.602880 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598731    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598774    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598947    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598965    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598969    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598972    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598975    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598977    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598980    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598984    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598987    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598990    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598994    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598997    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.598999    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599003    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599006    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:13.603402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599008    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.599014    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599137    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599141    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599144    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599147    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599150    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599152    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599155    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599158    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599160    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599163    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599165    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599167    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599170    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:13.603830 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599173    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599175    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599178    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599181    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599183    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599186    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599188    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599191    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599193    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599196    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599198    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599201    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599203    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599206    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599208    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599211    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599213    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599215    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599218    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599220    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:13.604209 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599223    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599226    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599228    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599231    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599234    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599236    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599239    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599243    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599246    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599249    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599252    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599255    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599257    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599260    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599262    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599265    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599267    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599270    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599274    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:13.604702 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599277    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599280    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599283    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599286    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599289    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599291    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599293    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599296    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599298    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599301    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599303    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599306    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599309    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599313    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599316    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599319    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599322    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599324    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599326    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:13.605174 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599329    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599331    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599334    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599336    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599339    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599342    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599344    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599347    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599349    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599352    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599355    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599358    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599361    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599364    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599367    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599369    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599372    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599374    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599377    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599379    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:13.605635 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599381    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599384    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599386    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599389    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599391    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599394    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599396    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:13.599399    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.599404    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.599512    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.602082    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.603441    2557 server.go:1019] "Starting client certificate rotation"
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.603544    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:05:13.606167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.603573    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:05:13.606496 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.606173    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:05:13.609422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.609409    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:05:13.621206 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.621192    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 27 19:05:13.623057 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.623043    2557 log.go:25] "Validated CRI v1 image API"
Jul 27 19:05:13.623755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.623737    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 19:05:13.626348 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.626332    2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b02bee57-b042-4726-a56d-8a8e37ccd4a8:/dev/nvme0n1p4 e31245db-b71e-42ec-be89-88741934664b:/dev/nvme0n1p3]
Jul 27 19:05:13.626390 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.626349    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 19:05:13.632681 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.632661    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:05:13.632760 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.632614    2557 manager.go:216] Machine: {Timestamp:2026-07-27 19:05:13.631380625 +0000 UTC m=+0.338520109 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3076302 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec244987e986a8d2bd79ca420cad0964 SystemUUID:ec244987-e986-a8d2-bd79-ca420cad0964 BootID:8d57bb02-f6b7-4b41-9fb8-843f004e8390 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3c:6b:1a:56:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3c:6b:1a:56:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:d6:9f:9b:d2:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 19:05:13.632760 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.632740    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 19:05:13.632927 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.632829    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 19:05:13.634000 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.633977    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 19:05:13.634149 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.634004    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-171.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 19:05:13.634733 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.634720    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 19:05:13.634785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.634737    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 19:05:13.634785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.634748    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:05:13.636593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.636580    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:05:13.637363 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.637351    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 19:05:13.639116 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.639103    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:05:13.639247 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.639237    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 19:05:13.639307 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.639273    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 19:05:13.639307 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.639296    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 19:05:13.639397 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.639310    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 19:05:13.639397 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.639324    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 27 19:05:13.639397 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.639336    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 19:05:13.640227 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.640203    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:05:13.640227 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.640224    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:05:13.643609 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.643592    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 19:05:13.645635 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.645623    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 19:05:13.645685 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.645653    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 19:05:13.647041 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647029    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647045    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647051    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647056    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647064    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647070    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647077    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647082    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647088    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 19:05:13.647096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647094    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 19:05:13.647349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647101    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 19:05:13.647349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647107    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 19:05:13.647833 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647823    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 19:05:13.647833 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.647833    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 19:05:13.650783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.650763    2557 server.go:1268] "Started kubelet"
Jul 27 19:05:13.650905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.650855    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 19:05:13.650958 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.650915    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 19:05:13.651060 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.650932    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 19:05:13.651557 ip-10-0-142-171 systemd[1]: Started Kubernetes Kubelet.
Jul 27 19:05:13.652109 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.652054    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-171.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:05:13.652239 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.652211    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:05:13.652413 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.652281    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:05:13.653147 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.653127    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 19:05:13.653328 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.653315    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 19:05:13.658318 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.658287    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 19:05:13.659874 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.659856    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 19:05:13.659955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.659874    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 19:05:13.660004 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.659966    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:13.660550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.660405    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 19:05:13.660550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.660479    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 19:05:13.660550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.660495    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 19:05:13.660715 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.660589    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 19:05:13.660715 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.660596    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 19:05:13.663189 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.663170    2557 factory.go:55] Registering systemd factory
Jul 27 19:05:13.663272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.663194    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 27 19:05:13.663431 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.663419    2557 factory.go:153] Registering CRI-O factory
Jul 27 19:05:13.663469 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.663441    2557 factory.go:223] Registration of the crio container factory successfully
Jul 27 19:05:13.663512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.663502    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 19:05:13.663546 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.663529    2557 factory.go:103] Registering Raw factory
Jul 27 19:05:13.663546 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.663544    2557 manager.go:1196] Started watching for new ooms in manager
Jul 27 19:05:13.664157 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.664144    2557 manager.go:349] Starting recovery of all containers
Jul 27 19:05:13.666205 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.666178    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:05:13.666313 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.666236    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 19:05:13.668053 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.666326    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-171.ec2.internal.18c63af2119952da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-171.ec2.internal,UID:ip-10-0-142-171.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-171.ec2.internal,},FirstTimestamp:2026-07-27 19:05:13.650737882 +0000 UTC m=+0.357877364,LastTimestamp:2026-07-27 19:05:13.650737882 +0000 UTC m=+0.357877364,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-171.ec2.internal,}"
Jul 27 19:05:13.676572 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.676550    2557 manager.go:354] Recovery completed
Jul 27 19:05:13.680692 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.680672    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fbp8m"
Jul 27 19:05:13.681391 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.681294    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:13.683141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.683127    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:13.683214 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.683154    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:13.683214 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.683164    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:13.683617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.683604    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:13.683681 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.683605    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 19:05:13.683681 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.683636    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 19:05:13.683681 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.683656    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:05:13.684272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.684256    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:13.684310 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.684288    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:13.684310 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.684302    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:13.685090 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.685027    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-171.ec2.internal.18c63af21387c4d7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-171.ec2.internal,UID:ip-10-0-142-171.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-171.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-171.ec2.internal,},FirstTimestamp:2026-07-27 19:05:13.683141847 +0000 UTC m=+0.390281329,LastTimestamp:2026-07-27 19:05:13.683141847 +0000 UTC m=+0.390281329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-171.ec2.internal,}"
Jul 27 19:05:13.685176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.685146    2557 policy_none.go:49] "None policy: Start"
Jul 27 19:05:13.685176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.685161    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 19:05:13.685176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.685173    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 19:05:13.686111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.686099    2557 policy_none.go:47] "Start"
Jul 27 19:05:13.686589 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.686574    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fbp8m"
Jul 27 19:05:13.715349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.715327    2557 manager.go:337] "Starting Device Plugin manager"
Jul 27 19:05:13.715422 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.715365    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 19:05:13.715422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.715378    2557 server.go:87] "Starting device plugin registration server"
Jul 27 19:05:13.715624 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.715612    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 19:05:13.715662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.715626    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 19:05:13.715745 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.715724    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 19:05:13.715849 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.715832    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 19:05:13.715849 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.715843    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 19:05:13.716319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.716298    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 19:05:13.716383 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.716352    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:13.782349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.782312    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 19:05:13.783567 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.783541    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 19:05:13.783655 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.783577    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 19:05:13.783655 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.783604    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 19:05:13.783655 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.783634    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 19:05:13.786258 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.786233    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:13.815830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.815800    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:13.817002 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.816988    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:13.817057 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.817020    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:13.817057 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.817031    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:13.817057 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.817051    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.826380 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.826363    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.826430 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.826384    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-171.ec2.internal\": node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:13.847742 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.847690    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:13.883692 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.883669    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal"]
Jul 27 19:05:13.883758 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.883731    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:13.884601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.884586    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:13.884654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.884620    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:13.884654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.884631    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:13.886009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.885997    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:13.886138 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.886122    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.886176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.886151    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:13.886713 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.886690    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:13.886836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.886722    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:13.886836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.886736    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:13.886836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.886742    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:13.886836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.886761    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:13.886836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.886770    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:13.888461 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.888448    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.888514 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.888471    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:13.889107 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.889092    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:13.889182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.889118    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:13.889182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.889127    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:13.916368 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.916352    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-171.ec2.internal\" not found" node="ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.919607 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.919593    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-171.ec2.internal\" not found" node="ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.948341 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:13.948313    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:13.962714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.962698    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80c26a821a31fb467e2ed51ede92a17a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal\" (UID: \"80c26a821a31fb467e2ed51ede92a17a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.962780 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.962720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80c26a821a31fb467e2ed51ede92a17a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal\" (UID: \"80c26a821a31fb467e2ed51ede92a17a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:13.962780 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:13.962745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c128425dd9f25041f1129ff56b0147d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-171.ec2.internal\" (UID: \"2c128425dd9f25041f1129ff56b0147d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.048852 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.048824    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:14.063145 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.063119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80c26a821a31fb467e2ed51ede92a17a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal\" (UID: \"80c26a821a31fb467e2ed51ede92a17a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.063212 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.063152    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80c26a821a31fb467e2ed51ede92a17a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal\" (UID: \"80c26a821a31fb467e2ed51ede92a17a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.063212 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.063170    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c128425dd9f25041f1129ff56b0147d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-171.ec2.internal\" (UID: \"2c128425dd9f25041f1129ff56b0147d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.063212 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.063210    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80c26a821a31fb467e2ed51ede92a17a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal\" (UID: \"80c26a821a31fb467e2ed51ede92a17a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.063302 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.063215    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80c26a821a31fb467e2ed51ede92a17a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal\" (UID: \"80c26a821a31fb467e2ed51ede92a17a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.063302 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.063269    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c128425dd9f25041f1129ff56b0147d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-171.ec2.internal\" (UID: \"2c128425dd9f25041f1129ff56b0147d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.149574 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.149496    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:14.219021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.218975    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.223447 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.223203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.250429 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.250402    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:14.350967 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.350929    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:14.451466 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.451439    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-171.ec2.internal\" not found"
Jul 27 19:05:14.543693 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.543666    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:14.560372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.560352    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.572996 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.572981    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:05:14.574959 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.574946    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal"
Jul 27 19:05:14.582503 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.582489    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:05:14.602615 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.602599    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 19:05:14.602750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.602732    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:05:14.602750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.602734    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:05:14.635735 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.635717    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:14.639778 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.639760    2557 apiserver.go:52] "Watching apiserver"
Jul 27 19:05:14.645766 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.645747    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:14.653295 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.653277    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:05:14.654430 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.654410    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal","openshift-multus/multus-9x5jm","openshift-network-operator/iptables-alerter-tt6kv","kube-system/global-pull-secret-syncer-hkjc9","openshift-cluster-node-tuning-operator/tuned-9jgr6","openshift-image-registry/node-ca-rtvcd","openshift-multus/multus-additional-cni-plugins-fg7v7","openshift-multus/network-metrics-daemon-s24nm","openshift-network-diagnostics/network-check-target-cxp86","openshift-ovn-kubernetes/ovnkube-node-wjqns","kube-system/konnectivity-agent-svscn","kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n","openshift-dns/node-resolver-frh26"]
Jul 27 19:05:14.655875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.655858    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.657010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.656986    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.658073 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.658057    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.658155 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.658107    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:14.658645 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.658622    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xbbqc\""
Jul 27 19:05:14.659155 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.659129    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:05:14.659255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.659165    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.659255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.659140    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:05:14.659255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.659234    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:05:14.659429 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.659295    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:05:14.660038 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.660023    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 19:05:14.660196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.660171    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:14.660281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.660192    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:05:14.660281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.660218    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kgxf9\""
Jul 27 19:05:14.660281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.660199    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:14.660439 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.660297    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.661460 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.661443    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.661668 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.661647    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ws6vn\""
Jul 27 19:05:14.661752 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.661649    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:14.662112 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.662097    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:14.662705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.662691    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:05:14.662781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.662773    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:14.662895 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.662834    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9k8bt\""
Jul 27 19:05:14.662895 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.662849    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:14.662981 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.662941    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:05:14.662981 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.662966    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:05:14.663759 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.663745    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:05:14.663944 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.663924    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:05:14.663992 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.663974    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2lmcz\""
Jul 27 19:05:14.664242 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.664231    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:14.664295 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.664280    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:14.665701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.665687    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.666986 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.666965    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-os-release\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.667072 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.666996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.667072 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667012    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysctl-conf\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.667072 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667015    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:14.667072 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667043    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-serviceca\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.667072 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667064    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-cni-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.667278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-multus-certs\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.667278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-host-slash\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.667278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/442de7e6-e05f-4f4e-9dda-87387ec140ca-dbus\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.667278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9xs\" (UniqueName: \"kubernetes.io/projected/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-kube-api-access-kk9xs\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.667278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667251    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-sys\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.667278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667274    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxxnx\" (UniqueName: \"kubernetes.io/projected/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-kube-api-access-jxxnx\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.667456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667298    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-system-cni-dir\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.667456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667324    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdn8\" (UniqueName: \"kubernetes.io/projected/c9f90fae-833e-4c69-a937-f899ff9c8db4-kube-api-access-2cdn8\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.667456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.667456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df04efb2-0cc3-47f7-9923-6cb77c72678b-tmp\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.667456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667402    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-host\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.667456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-cnibin\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.667456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-cni-binary-copy\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667473    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-k8s-cni-cncf-io\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-cni-bin\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-kubelet\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-conf-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-modprobe-d\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667583    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysctl-d\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-systemd\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667635    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-run\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-lib-modules\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.667701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-tuned\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-system-cni-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667736    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-socket-dir-parent\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysconfig\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-kubernetes\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk7pd\" (UniqueName: \"kubernetes.io/projected/df04efb2-0cc3-47f7-9923-6cb77c72678b-kube-api-access-gk7pd\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667843    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667856    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-os-release\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-cni-multus\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-daemon-config\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-var-lib-kubelet\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667936    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.667977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-netns\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-hostroot\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668025    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pv96r\""
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668027    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-etc-kubernetes\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668053    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpl4m\" (UniqueName: \"kubernetes.io/projected/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-kube-api-access-lpl4m\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.668100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668096    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/442de7e6-e05f-4f4e-9dda-87387ec140ca-kubelet-config\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.668711 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-host\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.668711 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668166    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:05:14.668711 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668183    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.668711 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668215    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-cnibin\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.668711 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-iptables-alerter-script\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.668711 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.668525    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.669220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.669204    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:05:14.669311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.669217    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:05:14.669311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.669272    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:05:14.669394 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.669341    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:05:14.669430 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.669395    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:05:14.669903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.669888    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:05:14.669959 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.669915    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:05:14.669998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.669990    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n8dcc\""
Jul 27 19:05:14.670197 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.670177    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.672056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.671283    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 19:05:14.672056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.671323    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:05:14.672056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.671427    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b6vjb\""
Jul 27 19:05:14.672056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.671786    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:05:14.672056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.671797    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:05:14.672642 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.672627    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xt2gt\""
Jul 27 19:05:14.672722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.672707    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:05:14.672779 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.672740    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:05:14.690949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.690911    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:00:14 +0000 UTC" deadline="2028-02-18 15:23:34.278033729 +0000 UTC"
Jul 27 19:05:14.691012 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.690950    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13700h18m19.587086636s"
Jul 27 19:05:14.703208 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.703169    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ls2bz"
Jul 27 19:05:14.711023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.711006    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ls2bz"
Jul 27 19:05:14.761460 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.761437    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 19:05:14.768758 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.768728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-kubernetes\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.768868 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.768772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.768868 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.768801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-os-release\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.768868 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.768846    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-env-overrides\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.768868 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.768857    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-kubernetes\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.769056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.768877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovn-node-metrics-cert\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.769056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.768905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-hosts-file\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.769056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.768923    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-os-release\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.769170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769089    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-netns\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769121    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-hostroot\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-systemd\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.769318 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769187    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-netns\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769318 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-hostroot\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769318 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769229    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-host\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.769318 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769257    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-cnibin\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769318 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-cni-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769331    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-host\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769349    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-cnibin\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769371    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-host-slash\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-cni-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769401    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-kubelet\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769415    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-host-slash\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769429    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-log-socket\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-registration-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769488    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-sys-fs\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769523    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9xs\" (UniqueName: \"kubernetes.io/projected/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-kube-api-access-kk9xs\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.769566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769549    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-sys\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdn8\" (UniqueName: \"kubernetes.io/projected/c9f90fae-833e-4c69-a937-f899ff9c8db4-kube-api-access-2cdn8\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-run-ovn-kubernetes\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769628    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovnkube-script-lib\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769640    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-sys\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769794    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df04efb2-0cc3-47f7-9923-6cb77c72678b-tmp\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-host\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769865    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-cni-binary-copy\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-k8s-cni-cncf-io\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769918    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-cni-bin\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769942    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-conf-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769966    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wz8v\" (UniqueName: \"kubernetes.io/projected/e7bfb844-63b5-45dc-9f17-79ad812783c3-kube-api-access-8wz8v\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-daemon-config\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-k8s-cni-cncf-io\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770022    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-iptables-alerter-script\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.770169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-conf-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770049    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770057    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-host\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.769993    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770082    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-cni-bin\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-modprobe-d\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770132    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysctl-d\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770103    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770158    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-systemd\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-lib-modules\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770208    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-tuned\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770231    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysconfig\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770256    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk7pd\" (UniqueName: \"kubernetes.io/projected/df04efb2-0cc3-47f7-9923-6cb77c72678b-kube-api-access-gk7pd\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770283    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nnx\" (UniqueName: \"kubernetes.io/projected/aaf92079-7d20-41d0-9158-bd99ff69d650-kube-api-access-x7nnx\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-run-netns\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770315    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-var-lib-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.771030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770360    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770384    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-ovn\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770403    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-systemd\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-node-log\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770479    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-var-lib-kubelet\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770511    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-modprobe-d\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770523    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysctl-d\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpl4m\" (UniqueName: \"kubernetes.io/projected/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-kube-api-access-lpl4m\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770569    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/442de7e6-e05f-4f4e-9dda-87387ec140ca-kubelet-config\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770586    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-var-lib-kubelet\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-lib-modules\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-etc-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovnkube-config\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770705    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-socket-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770713    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/442de7e6-e05f-4f4e-9dda-87387ec140ca-kubelet-config\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-systemd-units\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.772207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770780    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysconfig\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770785    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-cni-bin\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770849    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-device-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.770903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-tmp-dir\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771117    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-os-release\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771256    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-os-release\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771287    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771593    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-daemon-config\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771662    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysctl-conf\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771776    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-serviceca\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771812    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9f90fae-833e-4c69-a937-f899ff9c8db4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.771951    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-sysctl-conf\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-multus-certs\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-serviceca\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-run-multus-certs\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/442de7e6-e05f-4f4e-9dda-87387ec140ca-dbus\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.773160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-cni-netd\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772337    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-iptables-alerter-script\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/442de7e6-e05f-4f4e-9dda-87387ec140ca-dbus\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772337    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxxnx\" (UniqueName: \"kubernetes.io/projected/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-kube-api-access-jxxnx\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772401    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-system-cni-dir\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-slash\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772464    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772463    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-system-cni-dir\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.772535    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772582    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-etc-kubernetes\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.772604    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret podName:442de7e6-e05f-4f4e-9dda-87387ec140ca nodeName:}" failed. No retries permitted until 2026-07-27 19:05:15.272582939 +0000 UTC m=+1.979722412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret") pod "global-pull-secret-syncer-hkjc9" (UID: "442de7e6-e05f-4f4e-9dda-87387ec140ca") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772613    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-etc-kubernetes\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772624    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58f7a128-f075-4083-a9ab-0768740754ad-agent-certs\") pod \"konnectivity-agent-svscn\" (UID: \"58f7a128-f075-4083-a9ab-0768740754ad\") " pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-cnibin\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772666    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-kubelet\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772690    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9f90fae-833e-4c69-a937-f899ff9c8db4-cnibin\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.773798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772694    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5zqz\" (UniqueName: \"kubernetes.io/projected/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-kube-api-access-g5zqz\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-cni-multus\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-cni-multus\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772788    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58f7a128-f075-4083-a9ab-0768740754ad-konnectivity-ca\") pod \"konnectivity-agent-svscn\" (UID: \"58f7a128-f075-4083-a9ab-0768740754ad\") " pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772795    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-host-var-lib-kubelet\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772810    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-run\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772848    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-system-cni-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772863    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-socket-dir-parent\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772881    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s57xk\" (UniqueName: \"kubernetes.io/projected/37ae55c3-ad1a-47fc-8490-c56c7f411f43-kube-api-access-s57xk\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772908    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772911    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df04efb2-0cc3-47f7-9923-6cb77c72678b-run\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772929    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-system-cni-dir\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772949    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-cni-binary-copy\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.772961    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-multus-socket-dir-parent\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.773485    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df04efb2-0cc3-47f7-9923-6cb77c72678b-tmp\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.774322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.773569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df04efb2-0cc3-47f7-9923-6cb77c72678b-etc-tuned\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.779921 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.779841    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk7pd\" (UniqueName: \"kubernetes.io/projected/df04efb2-0cc3-47f7-9923-6cb77c72678b-kube-api-access-gk7pd\") pod \"tuned-9jgr6\" (UID: \"df04efb2-0cc3-47f7-9923-6cb77c72678b\") " pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:14.780035 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.779997    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9xs\" (UniqueName: \"kubernetes.io/projected/890b0804-97d7-4b8a-8e43-ba3a06eb7fa5-kube-api-access-kk9xs\") pod \"multus-9x5jm\" (UID: \"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5\") " pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.780097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.780044    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpl4m\" (UniqueName: \"kubernetes.io/projected/c2c25ff9-ab81-406b-b3a9-937f8489fbd1-kube-api-access-lpl4m\") pod \"iptables-alerter-tt6kv\" (UID: \"c2c25ff9-ab81-406b-b3a9-937f8489fbd1\") " pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:14.780292 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.780261    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdn8\" (UniqueName: \"kubernetes.io/projected/c9f90fae-833e-4c69-a937-f899ff9c8db4-kube-api-access-2cdn8\") pod \"multus-additional-cni-plugins-fg7v7\" (UID: \"c9f90fae-833e-4c69-a937-f899ff9c8db4\") " pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:14.781256 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.781232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxxnx\" (UniqueName: \"kubernetes.io/projected/408b1c2b-d4fd-491a-9a34-35a8c3a090d0-kube-api-access-jxxnx\") pod \"node-ca-rtvcd\" (UID: \"408b1c2b-d4fd-491a-9a34-35a8c3a090d0\") " pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:14.874270 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874236    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nnx\" (UniqueName: \"kubernetes.io/projected/aaf92079-7d20-41d0-9158-bd99ff69d650-kube-api-access-x7nnx\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-run-netns\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-var-lib-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874309    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874334    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-ovn\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-node-log\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-run-netns\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-etc-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874392    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovnkube-config\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874383    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-var-lib-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-node-log\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-etc-openvswitch\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.874466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874425    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-ovn\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874476    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-socket-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-systemd-units\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874537    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-cni-bin\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-systemd-units\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-device-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874588    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-tmp-dir\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874602    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-cni-bin\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874621    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-cni-netd\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874657    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-device-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-slash\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874651    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-socket-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874704    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-slash\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874704    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-cni-netd\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58f7a128-f075-4083-a9ab-0768740754ad-agent-certs\") pod \"konnectivity-agent-svscn\" (UID: \"58f7a128-f075-4083-a9ab-0768740754ad\") " pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874794    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5zqz\" (UniqueName: \"kubernetes.io/projected/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-kube-api-access-g5zqz\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.875176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874796    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874822    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58f7a128-f075-4083-a9ab-0768740754ad-konnectivity-ca\") pod \"konnectivity-agent-svscn\" (UID: \"58f7a128-f075-4083-a9ab-0768740754ad\") " pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s57xk\" (UniqueName: \"kubernetes.io/projected/37ae55c3-ad1a-47fc-8490-c56c7f411f43-kube-api-access-s57xk\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-env-overrides\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874934    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovn-node-metrics-cert\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874955    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-tmp-dir\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.874960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-hosts-file\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875001    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-hosts-file\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875011    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovnkube-config\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875022    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-systemd\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875051    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-run-systemd\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875069    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-kubelet\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875102    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-log-socket\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875111    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-kubelet\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-registration-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875158    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-sys-fs\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875175    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-log-socket\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875187    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-run-ovn-kubernetes\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovnkube-script-lib\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875241    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875246    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-registration-dir\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875296    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37ae55c3-ad1a-47fc-8490-c56c7f411f43-host-run-ovn-kubernetes\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875298    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wz8v\" (UniqueName: \"kubernetes.io/projected/e7bfb844-63b5-45dc-9f17-79ad812783c3-kube-api-access-8wz8v\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875343    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875611    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58f7a128-f075-4083-a9ab-0768740754ad-konnectivity-ca\") pod \"konnectivity-agent-svscn\" (UID: \"58f7a128-f075-4083-a9ab-0768740754ad\") " pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-sys-fs\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875662    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-env-overrides\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.875725    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.875793    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs podName:aaf92079-7d20-41d0-9158-bd99ff69d650 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:15.375774123 +0000 UTC m=+2.082913609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs") pod "network-metrics-daemon-s24nm" (UID: "aaf92079-7d20-41d0-9158-bd99ff69d650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.875918    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7bfb844-63b5-45dc-9f17-79ad812783c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.876648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.876046    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovnkube-script-lib\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.877500 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.877442    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58f7a128-f075-4083-a9ab-0768740754ad-agent-certs\") pod \"konnectivity-agent-svscn\" (UID: \"58f7a128-f075-4083-a9ab-0768740754ad\") " pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:14.877500 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.877487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37ae55c3-ad1a-47fc-8490-c56c7f411f43-ovn-node-metrics-cert\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.882523 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.882499    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:14.882650 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.882527    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:14.882650 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.882541    2557 projected.go:196] Error preparing data for projected volume kube-api-access-d2jq2 for pod openshift-network-diagnostics/network-check-target-cxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:14.882650 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:14.882618    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2 podName:2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:15.382598882 +0000 UTC m=+2.089738372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d2jq2" (UniqueName: "kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2") pod "network-check-target-cxp86" (UID: "2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:14.883725 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.883697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5zqz\" (UniqueName: \"kubernetes.io/projected/1112b3ac-a158-4cd1-b49e-3e6dc65be58e-kube-api-access-g5zqz\") pod \"node-resolver-frh26\" (UID: \"1112b3ac-a158-4cd1-b49e-3e6dc65be58e\") " pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:14.883917 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.883876    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nnx\" (UniqueName: \"kubernetes.io/projected/aaf92079-7d20-41d0-9158-bd99ff69d650-kube-api-access-x7nnx\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:14.884694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.884672    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wz8v\" (UniqueName: \"kubernetes.io/projected/e7bfb844-63b5-45dc-9f17-79ad812783c3-kube-api-access-8wz8v\") pod \"aws-ebs-csi-driver-node-msk4n\" (UID: \"e7bfb844-63b5-45dc-9f17-79ad812783c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:14.885389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.885369    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s57xk\" (UniqueName: \"kubernetes.io/projected/37ae55c3-ad1a-47fc-8490-c56c7f411f43-kube-api-access-s57xk\") pod \"ovnkube-node-wjqns\" (UID: \"37ae55c3-ad1a-47fc-8490-c56c7f411f43\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:14.898343 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:14.898310    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c26a821a31fb467e2ed51ede92a17a.slice/crio-a72a7ee229ebd484493b332650a82efa16a14a228637a200d6b2ebbad2c37670 WatchSource:0}: Error finding container a72a7ee229ebd484493b332650a82efa16a14a228637a200d6b2ebbad2c37670: Status 404 returned error can't find the container with id a72a7ee229ebd484493b332650a82efa16a14a228637a200d6b2ebbad2c37670
Jul 27 19:05:14.903305 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.903290    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:05:14.927262 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:14.927233    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c128425dd9f25041f1129ff56b0147d.slice/crio-e45c00ee8ed1c7740d4af3e80ea520cb92a2e9733b1af67a68c9bef234d7b047 WatchSource:0}: Error finding container e45c00ee8ed1c7740d4af3e80ea520cb92a2e9733b1af67a68c9bef234d7b047: Status 404 returned error can't find the container with id e45c00ee8ed1c7740d4af3e80ea520cb92a2e9733b1af67a68c9bef234d7b047
Jul 27 19:05:14.988596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:14.988524    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9x5jm"
Jul 27 19:05:14.995761 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:14.995738    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890b0804_97d7_4b8a_8e43_ba3a06eb7fa5.slice/crio-83ffac4c32e3fad018f28e53e9cda6da919efd5eccd736e5796907d757ab2aa0 WatchSource:0}: Error finding container 83ffac4c32e3fad018f28e53e9cda6da919efd5eccd736e5796907d757ab2aa0: Status 404 returned error can't find the container with id 83ffac4c32e3fad018f28e53e9cda6da919efd5eccd736e5796907d757ab2aa0
Jul 27 19:05:15.006079 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.006062    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tt6kv"
Jul 27 19:05:15.013222 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:15.013200    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c25ff9_ab81_406b_b3a9_937f8489fbd1.slice/crio-885dc2167063b71b2869796f0f1d2346a70c6c414fabe4a64e4b066157cfdcd0 WatchSource:0}: Error finding container 885dc2167063b71b2869796f0f1d2346a70c6c414fabe4a64e4b066157cfdcd0: Status 404 returned error can't find the container with id 885dc2167063b71b2869796f0f1d2346a70c6c414fabe4a64e4b066157cfdcd0
Jul 27 19:05:15.030225 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.030205    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9jgr6"
Jul 27 19:05:15.038523 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:15.038505    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf04efb2_0cc3_47f7_9923_6cb77c72678b.slice/crio-cf22d19d957536e93fa806b3d89c520565a9cc2b7c8fe138303c26adf8f941f2 WatchSource:0}: Error finding container cf22d19d957536e93fa806b3d89c520565a9cc2b7c8fe138303c26adf8f941f2: Status 404 returned error can't find the container with id cf22d19d957536e93fa806b3d89c520565a9cc2b7c8fe138303c26adf8f941f2
Jul 27 19:05:15.050873 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.050857    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rtvcd"
Jul 27 19:05:15.057810 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.057794    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fg7v7"
Jul 27 19:05:15.058127 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:15.058108    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408b1c2b_d4fd_491a_9a34_35a8c3a090d0.slice/crio-1a10fcc3c91c392e69b3ee806c5bdc2902f21cd08b5ee887280a8ba9d19ecdad WatchSource:0}: Error finding container 1a10fcc3c91c392e69b3ee806c5bdc2902f21cd08b5ee887280a8ba9d19ecdad: Status 404 returned error can't find the container with id 1a10fcc3c91c392e69b3ee806c5bdc2902f21cd08b5ee887280a8ba9d19ecdad
Jul 27 19:05:15.065462 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:15.065443    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f90fae_833e_4c69_a937_f899ff9c8db4.slice/crio-2caac8460f01a4d974aea75f9c55a155d38b70e226adcc9e192077d7ff2cc904 WatchSource:0}: Error finding container 2caac8460f01a4d974aea75f9c55a155d38b70e226adcc9e192077d7ff2cc904: Status 404 returned error can't find the container with id 2caac8460f01a4d974aea75f9c55a155d38b70e226adcc9e192077d7ff2cc904
Jul 27 19:05:15.089403 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.089376    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:15.096361 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:15.096337    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ae55c3_ad1a_47fc_8490_c56c7f411f43.slice/crio-ae6388eeb58c6496ebc1e7ae24feb4e7c80bbee191a913d0f8417292f75276c8 WatchSource:0}: Error finding container ae6388eeb58c6496ebc1e7ae24feb4e7c80bbee191a913d0f8417292f75276c8: Status 404 returned error can't find the container with id ae6388eeb58c6496ebc1e7ae24feb4e7c80bbee191a913d0f8417292f75276c8
Jul 27 19:05:15.102614 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.102599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:15.110333 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:15.110306    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f7a128_f075_4083_a9ab_0768740754ad.slice/crio-32639344520e07d6c0d4297b501e4753f7a956f4534fa5cb4f347aed1b738bd4 WatchSource:0}: Error finding container 32639344520e07d6c0d4297b501e4753f7a956f4534fa5cb4f347aed1b738bd4: Status 404 returned error can't find the container with id 32639344520e07d6c0d4297b501e4753f7a956f4534fa5cb4f347aed1b738bd4
Jul 27 19:05:15.116999 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.116979    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n"
Jul 27 19:05:15.124384 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:15.124359    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bfb844_63b5_45dc_9f17_79ad812783c3.slice/crio-e47b0336bd071290b6316a02fb74b2e40fff4b005ffc434db996aca8441b60ab WatchSource:0}: Error finding container e47b0336bd071290b6316a02fb74b2e40fff4b005ffc434db996aca8441b60ab: Status 404 returned error can't find the container with id e47b0336bd071290b6316a02fb74b2e40fff4b005ffc434db996aca8441b60ab
Jul 27 19:05:15.124960 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.124944    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-frh26"
Jul 27 19:05:15.132471 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:15.132452    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1112b3ac_a158_4cd1_b49e_3e6dc65be58e.slice/crio-eeac6e0749a58d7aa4b300265013dcd86b07c11eecd03c9ea5aaff76fba9c471 WatchSource:0}: Error finding container eeac6e0749a58d7aa4b300265013dcd86b07c11eecd03c9ea5aaff76fba9c471: Status 404 returned error can't find the container with id eeac6e0749a58d7aa4b300265013dcd86b07c11eecd03c9ea5aaff76fba9c471
Jul 27 19:05:15.278495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.278404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:15.278667 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.278592    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:15.278734 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.278667    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret podName:442de7e6-e05f-4f4e-9dda-87387ec140ca nodeName:}" failed. No retries permitted until 2026-07-27 19:05:16.278646856 +0000 UTC m=+2.985786330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret") pod "global-pull-secret-syncer-hkjc9" (UID: "442de7e6-e05f-4f4e-9dda-87387ec140ca") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:15.379125 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.379086    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:15.379264 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.379233    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:15.379300 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.379289    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs podName:aaf92079-7d20-41d0-9158-bd99ff69d650 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:16.379272863 +0000 UTC m=+3.086412348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs") pod "network-metrics-daemon-s24nm" (UID: "aaf92079-7d20-41d0-9158-bd99ff69d650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:15.480039 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.480001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:15.480246 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.480229    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:15.480317 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.480267    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:15.480317 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.480282    2557 projected.go:196] Error preparing data for projected volume kube-api-access-d2jq2 for pod openshift-network-diagnostics/network-check-target-cxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:15.480430 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.480360    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2 podName:2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:16.480339664 +0000 UTC m=+3.187479140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2jq2" (UniqueName: "kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2") pod "network-check-target-cxp86" (UID: "2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:15.713853 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.713735    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:00:15 +0000 UTC" deadline="2028-03-19 16:31:19.203941912 +0000 UTC"
Jul 27 19:05:15.713853 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.713777    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14421h26m3.490170364s"
Jul 27 19:05:15.765334 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.765112    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:15.793814 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.793280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:15.793814 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.793428    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:15.793814 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.793482    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:15.793814 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:15.793611    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:15.798462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.798337    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n" event={"ID":"e7bfb844-63b5-45dc-9f17-79ad812783c3","Type":"ContainerStarted","Data":"e47b0336bd071290b6316a02fb74b2e40fff4b005ffc434db996aca8441b60ab"}
Jul 27 19:05:15.800815 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.800743    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-svscn" event={"ID":"58f7a128-f075-4083-a9ab-0768740754ad","Type":"ContainerStarted","Data":"32639344520e07d6c0d4297b501e4753f7a956f4534fa5cb4f347aed1b738bd4"}
Jul 27 19:05:15.808117 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.807986    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"ae6388eeb58c6496ebc1e7ae24feb4e7c80bbee191a913d0f8417292f75276c8"}
Jul 27 19:05:15.812728 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.812647    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerStarted","Data":"2caac8460f01a4d974aea75f9c55a155d38b70e226adcc9e192077d7ff2cc904"}
Jul 27 19:05:15.819493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.819414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9jgr6" event={"ID":"df04efb2-0cc3-47f7-9923-6cb77c72678b","Type":"ContainerStarted","Data":"cf22d19d957536e93fa806b3d89c520565a9cc2b7c8fe138303c26adf8f941f2"}
Jul 27 19:05:15.825045 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.824966    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tt6kv" event={"ID":"c2c25ff9-ab81-406b-b3a9-937f8489fbd1","Type":"ContainerStarted","Data":"885dc2167063b71b2869796f0f1d2346a70c6c414fabe4a64e4b066157cfdcd0"}
Jul 27 19:05:15.831326 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.831300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal" event={"ID":"80c26a821a31fb467e2ed51ede92a17a","Type":"ContainerStarted","Data":"a72a7ee229ebd484493b332650a82efa16a14a228637a200d6b2ebbad2c37670"}
Jul 27 19:05:15.842465 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.842440    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-frh26" event={"ID":"1112b3ac-a158-4cd1-b49e-3e6dc65be58e","Type":"ContainerStarted","Data":"eeac6e0749a58d7aa4b300265013dcd86b07c11eecd03c9ea5aaff76fba9c471"}
Jul 27 19:05:15.848462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.848432    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rtvcd" event={"ID":"408b1c2b-d4fd-491a-9a34-35a8c3a090d0","Type":"ContainerStarted","Data":"1a10fcc3c91c392e69b3ee806c5bdc2902f21cd08b5ee887280a8ba9d19ecdad"}
Jul 27 19:05:15.855993 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.855962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9x5jm" event={"ID":"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5","Type":"ContainerStarted","Data":"83ffac4c32e3fad018f28e53e9cda6da919efd5eccd736e5796907d757ab2aa0"}
Jul 27 19:05:15.861059 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:15.861008    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal" event={"ID":"2c128425dd9f25041f1129ff56b0147d","Type":"ContainerStarted","Data":"e45c00ee8ed1c7740d4af3e80ea520cb92a2e9733b1af67a68c9bef234d7b047"}
Jul 27 19:05:16.287804 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:16.287761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:16.288045 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.288014    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:16.288121 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.288085    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret podName:442de7e6-e05f-4f4e-9dda-87387ec140ca nodeName:}" failed. No retries permitted until 2026-07-27 19:05:18.288066396 +0000 UTC m=+4.995205870 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret") pod "global-pull-secret-syncer-hkjc9" (UID: "442de7e6-e05f-4f4e-9dda-87387ec140ca") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:16.390416 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:16.388423    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:16.390416 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.388635    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:16.390416 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.388700    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs podName:aaf92079-7d20-41d0-9158-bd99ff69d650 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:18.388680731 +0000 UTC m=+5.095820205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs") pod "network-metrics-daemon-s24nm" (UID: "aaf92079-7d20-41d0-9158-bd99ff69d650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:16.466866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:16.466836    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:16.489623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:16.489573    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:16.489952 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.489789    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:16.489952 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.489816    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:16.489952 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.489830    2557 projected.go:196] Error preparing data for projected volume kube-api-access-d2jq2 for pod openshift-network-diagnostics/network-check-target-cxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:16.489952 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.489910    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2 podName:2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:18.489891022 +0000 UTC m=+5.197030495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2jq2" (UniqueName: "kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2") pod "network-check-target-cxp86" (UID: "2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:16.714854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:16.714738    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:00:15 +0000 UTC" deadline="2028-04-27 01:15:38.896018056 +0000 UTC"
Jul 27 19:05:16.714854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:16.714804    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15342h10m22.181219119s"
Jul 27 19:05:16.784658 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:16.784148    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:16.784658 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:16.784283    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:17.785566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:17.784720    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:17.785566 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:17.784902    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:17.785566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:17.785370    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:17.785566 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:17.785474    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:18.307572 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:18.307527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:18.307771 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.307678    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:18.307771 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.307743    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret podName:442de7e6-e05f-4f4e-9dda-87387ec140ca nodeName:}" failed. No retries permitted until 2026-07-27 19:05:22.307723883 +0000 UTC m=+9.014863369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret") pod "global-pull-secret-syncer-hkjc9" (UID: "442de7e6-e05f-4f4e-9dda-87387ec140ca") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:18.408730 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:18.408021    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:18.408730 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.408210    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:18.408730 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.408279    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs podName:aaf92079-7d20-41d0-9158-bd99ff69d650 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:22.408259466 +0000 UTC m=+9.115398952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs") pod "network-metrics-daemon-s24nm" (UID: "aaf92079-7d20-41d0-9158-bd99ff69d650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:18.509907 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:18.509251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:18.509907 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.509463    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:18.509907 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.509485    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:18.509907 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.509499    2557 projected.go:196] Error preparing data for projected volume kube-api-access-d2jq2 for pod openshift-network-diagnostics/network-check-target-cxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:18.509907 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.509559    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2 podName:2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:22.509539931 +0000 UTC m=+9.216679420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2jq2" (UniqueName: "kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2") pod "network-check-target-cxp86" (UID: "2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:18.783852 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:18.783795    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:18.784056 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:18.783953    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:19.784841 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:19.784783    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:19.785339 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:19.784968    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:19.785339 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:19.785060    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:19.785339 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:19.785181    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:20.785162 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:20.784656    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:20.785162 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:20.784802    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:21.788332 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:21.788301    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:21.788712 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:21.788445    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:21.788712 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:21.788482    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:21.788712 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:21.788550    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:22.347858 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:22.347799    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:22.348039 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.347925    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:22.348039 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.347999    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret podName:442de7e6-e05f-4f4e-9dda-87387ec140ca nodeName:}" failed. No retries permitted until 2026-07-27 19:05:30.347980881 +0000 UTC m=+17.055120353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret") pod "global-pull-secret-syncer-hkjc9" (UID: "442de7e6-e05f-4f4e-9dda-87387ec140ca") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:22.448603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:22.448557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:22.448783 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.448734    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:22.448869 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.448801    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs podName:aaf92079-7d20-41d0-9158-bd99ff69d650 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:30.448781261 +0000 UTC m=+17.155920736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs") pod "network-metrics-daemon-s24nm" (UID: "aaf92079-7d20-41d0-9158-bd99ff69d650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:22.549744 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:22.549497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:22.549744 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.549685    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:22.549744 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.549710    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:22.549744 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.549724    2557 projected.go:196] Error preparing data for projected volume kube-api-access-d2jq2 for pod openshift-network-diagnostics/network-check-target-cxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:22.550034 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.549787    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2 podName:2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:30.549769849 +0000 UTC m=+17.256909324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2jq2" (UniqueName: "kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2") pod "network-check-target-cxp86" (UID: "2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:22.785207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:22.784727    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:22.785207 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:22.784871    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:23.785454 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:23.785423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:23.785913 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:23.785528    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:23.785913 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:23.785895    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:23.786034 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:23.785993    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:24.784676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:24.784637    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:24.784901 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:24.784770    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:25.784089 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:25.784040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:25.784535 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:25.784094    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:25.784535 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:25.784167    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:25.784535 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:25.784306    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:26.784723 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:26.784692    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:26.785099 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:26.784784    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:27.785363 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:27.784596    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:27.785363 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:27.784733    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:27.785363 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:27.785213    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:27.785363 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:27.785318    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:28.784866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:28.784341    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:28.784866 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:28.784472    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:29.784646 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:29.784608    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:29.785105 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:29.784746    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:29.785105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:29.784773    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:29.785105 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:29.784910    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:30.408864 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:30.408822    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:30.409069 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.408964    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:30.409069 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.409037    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret podName:442de7e6-e05f-4f4e-9dda-87387ec140ca nodeName:}" failed. No retries permitted until 2026-07-27 19:05:46.409016725 +0000 UTC m=+33.116156196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret") pod "global-pull-secret-syncer-hkjc9" (UID: "442de7e6-e05f-4f4e-9dda-87387ec140ca") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:30.509721 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:30.509691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:30.509916 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.509883    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:30.509986 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.509956    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs podName:aaf92079-7d20-41d0-9158-bd99ff69d650 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:46.509935861 +0000 UTC m=+33.217075331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs") pod "network-metrics-daemon-s24nm" (UID: "aaf92079-7d20-41d0-9158-bd99ff69d650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:30.610601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:30.610563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:30.610774 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.610719    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:30.610774 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.610738    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:30.610774 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.610751    2557 projected.go:196] Error preparing data for projected volume kube-api-access-d2jq2 for pod openshift-network-diagnostics/network-check-target-cxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:30.610926 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.610825    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2 podName:2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:46.610792204 +0000 UTC m=+33.317931679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2jq2" (UniqueName: "kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2") pod "network-check-target-cxp86" (UID: "2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:30.784607 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:30.784567    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:30.784790 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:30.784695    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:31.785061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:31.784450    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:31.785061 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:31.784583    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:31.785529 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:31.785120    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:31.785529 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:31.785240    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:32.784141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:32.784108    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:32.784302 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:32.784228    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:33.785440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:33.785388    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:33.785910 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:33.785513    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:33.785910 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:33.785893    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:33.786029 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:33.785988    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:34.784826 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:34.784770    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:34.785000 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:34.784931    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:35.784516 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:35.784302    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:35.784875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:35.784339    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:35.784875 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:35.784634    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:35.784875 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:35.784706    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:35.913095 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:35.913063    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9jgr6" event={"ID":"df04efb2-0cc3-47f7-9923-6cb77c72678b","Type":"ContainerStarted","Data":"2aa3a6808329f51c62dcc116b852544ba9fd8eeda10bbd608466c8ed64483621"}
Jul 27 19:05:35.914486 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:35.914460    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9x5jm" event={"ID":"890b0804-97d7-4b8a-8e43-ba3a06eb7fa5","Type":"ContainerStarted","Data":"2fe8b129602c1a76cb9ed6b0dad4af9be7d7703669456cbb1e320895e4779c6c"}
Jul 27 19:05:35.916319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:35.915962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal" event={"ID":"2c128425dd9f25041f1129ff56b0147d","Type":"ContainerStarted","Data":"da94401a284aa2571c57996234c7d329f9a6712f6ce38dfdf758da38554e2b79"}
Jul 27 19:05:35.930916 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:35.930877    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9jgr6" podStartSLOduration=1.42478389 podStartE2EDuration="21.930864778s" totalImagesPullingTime="20.506080888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:35.930439895 +0000 UTC m=+22.637579385" watchObservedRunningTime="2026-07-27 19:05:35.930864778 +0000 UTC m=+22.638004246"
Jul 27 19:05:35.944061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:35.944025    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-171.ec2.internal" podStartSLOduration=21.944014469 podStartE2EDuration="21.944014469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:35.943631218 +0000 UTC m=+22.650770709" watchObservedRunningTime="2026-07-27 19:05:35.944014469 +0000 UTC m=+22.651153960"
Jul 27 19:05:35.969801 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:35.969766    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9x5jm" podStartSLOduration=1.318558486 podStartE2EDuration="21.96975436s" totalImagesPullingTime="20.651195874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:35.968132237 +0000 UTC m=+22.675271728" watchObservedRunningTime="2026-07-27 19:05:35.96975436 +0000 UTC m=+22.676893851"
Jul 27 19:05:36.784772 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.784442    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:36.785447 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:36.784880    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:36.919377 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.919345    2557 generic.go:356] "Generic (PLEG): container finished" podID="80c26a821a31fb467e2ed51ede92a17a" containerID="3d23976fa0210dcd6f2f07d06f22bd987475f409179c488b1cff24d2f370dbac" exitCode=0
Jul 27 19:05:36.919512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.919414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal" event={"ID":"80c26a821a31fb467e2ed51ede92a17a","Type":"ContainerDied","Data":"3d23976fa0210dcd6f2f07d06f22bd987475f409179c488b1cff24d2f370dbac"}
Jul 27 19:05:36.920867 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.920840    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-frh26" event={"ID":"1112b3ac-a158-4cd1-b49e-3e6dc65be58e","Type":"ContainerStarted","Data":"6141ddd21601c100fcec57bb21cbf10f7609bf49718a5cc266f4f32747a7b3ad"}
Jul 27 19:05:36.922419 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.922388    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rtvcd" event={"ID":"408b1c2b-d4fd-491a-9a34-35a8c3a090d0","Type":"ContainerStarted","Data":"e85577fda6c7525914f5a331a5bdd963008107b15d0df66a8d0e2feecfb9efe3"}
Jul 27 19:05:36.923929 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.923908    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n" event={"ID":"e7bfb844-63b5-45dc-9f17-79ad812783c3","Type":"ContainerStarted","Data":"7bb3bb129eb3067906fc47a9737263803a314cdd82bc773a21cadee9b7492832"}
Jul 27 19:05:36.925249 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.925227    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-svscn" event={"ID":"58f7a128-f075-4083-a9ab-0768740754ad","Type":"ContainerStarted","Data":"ec1d19c636bbcf7e667e822b91641b0dccaea55fd18b6aef18a924202ea2d79c"}
Jul 27 19:05:36.927819 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.927787    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:05:36.928131 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.928114    2557 generic.go:356] "Generic (PLEG): container finished" podID="37ae55c3-ad1a-47fc-8490-c56c7f411f43" containerID="ca0d0f9bd09b45432d1aec0f60c41a1d6cea37838cd14186f28b551313d71ae3" exitCode=1
Jul 27 19:05:36.928190 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.928172    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"e4f30393417faffb687c4e46c74c298dea3fa48a1d81ce2580bfd1ba2e390682"}
Jul 27 19:05:36.928244 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.928214    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"eea4e7b827a4a583a07dc9643d98715a9df884763fa7014d745f9053af09e57a"}
Jul 27 19:05:36.928298 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.928252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"ddae933f3eac6b6826bca141401ac06afb167b5097debb4d75b4c5371df247b8"}
Jul 27 19:05:36.928298 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.928292    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"8c52efea23110a97c042a8a713e02be91a7eb482f88f9b429e5fedd6f3d35dcf"}
Jul 27 19:05:36.928382 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.928320    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerDied","Data":"ca0d0f9bd09b45432d1aec0f60c41a1d6cea37838cd14186f28b551313d71ae3"}
Jul 27 19:05:36.928382 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.928347    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"2c92fd1d39fa722bb810009f5169a6c5419ff90fb63a12552e57a3f0aedb884a"}
Jul 27 19:05:36.929525 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.929504    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9f90fae-833e-4c69-a937-f899ff9c8db4" containerID="7254c4bf31382b587cd529ed130319b5613ad82bd484b7051d99009c50101531" exitCode=0
Jul 27 19:05:36.929608 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.929527    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerDied","Data":"7254c4bf31382b587cd529ed130319b5613ad82bd484b7051d99009c50101531"}
Jul 27 19:05:36.936923 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.936834    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-frh26" podStartSLOduration=2.421355251 podStartE2EDuration="22.936821546s" totalImagesPullingTime="20.515466295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:36.936648175 +0000 UTC m=+23.643787665" watchObservedRunningTime="2026-07-27 19:05:36.936821546 +0000 UTC m=+23.643961036"
Jul 27 19:05:36.950307 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.950275    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rtvcd" podStartSLOduration=2.3620286569999998 podStartE2EDuration="22.950264809s" totalImagesPullingTime="20.588236152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:36.949953288 +0000 UTC m=+23.657092779" watchObservedRunningTime="2026-07-27 19:05:36.950264809 +0000 UTC m=+23.657404299"
Jul 27 19:05:36.989527 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:36.989492    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-svscn" podStartSLOduration=2.454325116 podStartE2EDuration="22.989480851s" totalImagesPullingTime="20.535155735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:36.989381093 +0000 UTC m=+23.696520583" watchObservedRunningTime="2026-07-27 19:05:36.989480851 +0000 UTC m=+23.696620342"
Jul 27 19:05:37.784874 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:37.784845    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:37.785293 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:37.784982    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:37.786137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:37.786110    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:37.786274 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:37.786253    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:37.872072 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:37.872030    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 19:05:37.933843 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:37.933769    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n" event={"ID":"e7bfb844-63b5-45dc-9f17-79ad812783c3","Type":"ContainerStarted","Data":"ca2e6e539a0028d5798f21bb564ab48cea93dab3ddf10cc26ec94d8283506a1e"}
Jul 27 19:05:37.935443 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:37.935417    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tt6kv" event={"ID":"c2c25ff9-ab81-406b-b3a9-937f8489fbd1","Type":"ContainerStarted","Data":"ab8a400ef93d5ed24f76fa440492c28fc38e34d0070f3db8759aaab85c452ab0"}
Jul 27 19:05:37.950007 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:37.949962    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tt6kv" podStartSLOduration=3.434200025 podStartE2EDuration="23.949943371s" totalImagesPullingTime="20.515743346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:37.949154612 +0000 UTC m=+24.656294105" watchObservedRunningTime="2026-07-27 19:05:37.949943371 +0000 UTC m=+24.657082865"
Jul 27 19:05:38.731958 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.731873    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:05:37.872052858Z","UUID":"c0c2c158-4142-4029-bdc5-f80be49e03f6","Handler":null,"Name":"","Endpoint":""}
Jul 27 19:05:38.733360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.733340    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 19:05:38.733492 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.733378    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 19:05:38.783994 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.783957    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:38.784129 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:38.784079    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:38.898750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.898719    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:38.899487 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.899467    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:38.939671 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.939629    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal" event={"ID":"80c26a821a31fb467e2ed51ede92a17a","Type":"ContainerStarted","Data":"f003a225acecabb260992766c9bbe5d45c0b52ee03a827592c08a8ac49b925be"}
Jul 27 19:05:38.939934 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.939916    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:38.940345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.940318    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-svscn"
Jul 27 19:05:38.954415 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:38.954378    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-171.ec2.internal" podStartSLOduration=24.954365083 podStartE2EDuration="24.954365083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:38.953988829 +0000 UTC m=+25.661128331" watchObservedRunningTime="2026-07-27 19:05:38.954365083 +0000 UTC m=+25.661504574"
Jul 27 19:05:39.784247 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:39.784209    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:39.784426 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:39.784333    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:39.784426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:39.784392    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:39.784541 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:39.784519    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:39.946154 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:39.946100    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:05:39.947135 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:39.947037    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"e0de6e6754b73b36850561216ec16dec684549e3944ef64fdc9bc89679f8db00"}
Jul 27 19:05:40.783854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:40.783795    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:40.784019 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:40.783948    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:41.784522 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:41.784262    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:41.785267 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:41.784338    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:41.785267 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:41.784646    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:41.785267 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:41.784694    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:41.955578 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:41.955555    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:05:41.955989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:41.955964    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"c2d42d30ac64a978e757c5d9f5788edf46e9f4c4d513399a942fde6bba8003c6"}
Jul 27 19:05:41.956235 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:41.956218    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:41.956458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:41.956437    2557 scope.go:117] "RemoveContainer" containerID="ca0d0f9bd09b45432d1aec0f60c41a1d6cea37838cd14186f28b551313d71ae3"
Jul 27 19:05:41.958065 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:41.958042    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerStarted","Data":"894354b39c688f9c487d3f130d9e7e24be582f206ccd20ec9ea3a3af81c4d19a"}
Jul 27 19:05:41.972939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:41.972922    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:42.784730 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.784551    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:42.785134 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:42.784847    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:42.962518 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.962484    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n" event={"ID":"e7bfb844-63b5-45dc-9f17-79ad812783c3","Type":"ContainerStarted","Data":"f190af6985be4af4e03ae4c24374d22b444434b20ae69bef97ea8e00b23856cd"}
Jul 27 19:05:42.966409 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.966388    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:05:42.966833 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.966776    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" event={"ID":"37ae55c3-ad1a-47fc-8490-c56c7f411f43","Type":"ContainerStarted","Data":"1b50f0745b1b6c1092e95b22daf0bbac1a648c65dcab55227728420c712ef409"}
Jul 27 19:05:42.967152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.967130    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:42.967257 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.967204    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:42.968760 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.968738    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9f90fae-833e-4c69-a937-f899ff9c8db4" containerID="894354b39c688f9c487d3f130d9e7e24be582f206ccd20ec9ea3a3af81c4d19a" exitCode=0
Jul 27 19:05:42.968871 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.968778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerDied","Data":"894354b39c688f9c487d3f130d9e7e24be582f206ccd20ec9ea3a3af81c4d19a"}
Jul 27 19:05:42.980605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.980557    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-msk4n" podStartSLOduration=2.910087081 podStartE2EDuration="28.980539487s" totalImagesPullingTime="26.070452406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:42.980412345 +0000 UTC m=+29.687551830" watchObservedRunningTime="2026-07-27 19:05:42.980539487 +0000 UTC m=+29.687678980"
Jul 27 19:05:42.983445 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:42.983425    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:05:43.035878 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:43.035782    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns" podStartSLOduration=7.913982751 podStartE2EDuration="29.035764445s" totalImagesPullingTime="21.121781694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:43.034296178 +0000 UTC m=+29.741435669" watchObservedRunningTime="2026-07-27 19:05:43.035764445 +0000 UTC m=+29.742903937"
Jul 27 19:05:43.324330 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:43.324248    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cxp86"]
Jul 27 19:05:43.324485 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:43.324352    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:43.324485 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:43.324444    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:43.325081 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:43.325061    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s24nm"]
Jul 27 19:05:43.325188 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:43.325146    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:43.325269 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:43.325248    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:43.326666 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:43.326643    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hkjc9"]
Jul 27 19:05:43.326752 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:43.326724    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:43.326840 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:43.326793    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:44.784783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:44.784754    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:44.785158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:44.784754    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:44.785158 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:44.784875    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:44.785158 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:44.784937    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:44.974181 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:44.974110    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9f90fae-833e-4c69-a937-f899ff9c8db4" containerID="2e678074c029839c0977cc3d01431fd4e9563250ec6b5db952e97faeda1962d1" exitCode=0
Jul 27 19:05:44.974300 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:44.974203    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerDied","Data":"2e678074c029839c0977cc3d01431fd4e9563250ec6b5db952e97faeda1962d1"}
Jul 27 19:05:45.784182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:45.784152    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:45.784341 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:45.784260    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:46.432369 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:46.432340    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:46.432738 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.432479    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:46.432738 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.432535    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret podName:442de7e6-e05f-4f4e-9dda-87387ec140ca nodeName:}" failed. No retries permitted until 2026-07-27 19:06:18.432521319 +0000 UTC m=+65.139660791 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret") pod "global-pull-secret-syncer-hkjc9" (UID: "442de7e6-e05f-4f4e-9dda-87387ec140ca") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:46.532957 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:46.532916    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:46.533103 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.533081    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:46.533203 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.533151    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs podName:aaf92079-7d20-41d0-9158-bd99ff69d650 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:18.533132027 +0000 UTC m=+65.240271519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs") pod "network-metrics-daemon-s24nm" (UID: "aaf92079-7d20-41d0-9158-bd99ff69d650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:46.633376 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:46.633338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:46.633467 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.633449    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:46.633505 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.633470    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:46.633505 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.633480    2557 projected.go:196] Error preparing data for projected volume kube-api-access-d2jq2 for pod openshift-network-diagnostics/network-check-target-cxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:46.633568 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.633524    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2 podName:2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:18.63351144 +0000 UTC m=+65.340650914 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2jq2" (UniqueName: "kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2") pod "network-check-target-cxp86" (UID: "2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:46.784009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:46.783928    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:46.784143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:46.783934    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:46.784143 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.784066    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s24nm" podUID="aaf92079-7d20-41d0-9158-bd99ff69d650"
Jul 27 19:05:46.784143 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:46.784098    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxp86" podUID="2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1"
Jul 27 19:05:46.980919 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:46.980721    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9f90fae-833e-4c69-a937-f899ff9c8db4" containerID="87210f488004045055215010d2f78ab89b4201c98d03dd12b75bc451b5695340" exitCode=0
Jul 27 19:05:46.981038 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:46.980771    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerDied","Data":"87210f488004045055215010d2f78ab89b4201c98d03dd12b75bc451b5695340"}
Jul 27 19:05:47.784701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:47.784670    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:47.785151 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:47.784798    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkjc9" podUID="442de7e6-e05f-4f4e-9dda-87387ec140ca"
Jul 27 19:05:48.556157 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.556128    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-171.ec2.internal" event="NodeReady"
Jul 27 19:05:48.556328 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.556297    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 19:05:48.589934 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.589903    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv"]
Jul 27 19:05:48.591916 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.591892    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv"
Jul 27 19:05:48.594092 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.593720    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"]
Jul 27 19:05:48.595584 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.595558    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76fdf799f5-mhh4d"]
Jul 27 19:05:48.598111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.598091    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.599605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.598571    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.599605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.599111    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z2dx6\""
Jul 27 19:05:48.599605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.599434    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.601209 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.601092    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 19:05:48.601209 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.601178    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"]
Jul 27 19:05:48.601372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.601340    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.603158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.603138    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zz7x4\""
Jul 27 19:05:48.603468 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.603398    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 19:05:48.603705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.603445    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.603705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.603699    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.603959 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.603914    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vw56c\""
Jul 27 19:05:48.604136 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.604114    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h49xz"]
Jul 27 19:05:48.604233 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.604214    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:48.604734 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.604715    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 19:05:48.605446 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.605357    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 19:05:48.605446 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.605391    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 19:05:48.605835 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.605800    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"]
Jul 27 19:05:48.605937 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.605885    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.607382 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.607366    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 19:05:48.607490 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.607447    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"]
Jul 27 19:05:48.607605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.607580    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.608289 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.608178    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.608289 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.608250    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fz2xt\""
Jul 27 19:05:48.608918 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.608900    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 19:05:48.609191 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.608967    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2m7nv\""
Jul 27 19:05:48.609191 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.608970    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.610555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.609713    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ldsb7"]
Jul 27 19:05:48.610555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.610027    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.610699 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.610632    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 19:05:48.610760 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.610703    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.611497 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.611480    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv"]
Jul 27 19:05:48.611616 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.611563    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.612834 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.612231    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.614136 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.614119    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-djppn\""
Jul 27 19:05:48.615146 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.614188    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 19:05:48.615146 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.614290    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.615146 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.615141    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 19:05:48.615965 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.615916    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.616576 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.616556    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.616677 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.616648    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 19:05:48.618184 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.618166    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 19:05:48.618432 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.618274    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"]
Jul 27 19:05:48.618587 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.618574    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b7nfp\""
Jul 27 19:05:48.618785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.618767    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.619054 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.619034    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 19:05:48.619163 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.619149    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"]
Jul 27 19:05:48.619246 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.619234    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 19:05:48.619411 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.619389    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.619643 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.619625    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 19:05:48.619968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.619943    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"]
Jul 27 19:05:48.621084 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.621063    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6kxtg\""
Jul 27 19:05:48.621925 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.621879    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.622582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.622563    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 19:05:48.624060 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.624039    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-shw9l"]
Jul 27 19:05:48.627611 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.627588    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.630563 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.628790    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c46d44f97-sg67g"]
Jul 27 19:05:48.632475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.632457    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"]
Jul 27 19:05:48.635683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.635662    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.635848 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.635741    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 19:05:48.638511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.638490    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:05:48.638940 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.638920    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8j5l9\""
Jul 27 19:05:48.639166 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.638528    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:05:48.639291 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.639273    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 19:05:48.639530 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.639510    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hkqdb"]
Jul 27 19:05:48.639601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.639564    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.639601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.639579    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 19:05:48.639750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.639734    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x49b2\""
Jul 27 19:05:48.639829 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.639756    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 19:05:48.640193 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.640001    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 19:05:48.640193 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.640137    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:48.640349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.639518    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.645076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.645057    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 19:05:48.645953 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.645914    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mft6x\""
Jul 27 19:05:48.646717 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.646695    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 19:05:48.647041 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.647021    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76fdf799f5-mhh4d"]
Jul 27 19:05:48.647161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.647055    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h49xz"]
Jul 27 19:05:48.647161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.647078    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27"]
Jul 27 19:05:48.647427 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.647411    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkqdb"
Jul 27 19:05:48.649885 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.649868    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.650158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650135    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.650218 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650199    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:05:48.650426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650405    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"]
Jul 27 19:05:48.650426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650423    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7dvk\""
Jul 27 19:05:48.650570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650442    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkqdb"]
Jul 27 19:05:48.650570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650454    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-shw9l"]
Jul 27 19:05:48.650570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650469    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c46d44f97-sg67g"]
Jul 27 19:05:48.650570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650482    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27"]
Jul 27 19:05:48.650570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650501    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ldsb7"]
Jul 27 19:05:48.650570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650518    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"]
Jul 27 19:05:48.650761 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.650580    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27"
Jul 27 19:05:48.653178 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.653158    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:05:48.653273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.653261    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:05:48.653354 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.653335    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h9bsf\""
Jul 27 19:05:48.750002 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.749942    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f175664a-1582-4bcb-b693-68c79235cd50-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.750002 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.749976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.750182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-installation-pull-secrets\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.750182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750027    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4bn\" (UniqueName: \"kubernetes.io/projected/6daba063-204b-41f7-8c46-71d1c896b21b-kube-api-access-km4bn\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:48.750182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjfsg\" (UniqueName: \"kubernetes.io/projected/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-kube-api-access-wjfsg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.750182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750101    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9c2n\" (UniqueName: \"kubernetes.io/projected/64ea86d6-0736-4e90-961c-30335ca425a2-kube-api-access-f9c2n\") pod \"network-check-source-7d88cb55d8-ght27\" (UID: \"64ea86d6-0736-4e90-961c-30335ca425a2\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27"
Jul 27 19:05:48.750182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750134    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:48.750182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750174    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-bound-sa-token\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750198    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-stats-auth\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-service-ca-bundle\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750311    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777fdac3-a4f7-4b41-b196-80d987abe37e-ca-trust-extracted\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750332    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1506781-81db-4e02-be04-1d57e9f98e6f-cert\") pod \"ingress-canary-hkqdb\" (UID: \"c1506781-81db-4e02-be04-1d57e9f98e6f\") " pod="openshift-ingress-canary/ingress-canary-hkqdb"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433f4a96-4572-4997-af45-4e2bd22c32ad-config\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrwp6\" (UniqueName: \"kubernetes.io/projected/c1506781-81db-4e02-be04-1d57e9f98e6f-kube-api-access-lrwp6\") pod \"ingress-canary-hkqdb\" (UID: \"c1506781-81db-4e02-be04-1d57e9f98e6f\") " pod="openshift-ingress-canary/ingress-canary-hkqdb"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750434    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-snapshots\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750458    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq6th\" (UniqueName: \"kubernetes.io/projected/f175664a-1582-4bcb-b693-68c79235cd50-kube-api-access-tq6th\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.750528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750486    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5pf5\" (UniqueName: \"kubernetes.io/projected/002f617c-ef0b-4876-a28c-c81bca7377a5-kube-api-access-p5pf5\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08f814de-dd10-44fb-b49f-a95abfbadb2a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750598    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-serving-cert\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-default-certificate\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750692    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdk25\" (UniqueName: \"kubernetes.io/projected/60142d34-80c8-4db5-b5f1-1652bea170af-kube-api-access-bdk25\") pod \"volume-data-source-validator-549c6d54cf-2x7jv\" (UID: \"60142d34-80c8-4db5-b5f1-1652bea170af\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-trusted-ca\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dncd\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-kube-api-access-6dncd\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750770    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51464ba8-9e7a-4d4e-8980-fde4058526cf-tmp-dir\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750892    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk92z\" (UniqueName: \"kubernetes.io/projected/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-kube-api-access-fk92z\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750914    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51464ba8-9e7a-4d4e-8980-fde4058526cf-config-volume\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08f814de-dd10-44fb-b49f-a95abfbadb2a-config\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750966    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:48.750998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.750994    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-tmp\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751020    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/433f4a96-4572-4997-af45-4e2bd22c32ad-trusted-ca\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751080    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433f4a96-4572-4997-af45-4e2bd22c32ad-serving-cert\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wkdz\" (UniqueName: \"kubernetes.io/projected/433f4a96-4572-4997-af45-4e2bd22c32ad-kube-api-access-4wkdz\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-certificates\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751185    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751240    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79xt\" (UniqueName: \"kubernetes.io/projected/08f814de-dd10-44fb-b49f-a95abfbadb2a-kube-api-access-v79xt\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751273    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-image-registry-private-configuration\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751312    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.751596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.751347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlr6l\" (UniqueName: \"kubernetes.io/projected/51464ba8-9e7a-4d4e-8980-fde4058526cf-kube-api-access-mlr6l\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.784583 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.784561    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:05:48.784583 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.784574    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:05:48.787456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.787438    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:05:48.787821 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.787512    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2xl5\""
Jul 27 19:05:48.787821 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.787572    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pxl4\""
Jul 27 19:05:48.851978 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.851948    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-serving-cert\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.852141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.851988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.852141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-default-certificate\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.852141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852044    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdk25\" (UniqueName: \"kubernetes.io/projected/60142d34-80c8-4db5-b5f1-1652bea170af-kube-api-access-bdk25\") pod \"volume-data-source-validator-549c6d54cf-2x7jv\" (UID: \"60142d34-80c8-4db5-b5f1-1652bea170af\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv"
Jul 27 19:05:48.852141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852069    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-trusted-ca\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.852141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852095    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dncd\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-kube-api-access-6dncd\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.852141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852112    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51464ba8-9e7a-4d4e-8980-fde4058526cf-tmp-dir\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852194    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk92z\" (UniqueName: \"kubernetes.io/projected/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-kube-api-access-fk92z\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852260    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51464ba8-9e7a-4d4e-8980-fde4058526cf-config-volume\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08f814de-dd10-44fb-b49f-a95abfbadb2a-config\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852339    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-tmp\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/433f4a96-4572-4997-af45-4e2bd22c32ad-trusted-ca\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.852418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852420    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852453    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433f4a96-4572-4997-af45-4e2bd22c32ad-serving-cert\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wkdz\" (UniqueName: \"kubernetes.io/projected/433f4a96-4572-4997-af45-4e2bd22c32ad-kube-api-access-4wkdz\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852488    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-certificates\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852526    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v79xt\" (UniqueName: \"kubernetes.io/projected/08f814de-dd10-44fb-b49f-a95abfbadb2a-kube-api-access-v79xt\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-image-registry-private-configuration\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852571    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlr6l\" (UniqueName: \"kubernetes.io/projected/51464ba8-9e7a-4d4e-8980-fde4058526cf-kube-api-access-mlr6l\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f175664a-1582-4bcb-b693-68c79235cd50-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852622    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-installation-pull-secrets\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852668    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4bn\" (UniqueName: \"kubernetes.io/projected/6daba063-204b-41f7-8c46-71d1c896b21b-kube-api-access-km4bn\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjfsg\" (UniqueName: \"kubernetes.io/projected/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-kube-api-access-wjfsg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.852855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.852720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9c2n\" (UniqueName: \"kubernetes.io/projected/64ea86d6-0736-4e90-961c-30335ca425a2-kube-api-access-f9c2n\") pod \"network-check-source-7d88cb55d8-ght27\" (UID: \"64ea86d6-0736-4e90-961c-30335ca425a2\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27"
Jul 27 19:05:48.854103 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.854067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-tmp\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.854455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.854429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08f814de-dd10-44fb-b49f-a95abfbadb2a-config\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.855694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.855666    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f175664a-1582-4bcb-b693-68c79235cd50-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.855830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.855752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/433f4a96-4572-4997-af45-4e2bd22c32ad-trusted-ca\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.857014 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.856989    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857367    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-bound-sa-token\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-stats-auth\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-service-ca-bundle\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857492    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777fdac3-a4f7-4b41-b196-80d987abe37e-ca-trust-extracted\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857651    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1506781-81db-4e02-be04-1d57e9f98e6f-cert\") pod \"ingress-canary-hkqdb\" (UID: \"c1506781-81db-4e02-be04-1d57e9f98e6f\") " pod="openshift-ingress-canary/ingress-canary-hkqdb"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857683    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433f4a96-4572-4997-af45-4e2bd22c32ad-config\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857738    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrwp6\" (UniqueName: \"kubernetes.io/projected/c1506781-81db-4e02-be04-1d57e9f98e6f-kube-api-access-lrwp6\") pod \"ingress-canary-hkqdb\" (UID: \"c1506781-81db-4e02-be04-1d57e9f98e6f\") " pod="openshift-ingress-canary/ingress-canary-hkqdb"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-snapshots\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq6th\" (UniqueName: \"kubernetes.io/projected/f175664a-1582-4bcb-b693-68c79235cd50-kube-api-access-tq6th\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5pf5\" (UniqueName: \"kubernetes.io/projected/002f617c-ef0b-4876-a28c-c81bca7377a5-kube-api-access-p5pf5\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857885    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-default-certificate\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857898    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51464ba8-9e7a-4d4e-8980-fde4058526cf-config-volume\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.858523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.857912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08f814de-dd10-44fb-b49f-a95abfbadb2a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.859222 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.858423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.859222 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.858723    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:48.859222 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.858728    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-certificates\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.859222 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.858738    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-serving-cert\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.859222 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.858926    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:48.859222 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.858937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51464ba8-9e7a-4d4e-8980-fde4058526cf-tmp-dir\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.859222 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.859016    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:05:48.859923 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.859896    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.860018 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.860002    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:05:48.861559 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.860494    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:48.861559 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.860890    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:05:48.861559 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.861208    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777fdac3-a4f7-4b41-b196-80d987abe37e-ca-trust-extracted\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.861865 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.861842    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdk25\" (UniqueName: \"kubernetes.io/projected/60142d34-80c8-4db5-b5f1-1652bea170af-kube-api-access-bdk25\") pod \"volume-data-source-validator-549c6d54cf-2x7jv\" (UID: \"60142d34-80c8-4db5-b5f1-1652bea170af\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv"
Jul 27 19:05:48.862028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.862007    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-stats-auth\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.862479 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.862453    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-service-ca-bundle\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.862595    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dncd\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-kube-api-access-6dncd\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.863198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-trusted-ca\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.859017    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls podName:f175664a-1582-4bcb-b693-68c79235cd50 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:49.358998543 +0000 UTC m=+36.066138013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nqgjq" (UID: "f175664a-1582-4bcb-b693-68c79235cd50") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.863248    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert podName:6ee70953-9fcf-4271-b319-4cc2ef2b6bed nodeName:}" failed. No retries permitted until 2026-07-27 19:05:49.36323142 +0000 UTC m=+36.070370892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tqgm6" (UID: "6ee70953-9fcf-4271-b319-4cc2ef2b6bed") : secret "networking-console-plugin-cert" not found
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.863243    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433f4a96-4572-4997-af45-4e2bd22c32ad-config\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.863278    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:49.363268209 +0000 UTC m=+36.070407680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : configmap references non-existent config key: service-ca.crt
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.863305    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls podName:6daba063-204b-41f7-8c46-71d1c896b21b nodeName:}" failed. No retries permitted until 2026-07-27 19:05:49.363290731 +0000 UTC m=+36.070430201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls") pod "cluster-samples-operator-6748489656-km8rx" (UID: "6daba063-204b-41f7-8c46-71d1c896b21b") : secret "samples-operator-tls" not found
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.863319    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls podName:51464ba8-9e7a-4d4e-8980-fde4058526cf nodeName:}" failed. No retries permitted until 2026-07-27 19:05:49.363310926 +0000 UTC m=+36.070450394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls") pod "dns-default-shw9l" (UID: "51464ba8-9e7a-4d4e-8980-fde4058526cf") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:48.863685 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.863336    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:49.363324295 +0000 UTC m=+36.070463771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : secret "router-metrics-certs-default" not found
Jul 27 19:05:48.866580 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.866556    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-snapshots\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.867066 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.867045    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08f814de-dd10-44fb-b49f-a95abfbadb2a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.867229 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.867204    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433f4a96-4572-4997-af45-4e2bd22c32ad-serving-cert\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.868195 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.868167    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wkdz\" (UniqueName: \"kubernetes.io/projected/433f4a96-4572-4997-af45-4e2bd22c32ad-kube-api-access-4wkdz\") pod \"console-operator-584dcb6b54-ldsb7\" (UID: \"433f4a96-4572-4997-af45-4e2bd22c32ad\") " pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:48.868703 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.868467    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9c2n\" (UniqueName: \"kubernetes.io/projected/64ea86d6-0736-4e90-961c-30335ca425a2-kube-api-access-f9c2n\") pod \"network-check-source-7d88cb55d8-ght27\" (UID: \"64ea86d6-0736-4e90-961c-30335ca425a2\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27"
Jul 27 19:05:48.868941 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.868918    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1506781-81db-4e02-be04-1d57e9f98e6f-cert\") pod \"ingress-canary-hkqdb\" (UID: \"c1506781-81db-4e02-be04-1d57e9f98e6f\") " pod="openshift-ingress-canary/ingress-canary-hkqdb"
Jul 27 19:05:48.869076 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.868939    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:48.869167 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.869156    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fdf799f5-mhh4d: secret "image-registry-tls" not found
Jul 27 19:05:48.869317 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.868964    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-installation-pull-secrets\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.869443 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.869419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk92z\" (UniqueName: \"kubernetes.io/projected/dc0e5d7c-561f-476b-beb9-ab84d87b23fb-kube-api-access-fk92z\") pod \"insights-operator-5885fdb759-h49xz\" (UID: \"dc0e5d7c-561f-476b-beb9-ab84d87b23fb\") " pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.869586 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.869567    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-image-registry-private-configuration\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.869645 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.869616    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79xt\" (UniqueName: \"kubernetes.io/projected/08f814de-dd10-44fb-b49f-a95abfbadb2a-kube-api-access-v79xt\") pod \"service-ca-operator-5d6c75f84f-8lnc7\" (UID: \"08f814de-dd10-44fb-b49f-a95abfbadb2a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.870319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:48.870146    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls podName:777fdac3-a4f7-4b41-b196-80d987abe37e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:49.369717926 +0000 UTC m=+36.076857408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls") pod "image-registry-76fdf799f5-mhh4d" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e") : secret "image-registry-tls" not found
Jul 27 19:05:48.871042 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.870994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-bound-sa-token\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:48.872023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.872004    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlr6l\" (UniqueName: \"kubernetes.io/projected/51464ba8-9e7a-4d4e-8980-fde4058526cf-kube-api-access-mlr6l\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:48.873926 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.873906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrwp6\" (UniqueName: \"kubernetes.io/projected/c1506781-81db-4e02-be04-1d57e9f98e6f-kube-api-access-lrwp6\") pod \"ingress-canary-hkqdb\" (UID: \"c1506781-81db-4e02-be04-1d57e9f98e6f\") " pod="openshift-ingress-canary/ingress-canary-hkqdb"
Jul 27 19:05:48.874731 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.874708    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4bn\" (UniqueName: \"kubernetes.io/projected/6daba063-204b-41f7-8c46-71d1c896b21b-kube-api-access-km4bn\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:48.875676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.875656    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjfsg\" (UniqueName: \"kubernetes.io/projected/d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a-kube-api-access-wjfsg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5\" (UID: \"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.879592 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.879568    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq6th\" (UniqueName: \"kubernetes.io/projected/f175664a-1582-4bcb-b693-68c79235cd50-kube-api-access-tq6th\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:48.879696 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.879674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5pf5\" (UniqueName: \"kubernetes.io/projected/002f617c-ef0b-4876-a28c-c81bca7377a5-kube-api-access-p5pf5\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:48.909658 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.909632    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv"
Jul 27 19:05:48.928394 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.928370    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"
Jul 27 19:05:48.962430 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.962405    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-h49xz"
Jul 27 19:05:48.972982 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.972128    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"
Jul 27 19:05:48.986066 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:48.985913    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:05:49.012608 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.012351    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkqdb"
Jul 27 19:05:49.017866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.017823    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27"
Jul 27 19:05:49.154825 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.144655    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv"]
Jul 27 19:05:49.157422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.155763    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7"]
Jul 27 19:05:49.179051 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:49.175954    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f814de_dd10_44fb_b49f_a95abfbadb2a.slice/crio-f4228fcd6c74acea066fc59529dcf53a7c96386a7c1d610abad2274343bfe0fa WatchSource:0}: Error finding container f4228fcd6c74acea066fc59529dcf53a7c96386a7c1d610abad2274343bfe0fa: Status 404 returned error can't find the container with id f4228fcd6c74acea066fc59529dcf53a7c96386a7c1d610abad2274343bfe0fa
Jul 27 19:05:49.206798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.205740    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h49xz"]
Jul 27 19:05:49.218916 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.218604    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5"]
Jul 27 19:05:49.228320 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:49.228096    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d97a66_be6e_42d3_a1c1_7d7b0f39ed8a.slice/crio-4daeedb374830b5ea9cd53d6fa0c44ecd9b80116824ff0ed12b95743b3922730 WatchSource:0}: Error finding container 4daeedb374830b5ea9cd53d6fa0c44ecd9b80116824ff0ed12b95743b3922730: Status 404 returned error can't find the container with id 4daeedb374830b5ea9cd53d6fa0c44ecd9b80116824ff0ed12b95743b3922730
Jul 27 19:05:49.266137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.266042    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ldsb7"]
Jul 27 19:05:49.269522 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.269498    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27"]
Jul 27 19:05:49.271390 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:49.270461    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433f4a96_4572_4997_af45_4e2bd22c32ad.slice/crio-f9dfbb42c0f7cb084c45d875ec744876afb5214c87d10eddcaac8d3010c83a93 WatchSource:0}: Error finding container f9dfbb42c0f7cb084c45d875ec744876afb5214c87d10eddcaac8d3010c83a93: Status 404 returned error can't find the container with id f9dfbb42c0f7cb084c45d875ec744876afb5214c87d10eddcaac8d3010c83a93
Jul 27 19:05:49.272638 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:49.272556    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ea86d6_0736_4e90_961c_30335ca425a2.slice/crio-10795d66d02941229310e76e212b45e8503a6fd88033b5bcc86550235aa7d516 WatchSource:0}: Error finding container 10795d66d02941229310e76e212b45e8503a6fd88033b5bcc86550235aa7d516: Status 404 returned error can't find the container with id 10795d66d02941229310e76e212b45e8503a6fd88033b5bcc86550235aa7d516
Jul 27 19:05:49.279148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.279126    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkqdb"]
Jul 27 19:05:49.282758 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:05:49.282723    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1506781_81db_4e02_be04_1d57e9f98e6f.slice/crio-0a9c6142a6e488a15a46efb76312ae7fdb53738575729d52603b0c18a578ea23 WatchSource:0}: Error finding container 0a9c6142a6e488a15a46efb76312ae7fdb53738575729d52603b0c18a578ea23: Status 404 returned error can't find the container with id 0a9c6142a6e488a15a46efb76312ae7fdb53738575729d52603b0c18a578ea23
Jul 27 19:05:49.369779 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.369751    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:49.369949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.369795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:49.369949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.369864    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:49.369949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.369895    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:49.369949 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.369914    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:49.369949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.369923    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:49.370174 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.369951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:49.370174 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.369977    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls podName:f175664a-1582-4bcb-b693-68c79235cd50 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:50.369958459 +0000 UTC m=+37.077097943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nqgjq" (UID: "f175664a-1582-4bcb-b693-68c79235cd50") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:49.370174 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370014    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:05:49.370174 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.370036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:49.370174 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370047    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls podName:6daba063-204b-41f7-8c46-71d1c896b21b nodeName:}" failed. No retries permitted until 2026-07-27 19:05:50.370036431 +0000 UTC m=+37.077175907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls") pod "cluster-samples-operator-6748489656-km8rx" (UID: "6daba063-204b-41f7-8c46-71d1c896b21b") : secret "samples-operator-tls" not found
Jul 27 19:05:49.370174 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370089    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:05:49.370174 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370120    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:50.370111446 +0000 UTC m=+37.077250918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : secret "router-metrics-certs-default" not found
Jul 27 19:05:49.370174 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370165    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:05:49.370525 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370196    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert podName:6ee70953-9fcf-4271-b319-4cc2ef2b6bed nodeName:}" failed. No retries permitted until 2026-07-27 19:05:50.370186815 +0000 UTC m=+37.077326287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tqgm6" (UID: "6ee70953-9fcf-4271-b319-4cc2ef2b6bed") : secret "networking-console-plugin-cert" not found
Jul 27 19:05:49.370525 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370257    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:50.370247436 +0000 UTC m=+37.077386905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : configmap references non-existent config key: service-ca.crt
Jul 27 19:05:49.370525 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370307    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:49.370525 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370331    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls podName:51464ba8-9e7a-4d4e-8980-fde4058526cf nodeName:}" failed. No retries permitted until 2026-07-27 19:05:50.370323396 +0000 UTC m=+37.077462865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls") pod "dns-default-shw9l" (UID: "51464ba8-9e7a-4d4e-8980-fde4058526cf") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:49.370525 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370386    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:49.370525 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370396    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fdf799f5-mhh4d: secret "image-registry-tls" not found
Jul 27 19:05:49.370525 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:49.370423    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls podName:777fdac3-a4f7-4b41-b196-80d987abe37e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:50.370414335 +0000 UTC m=+37.077553805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls") pod "image-registry-76fdf799f5-mhh4d" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e") : secret "image-registry-tls" not found
Jul 27 19:05:49.786950 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.786356    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:05:49.790180 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:49.789980    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:05:50.000404 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.000326    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7" event={"ID":"433f4a96-4572-4997-af45-4e2bd22c32ad","Type":"ContainerStarted","Data":"f9dfbb42c0f7cb084c45d875ec744876afb5214c87d10eddcaac8d3010c83a93"}
Jul 27 19:05:50.001744 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.001695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkqdb" event={"ID":"c1506781-81db-4e02-be04-1d57e9f98e6f","Type":"ContainerStarted","Data":"0a9c6142a6e488a15a46efb76312ae7fdb53738575729d52603b0c18a578ea23"}
Jul 27 19:05:50.003413 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.003389    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5" event={"ID":"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a","Type":"ContainerStarted","Data":"4daeedb374830b5ea9cd53d6fa0c44ecd9b80116824ff0ed12b95743b3922730"}
Jul 27 19:05:50.004848 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.004826    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27" event={"ID":"64ea86d6-0736-4e90-961c-30335ca425a2","Type":"ContainerStarted","Data":"10795d66d02941229310e76e212b45e8503a6fd88033b5bcc86550235aa7d516"}
Jul 27 19:05:50.006168 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.006115    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7" event={"ID":"08f814de-dd10-44fb-b49f-a95abfbadb2a","Type":"ContainerStarted","Data":"f4228fcd6c74acea066fc59529dcf53a7c96386a7c1d610abad2274343bfe0fa"}
Jul 27 19:05:50.007773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.007740    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv" event={"ID":"60142d34-80c8-4db5-b5f1-1652bea170af","Type":"ContainerStarted","Data":"64bc8d12fcac64873241f92720142bd8cca2483748e49f167c3384cfa9ad4ed9"}
Jul 27 19:05:50.009551 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.009527    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h49xz" event={"ID":"dc0e5d7c-561f-476b-beb9-ab84d87b23fb","Type":"ContainerStarted","Data":"4d0f4d075eeb4c22796b46cd2aaa380a785cfa524a69a52efa24a343acdfaedc"}
Jul 27 19:05:50.388569 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.388533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:50.388750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.388583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:50.388750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.388605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:50.388750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.388623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:50.388750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.388658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:50.388750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.388721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:50.388750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:50.388747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:50.389080 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.388865    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:05:50.389080 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.388916    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert podName:6ee70953-9fcf-4271-b319-4cc2ef2b6bed nodeName:}" failed. No retries permitted until 2026-07-27 19:05:52.38890081 +0000 UTC m=+39.096040278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tqgm6" (UID: "6ee70953-9fcf-4271-b319-4cc2ef2b6bed") : secret "networking-console-plugin-cert" not found
Jul 27 19:05:50.389295 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389269    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:52.389255899 +0000 UTC m=+39.096395384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : configmap references non-existent config key: service-ca.crt
Jul 27 19:05:50.389365 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389342    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:50.389416 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389366    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls podName:51464ba8-9e7a-4d4e-8980-fde4058526cf nodeName:}" failed. No retries permitted until 2026-07-27 19:05:52.389359836 +0000 UTC m=+39.096499305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls") pod "dns-default-shw9l" (UID: "51464ba8-9e7a-4d4e-8980-fde4058526cf") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:50.389416 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389407    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:50.389416 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389414    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fdf799f5-mhh4d: secret "image-registry-tls" not found
Jul 27 19:05:50.389567 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389456    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls podName:777fdac3-a4f7-4b41-b196-80d987abe37e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:52.389436864 +0000 UTC m=+39.096576353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls") pod "image-registry-76fdf799f5-mhh4d" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e") : secret "image-registry-tls" not found
Jul 27 19:05:50.389567 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389496    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:05:50.389567 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389525    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls podName:6daba063-204b-41f7-8c46-71d1c896b21b nodeName:}" failed. No retries permitted until 2026-07-27 19:05:52.389515029 +0000 UTC m=+39.096654512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls") pod "cluster-samples-operator-6748489656-km8rx" (UID: "6daba063-204b-41f7-8c46-71d1c896b21b") : secret "samples-operator-tls" not found
Jul 27 19:05:50.389567 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389558    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:05:50.389768 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389584    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:52.389570034 +0000 UTC m=+39.096709503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : secret "router-metrics-certs-default" not found
Jul 27 19:05:50.389768 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389628    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:50.389768 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:50.389655    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls podName:f175664a-1582-4bcb-b693-68c79235cd50 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:52.389645865 +0000 UTC m=+39.096785352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nqgjq" (UID: "f175664a-1582-4bcb-b693-68c79235cd50") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:52.408437 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:52.408394    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:52.408460    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:52.408512    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:52.408544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:52.408575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408662    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:52.408637    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408730    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert podName:6ee70953-9fcf-4271-b319-4cc2ef2b6bed nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.408716441 +0000 UTC m=+43.115855913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tqgm6" (UID: "6ee70953-9fcf-4271-b319-4cc2ef2b6bed") : secret "networking-console-plugin-cert" not found
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:52.408766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408773    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408783    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408837    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls podName:6daba063-204b-41f7-8c46-71d1c896b21b nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.40882671 +0000 UTC m=+43.115966222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls") pod "cluster-samples-operator-6748489656-km8rx" (UID: "6daba063-204b-41f7-8c46-71d1c896b21b") : secret "samples-operator-tls" not found
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408850    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls podName:51464ba8-9e7a-4d4e-8980-fde4058526cf nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.408844478 +0000 UTC m=+43.115983947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls") pod "dns-default-shw9l" (UID: "51464ba8-9e7a-4d4e-8980-fde4058526cf") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408880    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408896    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.408881815 +0000 UTC m=+43.116021292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : configmap references non-existent config key: service-ca.crt
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408902    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:52.408947 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408911    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fdf799f5-mhh4d: secret "image-registry-tls" not found
Jul 27 19:05:52.409432 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408916    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.408905629 +0000 UTC m=+43.116045105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : secret "router-metrics-certs-default" not found
Jul 27 19:05:52.409432 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408665    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:52.409432 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408932    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls podName:777fdac3-a4f7-4b41-b196-80d987abe37e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.408926135 +0000 UTC m=+43.116065604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls") pod "image-registry-76fdf799f5-mhh4d" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e") : secret "image-registry-tls" not found
Jul 27 19:05:52.409432 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:52.408950    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls podName:f175664a-1582-4bcb-b693-68c79235cd50 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.408941733 +0000 UTC m=+43.116081208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nqgjq" (UID: "f175664a-1582-4bcb-b693-68c79235cd50") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:56.446873 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:56.446822    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:56.446887    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:56.446919    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:56.446938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.446950    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:56.446969    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:56.446999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447031    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447033    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls podName:f175664a-1582-4bcb-b693-68c79235cd50 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:04.447012423 +0000 UTC m=+51.154151892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nqgjq" (UID: "f175664a-1582-4bcb-b693-68c79235cd50") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447076    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447085    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447113    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls podName:6daba063-204b-41f7-8c46-71d1c896b21b nodeName:}" failed. No retries permitted until 2026-07-27 19:06:04.447099288 +0000 UTC m=+51.154238763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls") pod "cluster-samples-operator-6748489656-km8rx" (UID: "6daba063-204b-41f7-8c46-71d1c896b21b") : secret "samples-operator-tls" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:56.447129    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447145    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls podName:51464ba8-9e7a-4d4e-8980-fde4058526cf nodeName:}" failed. No retries permitted until 2026-07-27 19:06:04.447133011 +0000 UTC m=+51.154272481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls") pod "dns-default-shw9l" (UID: "51464ba8-9e7a-4d4e-8980-fde4058526cf") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447088    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447163    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fdf799f5-mhh4d: secret "image-registry-tls" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447166    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:05:56.447319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447188    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert podName:6ee70953-9fcf-4271-b319-4cc2ef2b6bed nodeName:}" failed. No retries permitted until 2026-07-27 19:06:04.447176478 +0000 UTC m=+51.154315955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tqgm6" (UID: "6ee70953-9fcf-4271-b319-4cc2ef2b6bed") : secret "networking-console-plugin-cert" not found
Jul 27 19:05:56.447906 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447204    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:04.447196046 +0000 UTC m=+51.154335522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : configmap references non-existent config key: service-ca.crt
Jul 27 19:05:56.447906 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447222    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls podName:777fdac3-a4f7-4b41-b196-80d987abe37e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:04.447214245 +0000 UTC m=+51.154353714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls") pod "image-registry-76fdf799f5-mhh4d" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e") : secret "image-registry-tls" not found
Jul 27 19:05:56.447906 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:56.447232    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:04.447227582 +0000 UTC m=+51.154367050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : secret "router-metrics-certs-default" not found
Jul 27 19:05:59.036951 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.036903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv" event={"ID":"60142d34-80c8-4db5-b5f1-1652bea170af","Type":"ContainerStarted","Data":"319142e13cd5d03aa09e6723137a7b9b3d34191196b1cf5e20cf1021fa75e0e4"}
Jul 27 19:05:59.038734 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.038705    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h49xz" event={"ID":"dc0e5d7c-561f-476b-beb9-ab84d87b23fb","Type":"ContainerStarted","Data":"181fb74f90b695ec81b3bdee86a3030077195dfb4178621dcad043fb5dbda4e1"}
Jul 27 19:05:59.040597 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.040576    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/0.log"
Jul 27 19:05:59.040724 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.040625    2557 generic.go:356] "Generic (PLEG): container finished" podID="433f4a96-4572-4997-af45-4e2bd22c32ad" containerID="330fc5c13f17126596bd22b679dbbb1b399f74a21dae24846702ca90e30e6953" exitCode=255
Jul 27 19:05:59.040796 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.040710    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7" event={"ID":"433f4a96-4572-4997-af45-4e2bd22c32ad","Type":"ContainerDied","Data":"330fc5c13f17126596bd22b679dbbb1b399f74a21dae24846702ca90e30e6953"}
Jul 27 19:05:59.040897 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.040880    2557 scope.go:117] "RemoveContainer" containerID="330fc5c13f17126596bd22b679dbbb1b399f74a21dae24846702ca90e30e6953"
Jul 27 19:05:59.042391 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.042369    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkqdb" event={"ID":"c1506781-81db-4e02-be04-1d57e9f98e6f","Type":"ContainerStarted","Data":"e48e9a21078badfd056fbbf1e485abefebd1f28e86c425e24033f9fe4ac10374"}
Jul 27 19:05:59.044432 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.044411    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5" event={"ID":"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a","Type":"ContainerStarted","Data":"b127d3be25356f0118205c71f097548f9d541aa071d76cece21bc8fb5cf02ca1"}
Jul 27 19:05:59.049321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.049296    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9f90fae-833e-4c69-a937-f899ff9c8db4" containerID="3a7588bcba97195ee61c0f226178c9450500e7a3f332370de662d78b7b558860" exitCode=0
Jul 27 19:05:59.049423 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.049381    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerDied","Data":"3a7588bcba97195ee61c0f226178c9450500e7a3f332370de662d78b7b558860"}
Jul 27 19:05:59.051323 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.051155    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27" event={"ID":"64ea86d6-0736-4e90-961c-30335ca425a2","Type":"ContainerStarted","Data":"62e11445cf3d4304309cbb7a83c83972b9a055d45079c5d7d94735e4f101f08c"}
Jul 27 19:05:59.052770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.052718    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2x7jv" podStartSLOduration=18.205494306 podStartE2EDuration="27.052701567s" totalImagesPullingTime="8.847207261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:59.052090458 +0000 UTC m=+45.759229949" watchObservedRunningTime="2026-07-27 19:05:59.052701567 +0000 UTC m=+45.759841087"
Jul 27 19:05:59.053332 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.052948    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7" event={"ID":"08f814de-dd10-44fb-b49f-a95abfbadb2a","Type":"ContainerStarted","Data":"a50fc1a349118a1531029c5990cb7809cc6536d908b005c32d5a179fc1fb808b"}
Jul 27 19:05:59.071547 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.071500    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5" podStartSLOduration=18.294778865 podStartE2EDuration="27.07148374s" totalImagesPullingTime="8.776704875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:59.069887344 +0000 UTC m=+45.777026835" watchObservedRunningTime="2026-07-27 19:05:59.07148374 +0000 UTC m=+45.778623232"
Jul 27 19:05:59.140973 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.140929    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hkqdb" podStartSLOduration=2.385236235 podStartE2EDuration="11.140913782s" totalImagesPullingTime="8.755677547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:59.140668841 +0000 UTC m=+45.847808333" watchObservedRunningTime="2026-07-27 19:05:59.140913782 +0000 UTC m=+45.848053274"
Jul 27 19:05:59.164837 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.162638    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-h49xz" podStartSLOduration=18.33541502 podStartE2EDuration="27.162617091s" totalImagesPullingTime="8.827202071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:59.158234699 +0000 UTC m=+45.865374191" watchObservedRunningTime="2026-07-27 19:05:59.162617091 +0000 UTC m=+45.869756583"
Jul 27 19:05:59.175213 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.175157    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-ght27" podStartSLOduration=18.397267057 podStartE2EDuration="27.175137619s" totalImagesPullingTime="8.777870562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:59.173583771 +0000 UTC m=+45.880723259" watchObservedRunningTime="2026-07-27 19:05:59.175137619 +0000 UTC m=+45.882277111"
Jul 27 19:05:59.190442 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.190391    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7" podStartSLOduration=18.430415322 podStartE2EDuration="27.190371956s" totalImagesPullingTime="8.759956634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:59.189972328 +0000 UTC m=+45.897111819" watchObservedRunningTime="2026-07-27 19:05:59.190371956 +0000 UTC m=+45.897511440"
Jul 27 19:05:59.281343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.280741    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q9mpz"]
Jul 27 19:05:59.302602 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.302569    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.302797 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.302771    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q9mpz"]
Jul 27 19:05:59.305184 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.305162    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:05:59.305369 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.305348    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:05:59.305480 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.305350    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7pgv\""
Jul 27 19:05:59.386170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.386144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.386280 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.386179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl2fp\" (UniqueName: \"kubernetes.io/projected/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-api-access-pl2fp\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.386280 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.386210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.386375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.386289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-crio-socket\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.386375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.386365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-data-volume\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.486964 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.486933    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-crio-socket\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.487111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.486986    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-data-volume\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.487111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.487062    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.487111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.487082    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl2fp\" (UniqueName: \"kubernetes.io/projected/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-api-access-pl2fp\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.487267 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.487149    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-crio-socket\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.487267 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:59.487169    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.487267 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:59.487237    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:59.987216539 +0000 UTC m=+46.694356033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.487411 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.487281    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.487411 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.487315    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-data-volume\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.487411 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:59.487399    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.487523 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:59.487451    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:59.987437769 +0000 UTC m=+46.694577252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.507000 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.506969    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl2fp\" (UniqueName: \"kubernetes.io/projected/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-api-access-pl2fp\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.991931 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.991897    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.992093 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:05:59.991952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:05:59.992093 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:59.992020    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.992157 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:59.992100    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:00.992081915 +0000 UTC m=+47.699221404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.992157 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:59.992121    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.992226 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:05:59.992195    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:00.992183272 +0000 UTC m=+47.699322741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:00.059302 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.059268    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9f90fae-833e-4c69-a937-f899ff9c8db4" containerID="1d1e7a3b25a0a15fa7f632fbd4334ee2d6e6c65c20516b49c67a0f66666a3354" exitCode=0
Jul 27 19:06:00.059659 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.059344    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerDied","Data":"1d1e7a3b25a0a15fa7f632fbd4334ee2d6e6c65c20516b49c67a0f66666a3354"}
Jul 27 19:06:00.060959 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.060943    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:06:00.061360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.061340    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/0.log"
Jul 27 19:06:00.061473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.061380    2557 generic.go:356] "Generic (PLEG): container finished" podID="433f4a96-4572-4997-af45-4e2bd22c32ad" containerID="e5cfcd8f6eec2656a86c0d077332d4d12a861f0ebe89c22ecc59ce39b4d9a174" exitCode=255
Jul 27 19:06:00.061473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.061448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7" event={"ID":"433f4a96-4572-4997-af45-4e2bd22c32ad","Type":"ContainerDied","Data":"e5cfcd8f6eec2656a86c0d077332d4d12a861f0ebe89c22ecc59ce39b4d9a174"}
Jul 27 19:06:00.061579 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.061516    2557 scope.go:117] "RemoveContainer" containerID="330fc5c13f17126596bd22b679dbbb1b399f74a21dae24846702ca90e30e6953"
Jul 27 19:06:00.061702 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.061685    2557 scope.go:117] "RemoveContainer" containerID="e5cfcd8f6eec2656a86c0d077332d4d12a861f0ebe89c22ecc59ce39b4d9a174"
Jul 27 19:06:00.061935 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:00.061873    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ldsb7_openshift-console-operator(433f4a96-4572-4997-af45-4e2bd22c32ad)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7" podUID="433f4a96-4572-4997-af45-4e2bd22c32ad"
Jul 27 19:06:00.999288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.999255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:00.999479 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:00.999397    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:00.999479 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:00.999421    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:00.999479 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:00.999455    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:06:00.999634 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:00.999488    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:02.999469168 +0000 UTC m=+49.706608637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:00.999634 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:00.999507    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:02.999497917 +0000 UTC m=+49.706637386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : configmap "kube-rbac-proxy" not found
Jul 27 19:06:01.068116 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:01.068087    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" event={"ID":"c9f90fae-833e-4c69-a937-f899ff9c8db4","Type":"ContainerStarted","Data":"5784d1dc3fed4344b7e8a93a1e4ace39e796ade00a516d0945b4d021c8dcb714"}
Jul 27 19:06:01.069492 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:01.069473    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:06:01.069738 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:01.069725    2557 scope.go:117] "RemoveContainer" containerID="e5cfcd8f6eec2656a86c0d077332d4d12a861f0ebe89c22ecc59ce39b4d9a174"
Jul 27 19:06:01.069888 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:01.069871    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ldsb7_openshift-console-operator(433f4a96-4572-4997-af45-4e2bd22c32ad)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7" podUID="433f4a96-4572-4997-af45-4e2bd22c32ad"
Jul 27 19:06:01.076619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:01.076604    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-frh26_1112b3ac-a158-4cd1-b49e-3e6dc65be58e/dns-node-resolver/0.log"
Jul 27 19:06:01.090638 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:01.090600    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fg7v7" podStartSLOduration=9.421983471 podStartE2EDuration="47.090588135s" totalImagesPullingTime="37.668604664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:01.088133352 +0000 UTC m=+47.795272842" watchObservedRunningTime="2026-07-27 19:06:01.090588135 +0000 UTC m=+47.797727626"
Jul 27 19:06:02.277335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:02.277306    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rtvcd_408b1c2b-d4fd-491a-9a34-35a8c3a090d0/node-ca/0.log"
Jul 27 19:06:03.017930 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:03.017894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:03.018100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:03.017944    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:03.018100 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:03.018012    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:06:03.018100 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:03.018065    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:03.018100 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:03.018076    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:07.018061263 +0000 UTC m=+53.725200732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : configmap "kube-rbac-proxy" not found
Jul 27 19:06:03.018100 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:03.018103    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:07.018092404 +0000 UTC m=+53.725231873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:03.076755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:03.076723    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hkqdb_c1506781-81db-4e02-be04-1d57e9f98e6f/serve-healthcheck-canary/0.log"
Jul 27 19:06:04.529855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:04.529801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:04.529923    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.529961    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:04.529967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:04.530013    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530029    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:20.530009537 +0000 UTC m=+67.237149027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : secret "router-metrics-certs-default" not found
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530066    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530087    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle podName:002f617c-ef0b-4876-a28c-c81bca7377a5 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:20.530076765 +0000 UTC m=+67.237216233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle") pod "router-default-6c46d44f97-sg67g" (UID: "002f617c-ef0b-4876-a28c-c81bca7377a5") : configmap references non-existent config key: service-ca.crt
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:04.530109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530123    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530128    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls podName:f175664a-1582-4bcb-b693-68c79235cd50 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:20.530113464 +0000 UTC m=+67.237252935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nqgjq" (UID: "f175664a-1582-4bcb-b693-68c79235cd50") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530182    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530184    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert podName:6ee70953-9fcf-4271-b319-4cc2ef2b6bed nodeName:}" failed. No retries permitted until 2026-07-27 19:06:20.530172632 +0000 UTC m=+67.237312101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tqgm6" (UID: "6ee70953-9fcf-4271-b319-4cc2ef2b6bed") : secret "networking-console-plugin-cert" not found
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530210    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls podName:51464ba8-9e7a-4d4e-8980-fde4058526cf nodeName:}" failed. No retries permitted until 2026-07-27 19:06:20.530201289 +0000 UTC m=+67.237340759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls") pod "dns-default-shw9l" (UID: "51464ba8-9e7a-4d4e-8980-fde4058526cf") : secret "dns-default-metrics-tls" not found
Jul 27 19:06:04.530232 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:04.530225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:06:04.530659 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:04.530250    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:06:04.530659 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530312    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:06:04.530659 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530321    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fdf799f5-mhh4d: secret "image-registry-tls" not found
Jul 27 19:06:04.530659 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530342    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:06:04.530659 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530353    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls podName:777fdac3-a4f7-4b41-b196-80d987abe37e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:20.530343724 +0000 UTC m=+67.237483196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls") pod "image-registry-76fdf799f5-mhh4d" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e") : secret "image-registry-tls" not found
Jul 27 19:06:04.530659 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:04.530366    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls podName:6daba063-204b-41f7-8c46-71d1c896b21b nodeName:}" failed. No retries permitted until 2026-07-27 19:06:20.530358908 +0000 UTC m=+67.237498377 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls") pod "cluster-samples-operator-6748489656-km8rx" (UID: "6daba063-204b-41f7-8c46-71d1c896b21b") : secret "samples-operator-tls" not found
Jul 27 19:06:07.052327 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:07.052289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:07.052327 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:07.052339    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:07.053063 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:07.052523    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:07.053063 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:07.052604    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls podName:f5bb22c9-1338-46a3-9863-4a3c2a87c68e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:15.052581969 +0000 UTC m=+61.759721442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q9mpz" (UID: "f5bb22c9-1338-46a3-9863-4a3c2a87c68e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:07.053063 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:07.052905    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:08.987253 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:08.987219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:06:08.987639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:08.987276    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:06:08.987639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:08.987580    2557 scope.go:117] "RemoveContainer" containerID="e5cfcd8f6eec2656a86c0d077332d4d12a861f0ebe89c22ecc59ce39b4d9a174"
Jul 27 19:06:08.987794 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:08.987772    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ldsb7_openshift-console-operator(433f4a96-4572-4997-af45-4e2bd22c32ad)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7" podUID="433f4a96-4572-4997-af45-4e2bd22c32ad"
Jul 27 19:06:14.985213 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:14.985181    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjqns"
Jul 27 19:06:15.125905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:15.125868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:15.128175 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:15.128144    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5bb22c9-1338-46a3-9863-4a3c2a87c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9mpz\" (UID: \"f5bb22c9-1338-46a3-9863-4a3c2a87c68e\") " pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:15.299473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:15.299383    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7pgv\""
Jul 27 19:06:15.307789 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:15.307762    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q9mpz"
Jul 27 19:06:15.432248 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:15.432220    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q9mpz"]
Jul 27 19:06:15.435756 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:15.435732    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bb22c9_1338_46a3_9863_4a3c2a87c68e.slice/crio-ac4a714246dc1e7d5cf3416fd302612e30578f7c29d4d7217dc4b99265ba03ae WatchSource:0}: Error finding container ac4a714246dc1e7d5cf3416fd302612e30578f7c29d4d7217dc4b99265ba03ae: Status 404 returned error can't find the container with id ac4a714246dc1e7d5cf3416fd302612e30578f7c29d4d7217dc4b99265ba03ae
Jul 27 19:06:16.118875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:16.118774    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9mpz" event={"ID":"f5bb22c9-1338-46a3-9863-4a3c2a87c68e","Type":"ContainerStarted","Data":"ac4a714246dc1e7d5cf3416fd302612e30578f7c29d4d7217dc4b99265ba03ae"}
Jul 27 19:06:18.456886 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.456830    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:06:18.459942 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.459904    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:06:18.472386 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.470606    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442de7e6-e05f-4f4e-9dda-87387ec140ca-original-pull-secret\") pod \"global-pull-secret-syncer-hkjc9\" (UID: \"442de7e6-e05f-4f4e-9dda-87387ec140ca\") " pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:06:18.558438 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.558398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:06:18.561162 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.561138    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:06:18.572288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.572261    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf92079-7d20-41d0-9158-bd99ff69d650-metrics-certs\") pod \"network-metrics-daemon-s24nm\" (UID: \"aaf92079-7d20-41d0-9158-bd99ff69d650\") " pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:06:18.600535 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.600507    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkjc9"
Jul 27 19:06:18.659873 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.659802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:06:18.662761 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.662712    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jq2\" (UniqueName: \"kubernetes.io/projected/2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1-kube-api-access-d2jq2\") pod \"network-check-target-cxp86\" (UID: \"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1\") " pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:06:18.796558 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.796489    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pxl4\""
Jul 27 19:06:18.800983 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.800961    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2xl5\""
Jul 27 19:06:18.803997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.803978    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:06:18.809250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:18.809226    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s24nm"
Jul 27 19:06:20.264328 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.264179    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cxp86"]
Jul 27 19:06:20.266933 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:20.266883    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6542ef_f6b3_49e2_9bfa_a1ce467aa0e1.slice/crio-488da52bbdb050957dd045b9f1578e710ab03f778ccebde388f08582080e1f4b WatchSource:0}: Error finding container 488da52bbdb050957dd045b9f1578e710ab03f778ccebde388f08582080e1f4b: Status 404 returned error can't find the container with id 488da52bbdb050957dd045b9f1578e710ab03f778ccebde388f08582080e1f4b
Jul 27 19:06:20.282697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.282673    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s24nm"]
Jul 27 19:06:20.286172 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:20.286145    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf92079_7d20_41d0_9158_bd99ff69d650.slice/crio-f5721871815ab5d7065147aca45757fcbf5dfbf676e298081177bcf281b9d8e4 WatchSource:0}: Error finding container f5721871815ab5d7065147aca45757fcbf5dfbf676e298081177bcf281b9d8e4: Status 404 returned error can't find the container with id f5721871815ab5d7065147aca45757fcbf5dfbf676e298081177bcf281b9d8e4
Jul 27 19:06:20.484801 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.484770    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hkjc9"]
Jul 27 19:06:20.488698 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:20.488669    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442de7e6_e05f_4f4e_9dda_87387ec140ca.slice/crio-2328ab0d9afd6db04687b1b0f6031e4eb9e54d1fde3880925585086d773335be WatchSource:0}: Error finding container 2328ab0d9afd6db04687b1b0f6031e4eb9e54d1fde3880925585086d773335be: Status 404 returned error can't find the container with id 2328ab0d9afd6db04687b1b0f6031e4eb9e54d1fde3880925585086d773335be
Jul 27 19:06:20.580420 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.580396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:06:20.580536 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.580432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:06:20.580536 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.580458    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:20.580536 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.580477    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:06:20.580536 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.580496    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:06:20.580536 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.580521    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:06:20.580769 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.580546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:20.581333 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.581283    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002f617c-ef0b-4876-a28c-c81bca7377a5-service-ca-bundle\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:20.583146 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.583117    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f175664a-1582-4bcb-b693-68c79235cd50-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nqgjq\" (UID: \"f175664a-1582-4bcb-b693-68c79235cd50\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:06:20.583455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.583431    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51464ba8-9e7a-4d4e-8980-fde4058526cf-metrics-tls\") pod \"dns-default-shw9l\" (UID: \"51464ba8-9e7a-4d4e-8980-fde4058526cf\") " pod="openshift-dns/dns-default-shw9l"
Jul 27 19:06:20.583503 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.583437    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ee70953-9fcf-4271-b319-4cc2ef2b6bed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tqgm6\" (UID: \"6ee70953-9fcf-4271-b319-4cc2ef2b6bed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:06:20.583503 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.583477    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002f617c-ef0b-4876-a28c-c81bca7377a5-metrics-certs\") pod \"router-default-6c46d44f97-sg67g\" (UID: \"002f617c-ef0b-4876-a28c-c81bca7377a5\") " pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:20.583583 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.583565    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"image-registry-76fdf799f5-mhh4d\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") " pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:06:20.583647 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.583593    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6daba063-204b-41f7-8c46-71d1c896b21b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-km8rx\" (UID: \"6daba063-204b-41f7-8c46-71d1c896b21b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:06:20.743113 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.743037    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vw56c\""
Jul 27 19:06:20.750480 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.750454    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:06:20.758789 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.758749    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fz2xt\""
Jul 27 19:06:20.766456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.765851    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"
Jul 27 19:06:20.781867 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.781279    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b7nfp\""
Jul 27 19:06:20.784148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.784068    2557 scope.go:117] "RemoveContainer" containerID="e5cfcd8f6eec2656a86c0d077332d4d12a861f0ebe89c22ecc59ce39b4d9a174"
Jul 27 19:06:20.789231 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.789058    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"
Jul 27 19:06:20.795332 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.795130    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8j5l9\""
Jul 27 19:06:20.799883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.799673    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x49b2\""
Jul 27 19:06:20.803176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.802753    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-shw9l"
Jul 27 19:06:20.805926 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.805679    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mft6x\""
Jul 27 19:06:20.811174 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.808088    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:20.818005 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:20.817778    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"
Jul 27 19:06:21.001069 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.001037    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76fdf799f5-mhh4d"]
Jul 27 19:06:21.017934 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:21.016350    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777fdac3_a4f7_4b41_b196_80d987abe37e.slice/crio-fad7e651cc397f3c38c347c2f49af3aeaf2c5c48abff50d4a9266762bda67ab9 WatchSource:0}: Error finding container fad7e651cc397f3c38c347c2f49af3aeaf2c5c48abff50d4a9266762bda67ab9: Status 404 returned error can't find the container with id fad7e651cc397f3c38c347c2f49af3aeaf2c5c48abff50d4a9266762bda67ab9
Jul 27 19:06:21.032853 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.032558    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx"]
Jul 27 19:06:21.058915 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.058842    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq"]
Jul 27 19:06:21.062726 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:21.062557    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf175664a_1582_4bcb_b693_68c79235cd50.slice/crio-00a74a7fee629e4c305c52c7c5b2a835a4ea45ad85e7bea0000dcc88538717e7 WatchSource:0}: Error finding container 00a74a7fee629e4c305c52c7c5b2a835a4ea45ad85e7bea0000dcc88538717e7: Status 404 returned error can't find the container with id 00a74a7fee629e4c305c52c7c5b2a835a4ea45ad85e7bea0000dcc88538717e7
Jul 27 19:06:21.092748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.090768    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6"]
Jul 27 19:06:21.095630 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.095563    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c46d44f97-sg67g"]
Jul 27 19:06:21.135405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.135379    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-shw9l"]
Jul 27 19:06:21.147364 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.146673    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:06:21.147364 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.146758    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7" event={"ID":"433f4a96-4572-4997-af45-4e2bd22c32ad","Type":"ContainerStarted","Data":"e3af04498c1e6b700f2b5e82fd9960cf52785f85a183eeac1aad200d36929837"}
Jul 27 19:06:21.147733 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.147678    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:06:21.152121 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.151541    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cxp86" event={"ID":"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1","Type":"ContainerStarted","Data":"4259190cd27a8d804fb2eb1fb8a508ac02e725510c0a537887a599fde2460d0d"}
Jul 27 19:06:21.152121 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.151588    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cxp86" event={"ID":"2c6542ef-f6b3-49e2-9bfa-a1ce467aa0e1","Type":"ContainerStarted","Data":"488da52bbdb050957dd045b9f1578e710ab03f778ccebde388f08582080e1f4b"}
Jul 27 19:06:21.152121 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.152042    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:06:21.157493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.157426    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9mpz" event={"ID":"f5bb22c9-1338-46a3-9863-4a3c2a87c68e","Type":"ContainerStarted","Data":"190a7ba596afedef9b814659eeefed6b51e3f30dca24432c3692c7eb5d60395e"}
Jul 27 19:06:21.161101 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.161043    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c46d44f97-sg67g" event={"ID":"002f617c-ef0b-4876-a28c-c81bca7377a5","Type":"ContainerStarted","Data":"18e4b09332e76c8919545466ee1d476530f73cb8a53cae4d6d5b05bd5e416c30"}
Jul 27 19:06:21.162487 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.162463    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s24nm" event={"ID":"aaf92079-7d20-41d0-9158-bd99ff69d650","Type":"ContainerStarted","Data":"f5721871815ab5d7065147aca45757fcbf5dfbf676e298081177bcf281b9d8e4"}
Jul 27 19:06:21.164112 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.164009    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6" event={"ID":"6ee70953-9fcf-4271-b319-4cc2ef2b6bed","Type":"ContainerStarted","Data":"8626bf815aed870db943efef73bf2a181692f56a13d7c42edba6d5ef3b79ad90"}
Jul 27 19:06:21.170749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.170723    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq" event={"ID":"f175664a-1582-4bcb-b693-68c79235cd50","Type":"ContainerStarted","Data":"00a74a7fee629e4c305c52c7c5b2a835a4ea45ad85e7bea0000dcc88538717e7"}
Jul 27 19:06:21.172670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.172597    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx" event={"ID":"6daba063-204b-41f7-8c46-71d1c896b21b","Type":"ContainerStarted","Data":"ecbb09635d9487f7c373d8bb33d9979ab435fb0ebda3cd9db58852a98b35f526"}
Jul 27 19:06:21.175662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.175099    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d" event={"ID":"777fdac3-a4f7-4b41-b196-80d987abe37e","Type":"ContainerStarted","Data":"0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576"}
Jul 27 19:06:21.175662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.175139    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d" event={"ID":"777fdac3-a4f7-4b41-b196-80d987abe37e","Type":"ContainerStarted","Data":"fad7e651cc397f3c38c347c2f49af3aeaf2c5c48abff50d4a9266762bda67ab9"}
Jul 27 19:06:21.175662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.175622    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:06:21.178187 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.178123    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hkjc9" event={"ID":"442de7e6-e05f-4f4e-9dda-87387ec140ca","Type":"ContainerStarted","Data":"2328ab0d9afd6db04687b1b0f6031e4eb9e54d1fde3880925585086d773335be"}
Jul 27 19:06:21.184779 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.184718    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7" podStartSLOduration=40.417167452 podStartE2EDuration="49.184701028s" totalImagesPullingTime="8.767533576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:21.167594434 +0000 UTC m=+67.874733926" watchObservedRunningTime="2026-07-27 19:06:21.184701028 +0000 UTC m=+67.891840534"
Jul 27 19:06:21.185700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.185304    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cxp86" podStartSLOduration=67.185290353 podStartE2EDuration="1m7.185290353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:21.184528925 +0000 UTC m=+67.891668418" watchObservedRunningTime="2026-07-27 19:06:21.185290353 +0000 UTC m=+67.892429845"
Jul 27 19:06:21.206843 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.206702    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d" podStartSLOduration=67.206684387 podStartE2EDuration="1m7.206684387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:21.205748584 +0000 UTC m=+67.912888076" watchObservedRunningTime="2026-07-27 19:06:21.206684387 +0000 UTC m=+67.913823879"
Jul 27 19:06:21.644455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.644421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-ldsb7"
Jul 27 19:06:21.837306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.836111    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-nzcpj"]
Jul 27 19:06:21.839628 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.838641    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-nzcpj"
Jul 27 19:06:21.843449 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.842790    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 19:06:21.843449 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.843085    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-j6mn5\""
Jul 27 19:06:21.843449 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.843273    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 19:06:21.848313 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.848262    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-nzcpj"]
Jul 27 19:06:21.901422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:21.901241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmmj\" (UniqueName: \"kubernetes.io/projected/4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d-kube-api-access-mpmmj\") pod \"downloads-7c97dc4555-nzcpj\" (UID: \"4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d\") " pod="openshift-console/downloads-7c97dc4555-nzcpj"
Jul 27 19:06:22.002539 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:22.002500    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmmj\" (UniqueName: \"kubernetes.io/projected/4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d-kube-api-access-mpmmj\") pod \"downloads-7c97dc4555-nzcpj\" (UID: \"4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d\") " pod="openshift-console/downloads-7c97dc4555-nzcpj"
Jul 27 19:06:22.021690 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:22.021633    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmmj\" (UniqueName: \"kubernetes.io/projected/4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d-kube-api-access-mpmmj\") pod \"downloads-7c97dc4555-nzcpj\" (UID: \"4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d\") " pod="openshift-console/downloads-7c97dc4555-nzcpj"
Jul 27 19:06:22.158037 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:22.157905    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-nzcpj"
Jul 27 19:06:22.187861 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:22.187275    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c46d44f97-sg67g" event={"ID":"002f617c-ef0b-4876-a28c-c81bca7377a5","Type":"ContainerStarted","Data":"c6a3aae961259ea2e57cbc63a938ea8ca56d4fb9f773ca6941680613e6fb0572"}
Jul 27 19:06:22.193941 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:22.193066    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shw9l" event={"ID":"51464ba8-9e7a-4d4e-8980-fde4058526cf","Type":"ContainerStarted","Data":"a0a8e15ec0bdf3cb5fb3c1a4a60f23fc57d8739d50284dd0e5062b6a9c5c9285"}
Jul 27 19:06:22.207886 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:22.207840    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c46d44f97-sg67g" podStartSLOduration=50.207801236 podStartE2EDuration="50.207801236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:22.207052303 +0000 UTC m=+68.914191816" watchObservedRunningTime="2026-07-27 19:06:22.207801236 +0000 UTC m=+68.914940730"
Jul 27 19:06:22.809414 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:22.809380    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:22.812335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:22.812147    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:23.202039 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:23.202012    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:23.203355 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:23.203312    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c46d44f97-sg67g"
Jul 27 19:06:29.010101 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:29.010069    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-nzcpj"]
Jul 27 19:06:29.222075 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:29.222039    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc0e035_4d4e_4dad_b7c3_1ebf83749c9d.slice/crio-cb841df80dd4c853e4696de183a4334f4598acb71209fdfa929d5d1d23fd54b9 WatchSource:0}: Error finding container cb841df80dd4c853e4696de183a4334f4598acb71209fdfa929d5d1d23fd54b9: Status 404 returned error can't find the container with id cb841df80dd4c853e4696de183a4334f4598acb71209fdfa929d5d1d23fd54b9
Jul 27 19:06:29.230320 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:29.230291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-nzcpj" event={"ID":"4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d","Type":"ContainerStarted","Data":"cb841df80dd4c853e4696de183a4334f4598acb71209fdfa929d5d1d23fd54b9"}
Jul 27 19:06:30.239357 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.239318    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shw9l" event={"ID":"51464ba8-9e7a-4d4e-8980-fde4058526cf","Type":"ContainerStarted","Data":"6717ab2938ffbc9470427056f643ec4e66ef0d29572adc5726c4a284559a36ee"}
Jul 27 19:06:30.239782 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.239391    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shw9l" event={"ID":"51464ba8-9e7a-4d4e-8980-fde4058526cf","Type":"ContainerStarted","Data":"853cc7eef47b8d6317924b1d1d2e57fb8ab5d97a454fcf27fed6bf1d0a59e7d8"}
Jul 27 19:06:30.239782 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.239607    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-shw9l"
Jul 27 19:06:30.242161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.242110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6" event={"ID":"6ee70953-9fcf-4271-b319-4cc2ef2b6bed","Type":"ContainerStarted","Data":"dbf9bbe87910ade4161c5c366b92f90f785ef40e36496c7241cf0e2783293559"}
Jul 27 19:06:30.245291 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.245218    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9mpz" event={"ID":"f5bb22c9-1338-46a3-9863-4a3c2a87c68e","Type":"ContainerStarted","Data":"a2d05f1c47db031f037134a01b3715f4c691531f7db90bd23bba8e23cdff163c"}
Jul 27 19:06:30.248755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.248732    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s24nm" event={"ID":"aaf92079-7d20-41d0-9158-bd99ff69d650","Type":"ContainerStarted","Data":"a4f00fdb7121709fa956b572c0733a1210357664c59d7f9263d782ed29f117e7"}
Jul 27 19:06:30.248883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.248778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s24nm" event={"ID":"aaf92079-7d20-41d0-9158-bd99ff69d650","Type":"ContainerStarted","Data":"20a4c752599b8a0c53b6bb28f6f070a4f1d7429108f5a664f3e63de86267ab4b"}
Jul 27 19:06:30.252265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.252244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq" event={"ID":"f175664a-1582-4bcb-b693-68c79235cd50","Type":"ContainerStarted","Data":"14be9ea94f00dc810a03ad043b3be96b9a1578dc3fe11b13a9875db7157c0e77"}
Jul 27 19:06:30.255401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.255376    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx" event={"ID":"6daba063-204b-41f7-8c46-71d1c896b21b","Type":"ContainerStarted","Data":"ac22f5bc85598db77a2009576f56dd3b4323e77e9da941665d39b75ceb2e026c"}
Jul 27 19:06:30.255508 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.255428    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx" event={"ID":"6daba063-204b-41f7-8c46-71d1c896b21b","Type":"ContainerStarted","Data":"e46dfc1df92a00ae632d0d443f6af2b6f1b27c57f64d1b88c1cf27d4220968ee"}
Jul 27 19:06:30.257749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.257729    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hkjc9" event={"ID":"442de7e6-e05f-4f4e-9dda-87387ec140ca","Type":"ContainerStarted","Data":"4a7d1902b5aedd62356c4b8b0e19184e0455cbe1ccd1a306d5b536fb773a1c3b"}
Jul 27 19:06:30.260329 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.260283    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-shw9l" podStartSLOduration=33.990997383 podStartE2EDuration="42.260267759s" totalImagesPullingTime="8.269270376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:30.259468018 +0000 UTC m=+76.966607510" watchObservedRunningTime="2026-07-27 19:06:30.260267759 +0000 UTC m=+76.967407251"
Jul 27 19:06:30.278592 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.278539    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nqgjq" podStartSLOduration=49.926965104 podStartE2EDuration="58.278526404s" totalImagesPullingTime="8.3515613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:30.278183403 +0000 UTC m=+76.985322894" watchObservedRunningTime="2026-07-27 19:06:30.278526404 +0000 UTC m=+76.985665894"
Jul 27 19:06:30.300830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.300240    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tqgm6" podStartSLOduration=50.518717049 podStartE2EDuration="58.300219959s" totalImagesPullingTime="7.78150291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:30.298445556 +0000 UTC m=+77.005585047" watchObservedRunningTime="2026-07-27 19:06:30.300219959 +0000 UTC m=+77.007359454"
Jul 27 19:06:30.318372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.317171    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hkjc9" podStartSLOduration=67.753490107 podStartE2EDuration="1m16.317152127s" totalImagesPullingTime="8.56366202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:30.316332038 +0000 UTC m=+77.023471531" watchObservedRunningTime="2026-07-27 19:06:30.317152127 +0000 UTC m=+77.024291618"
Jul 27 19:06:30.335221 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.334603    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s24nm" podStartSLOduration=68.982335024 podStartE2EDuration="1m16.334584544s" totalImagesPullingTime="7.35224952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:30.333912984 +0000 UTC m=+77.041052476" watchObservedRunningTime="2026-07-27 19:06:30.334584544 +0000 UTC m=+77.041724034"
Jul 27 19:06:30.352243 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:30.352188    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-km8rx" podStartSLOduration=50.054021522 podStartE2EDuration="58.352165558s" totalImagesPullingTime="8.298144036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:30.351564924 +0000 UTC m=+77.058704420" watchObservedRunningTime="2026-07-27 19:06:30.352165558 +0000 UTC m=+77.059305050"
Jul 27 19:06:35.283244 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:35.283206    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9mpz" event={"ID":"f5bb22c9-1338-46a3-9863-4a3c2a87c68e","Type":"ContainerStarted","Data":"5ce59958e78f2195e61c650df52e565121b5e8d7da62586e3b1143220e44b160"}
Jul 27 19:06:35.300620 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:35.300572    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q9mpz" podStartSLOduration=17.768601996 podStartE2EDuration="36.300557755s" totalImagesPullingTime="18.531955759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:35.300158002 +0000 UTC m=+82.007297511" watchObservedRunningTime="2026-07-27 19:06:35.300557755 +0000 UTC m=+82.007697246"
Jul 27 19:06:40.265598 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:40.265570    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-shw9l"
Jul 27 19:06:42.467992 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.467950    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-znk94"]
Jul 27 19:06:42.471361 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.471336    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.474285 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.474262    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:06:42.474416 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.474302    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:06:42.474580 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.474557    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g68sl\""
Jul 27 19:06:42.474658 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.474589    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:06:42.475725 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.475708    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:06:42.577219 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.577379 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.577379 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577255    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-wtmp\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.577379 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn84x\" (UniqueName: \"kubernetes.io/projected/52b48837-9920-402a-9b89-aa5d439d75cd-kube-api-access-qn84x\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.577484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-sys\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.577484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b48837-9920-402a-9b89-aa5d439d75cd-metrics-client-ca\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.577573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577490    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-tls\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.577573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577560    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-root\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.577640 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.577598    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-textfile\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.636507 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.636475    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76fdf799f5-mhh4d"]
Jul 27 19:06:42.641351 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.641325    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:06:42.678588 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn84x\" (UniqueName: \"kubernetes.io/projected/52b48837-9920-402a-9b89-aa5d439d75cd-kube-api-access-qn84x\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.678757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678622    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-sys\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.678757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b48837-9920-402a-9b89-aa5d439d75cd-metrics-client-ca\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.678757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678678    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-tls\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.678757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678697    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-root\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.678757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-textfile\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.678757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.679061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.679061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678785    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-wtmp\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.679061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678975    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-wtmp\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.679061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.678980    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-root\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.679061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.679039    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52b48837-9920-402a-9b89-aa5d439d75cd-sys\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.679461 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.679421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-textfile\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.679611 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.679590    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.679752 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.679733    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b48837-9920-402a-9b89-aa5d439d75cd-metrics-client-ca\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.681896 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.681877    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.685159 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.685142    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52b48837-9920-402a-9b89-aa5d439d75cd-node-exporter-tls\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.697011 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.696569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn84x\" (UniqueName: \"kubernetes.io/projected/52b48837-9920-402a-9b89-aa5d439d75cd-kube-api-access-qn84x\") pod \"node-exporter-znk94\" (UID: \"52b48837-9920-402a-9b89-aa5d439d75cd\") " pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:42.781978 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:42.781901    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-znk94"
Jul 27 19:06:43.505845 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.505798    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:06:43.512501 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.512475    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.515895 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.515388    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 19:06:43.515895 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.515423    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 19:06:43.515895 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.515665    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 19:06:43.515895 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.515705    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bfqsl\""
Jul 27 19:06:43.516189 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.515937    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 19:06:43.516189 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.515941    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 19:06:43.516189 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.515985    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 19:06:43.516189 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.516002    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 19:06:43.516352 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.516338    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 19:06:43.516697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.516525    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 19:06:43.531315 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.531291    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:06:43.586641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.586830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.586830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586680    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-config-volume\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.586830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586706    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.586830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.587064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-web-config\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.587064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.587064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59q64\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-kube-api-access-59q64\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.587064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.586986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.587064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.587017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.587064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.587048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-config-out\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.587302 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.587076    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.587302 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.587145    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688423 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688383    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688431    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688458    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688492    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-config-volume\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688603    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-web-config\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59q64\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-kube-api-access-59q64\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688757    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-config-out\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.688936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.688783    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.689194 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:43.688950    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle podName:83db4a96-d46c-4880-9af0-6c5cadda8856 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:44.188925201 +0000 UTC m=+90.896064675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856") : configmap references non-existent config key: ca-bundle.crt
Jul 27 19:06:43.693400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.692225    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.693400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.692641    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.697637 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.695612    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.703551 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.703470    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.703551 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.703501    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.703762 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.703600    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-web-config\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.704508 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.704482    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.705217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.705166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-tls-assets\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.705217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.705207    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-config-out\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.705451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.705414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.705791 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.705775    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59q64\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-kube-api-access-59q64\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:43.707508 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:43.707481    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-config-volume\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:44.194294 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:44.194258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:44.195342 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:44.195307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:44.426520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:44.426482    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:06:45.421577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.421543    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"]
Jul 27 19:06:45.512119 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.512087    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"]
Jul 27 19:06:45.512293 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.512189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.515619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.515314    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 19:06:45.515619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.515395    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9sksrvmqbs4dd\""
Jul 27 19:06:45.515619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.515440    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 19:06:45.515619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.515445    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 19:06:45.515619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.515450    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 19:06:45.515619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.515521    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-46hlb\""
Jul 27 19:06:45.515619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.515395    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 19:06:45.605925 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.605885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-grpc-tls\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.606105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.605946    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.606105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.605996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.606105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.606016    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.606105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.606032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.606297 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.606128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-metrics-client-ca\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.606297 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.606190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-tls\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.606297 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.606254    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg5pf\" (UniqueName: \"kubernetes.io/projected/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-kube-api-access-dg5pf\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.706698 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.706665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.706920 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.706710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.706920 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.706738    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.706920 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.706859    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-metrics-client-ca\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.707124 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.707038    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-tls\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.707124 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.707083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg5pf\" (UniqueName: \"kubernetes.io/projected/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-kube-api-access-dg5pf\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.707228 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.707132    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-grpc-tls\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.707228 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.707178    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.707754 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.707729    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-metrics-client-ca\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.710499 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.710475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.710615 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.710547    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.710615 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.710553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-grpc-tls\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.710615 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.710564    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-tls\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.710878 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.710862    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.710963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.710946    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.719793 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.719772    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg5pf\" (UniqueName: \"kubernetes.io/projected/346c1b1c-f058-4ae1-9d29-5e3d5f4cf456-kube-api-access-dg5pf\") pod \"thanos-querier-5f85cbfccd-rnhvz\" (UID: \"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456\") " pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:45.823129 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:45.823093    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:47.218184 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.218138    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"]
Jul 27 19:06:47.255925 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.255899    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"]
Jul 27 19:06:47.256116 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.256015    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:47.258723 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.258542    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 19:06:47.258904 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.258722    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wwdnp\""
Jul 27 19:06:47.321393 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.321354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5z6k\" (UniqueName: \"kubernetes.io/projected/953fa1b0-2c22-4be9-9f83-720d368a9ecc-kube-api-access-f5z6k\") pod \"monitoring-plugin-68b7fc9574-nl9d7\" (UID: \"953fa1b0-2c22-4be9-9f83-720d368a9ecc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:47.321670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.321450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953fa1b0-2c22-4be9-9f83-720d368a9ecc-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-nl9d7\" (UID: \"953fa1b0-2c22-4be9-9f83-720d368a9ecc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:47.422234 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.422190    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953fa1b0-2c22-4be9-9f83-720d368a9ecc-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-nl9d7\" (UID: \"953fa1b0-2c22-4be9-9f83-720d368a9ecc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:47.422428 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.422283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5z6k\" (UniqueName: \"kubernetes.io/projected/953fa1b0-2c22-4be9-9f83-720d368a9ecc-kube-api-access-f5z6k\") pod \"monitoring-plugin-68b7fc9574-nl9d7\" (UID: \"953fa1b0-2c22-4be9-9f83-720d368a9ecc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:47.422428 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:47.422364    2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 19:06:47.422545 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:06:47.422444    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953fa1b0-2c22-4be9-9f83-720d368a9ecc-monitoring-plugin-cert podName:953fa1b0-2c22-4be9-9f83-720d368a9ecc nodeName:}" failed. No retries permitted until 2026-07-27 19:06:47.922422931 +0000 UTC m=+94.629562404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/953fa1b0-2c22-4be9-9f83-720d368a9ecc-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-nl9d7" (UID: "953fa1b0-2c22-4be9-9f83-720d368a9ecc") : secret "monitoring-plugin-cert" not found
Jul 27 19:06:47.432353 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.432324    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5z6k\" (UniqueName: \"kubernetes.io/projected/953fa1b0-2c22-4be9-9f83-720d368a9ecc-kube-api-access-f5z6k\") pod \"monitoring-plugin-68b7fc9574-nl9d7\" (UID: \"953fa1b0-2c22-4be9-9f83-720d368a9ecc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:47.534895 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:47.534868    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b48837_9920_402a_9b89_aa5d439d75cd.slice/crio-bcc2b884021a2785869ce65308dd335603a85e8100387bca6fb8b9a405ca4474 WatchSource:0}: Error finding container bcc2b884021a2785869ce65308dd335603a85e8100387bca6fb8b9a405ca4474: Status 404 returned error can't find the container with id bcc2b884021a2785869ce65308dd335603a85e8100387bca6fb8b9a405ca4474
Jul 27 19:06:47.687267 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.687242    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"]
Jul 27 19:06:47.706583 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.706561    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:06:47.749242 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:47.749212    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346c1b1c_f058_4ae1_9d29_5e3d5f4cf456.slice/crio-49f601c5ced347b95faec60ea204df5ad109656f7a2325fb612f050bb45a65ed WatchSource:0}: Error finding container 49f601c5ced347b95faec60ea204df5ad109656f7a2325fb612f050bb45a65ed: Status 404 returned error can't find the container with id 49f601c5ced347b95faec60ea204df5ad109656f7a2325fb612f050bb45a65ed
Jul 27 19:06:47.749992 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:47.749963    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83db4a96_d46c_4880_9af0_6c5cadda8856.slice/crio-86e1507c3a78bb4cba9d1761add9f6dbcc152527167fc3333bc6198d8d65d410 WatchSource:0}: Error finding container 86e1507c3a78bb4cba9d1761add9f6dbcc152527167fc3333bc6198d8d65d410: Status 404 returned error can't find the container with id 86e1507c3a78bb4cba9d1761add9f6dbcc152527167fc3333bc6198d8d65d410
Jul 27 19:06:47.925105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.925082    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953fa1b0-2c22-4be9-9f83-720d368a9ecc-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-nl9d7\" (UID: \"953fa1b0-2c22-4be9-9f83-720d368a9ecc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:47.927330 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:47.927300    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/953fa1b0-2c22-4be9-9f83-720d368a9ecc-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-nl9d7\" (UID: \"953fa1b0-2c22-4be9-9f83-720d368a9ecc\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:48.167480 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.167403    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:48.317078 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.316958    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"]
Jul 27 19:06:48.341064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.341020    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz" event={"ID":"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456","Type":"ContainerStarted","Data":"49f601c5ced347b95faec60ea204df5ad109656f7a2325fb612f050bb45a65ed"}
Jul 27 19:06:48.342471 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.342444    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-nzcpj" event={"ID":"4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d","Type":"ContainerStarted","Data":"e93a70a199dbbc90cf25533027578049176d7644efb3d0e37f35ecfdb8ce6573"}
Jul 27 19:06:48.342790 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.342721    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-nzcpj"
Jul 27 19:06:48.349783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.349404    2557 patch_prober.go:28] interesting pod/downloads-7c97dc4555-nzcpj container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" start-of-body=
Jul 27 19:06:48.349783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.349465    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-nzcpj" podUID="4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused"
Jul 27 19:06:48.351088 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.351062    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerStarted","Data":"86e1507c3a78bb4cba9d1761add9f6dbcc152527167fc3333bc6198d8d65d410"}
Jul 27 19:06:48.352713 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.352688    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znk94" event={"ID":"52b48837-9920-402a-9b89-aa5d439d75cd","Type":"ContainerStarted","Data":"bcc2b884021a2785869ce65308dd335603a85e8100387bca6fb8b9a405ca4474"}
Jul 27 19:06:48.363067 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:48.362820    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-nzcpj" podStartSLOduration=8.941653184 podStartE2EDuration="27.362789985s" totalImagesPullingTime="18.421136801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:48.360842972 +0000 UTC m=+95.067982462" watchObservedRunningTime="2026-07-27 19:06:48.362789985 +0000 UTC m=+95.069929541"
Jul 27 19:06:48.692875 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:48.692830    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953fa1b0_2c22_4be9_9f83_720d368a9ecc.slice/crio-14137e851574a1c49167a96213a0e3d96a8699226eacc3a48350b15c62751e11 WatchSource:0}: Error finding container 14137e851574a1c49167a96213a0e3d96a8699226eacc3a48350b15c62751e11: Status 404 returned error can't find the container with id 14137e851574a1c49167a96213a0e3d96a8699226eacc3a48350b15c62751e11
Jul 27 19:06:49.360636 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:49.360596    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7" event={"ID":"953fa1b0-2c22-4be9-9f83-720d368a9ecc","Type":"ContainerStarted","Data":"14137e851574a1c49167a96213a0e3d96a8699226eacc3a48350b15c62751e11"}
Jul 27 19:06:49.362973 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:49.362932    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znk94" event={"ID":"52b48837-9920-402a-9b89-aa5d439d75cd","Type":"ContainerStarted","Data":"c9baed0affe0aa1bfde548dff11ace3ad93a782e55344bc249e3cca07e1b81f8"}
Jul 27 19:06:49.373252 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:49.373218    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-nzcpj"
Jul 27 19:06:50.371128 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:50.371083    2557 generic.go:356] "Generic (PLEG): container finished" podID="52b48837-9920-402a-9b89-aa5d439d75cd" containerID="c9baed0affe0aa1bfde548dff11ace3ad93a782e55344bc249e3cca07e1b81f8" exitCode=0
Jul 27 19:06:50.371615 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:50.371178    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znk94" event={"ID":"52b48837-9920-402a-9b89-aa5d439d75cd","Type":"ContainerDied","Data":"c9baed0affe0aa1bfde548dff11ace3ad93a782e55344bc249e3cca07e1b81f8"}
Jul 27 19:06:52.382565 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.382471    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7" event={"ID":"953fa1b0-2c22-4be9-9f83-720d368a9ecc","Type":"ContainerStarted","Data":"4884089cb5012d2fb7d34dbcf094a0f39b27f10e7a687c95e5af5e7fafa11989"}
Jul 27 19:06:52.383028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.382710    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:52.384358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.384327    2557 generic.go:356] "Generic (PLEG): container finished" podID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerID="52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805" exitCode=0
Jul 27 19:06:52.384506 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.384479    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerDied","Data":"52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805"}
Jul 27 19:06:52.388227 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.388190    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znk94" event={"ID":"52b48837-9920-402a-9b89-aa5d439d75cd","Type":"ContainerStarted","Data":"fc9370178133206c678b34d8fee6606a7b1e098205b61577fb165f4d50ef5f63"}
Jul 27 19:06:52.388304 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.388267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znk94" event={"ID":"52b48837-9920-402a-9b89-aa5d439d75cd","Type":"ContainerStarted","Data":"965f68c3d5a036502442a631bff93dcecd6fc91aeafc13f4e049144ceb372b19"}
Jul 27 19:06:52.389902 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.389879    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7"
Jul 27 19:06:52.391338 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.391311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz" event={"ID":"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456","Type":"ContainerStarted","Data":"c7a80dad53defa1f17ba39e0d2d10a3c8f31233462bf6d5bd0c60b32af1ff63b"}
Jul 27 19:06:52.391455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.391374    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz" event={"ID":"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456","Type":"ContainerStarted","Data":"e53098e9a786fbc32756fd0ae864f66af35526391a34aa58e0a9a795e7ee86aa"}
Jul 27 19:06:52.391455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.391404    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz" event={"ID":"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456","Type":"ContainerStarted","Data":"df2fcfa16c63b36db434631cd4aebf2ba9bd4dad9ede5e6af25b533b954a8649"}
Jul 27 19:06:52.398555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.398512    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-nl9d7" podStartSLOduration=2.387225426 podStartE2EDuration="5.398499552s" totalImagesPullingTime="3.011274126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:52.397689025 +0000 UTC m=+99.104828517" watchObservedRunningTime="2026-07-27 19:06:52.398499552 +0000 UTC m=+99.105639092"
Jul 27 19:06:52.417712 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.417653    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-znk94" podStartSLOduration=8.818854267 podStartE2EDuration="10.41763678s" totalImagesPullingTime="1.480366454s" totalInitContainerRuntime="118.416059ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:52.416080441 +0000 UTC m=+99.123219949" watchObservedRunningTime="2026-07-27 19:06:52.41763678 +0000 UTC m=+99.124776271"
Jul 27 19:06:52.518159 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.518122    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8987d665-9jxtm"]
Jul 27 19:06:52.537827 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.537775    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8987d665-9jxtm"]
Jul 27 19:06:52.537992 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.537920    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.540926 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.540902    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 19:06:52.541081 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.541058    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 19:06:52.541155 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.541121    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m8xt6\""
Jul 27 19:06:52.541335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.541292    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 19:06:52.541510 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.541484    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 19:06:52.542491 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.542463    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 19:06:52.547542 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.547521    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 19:06:52.674728 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.674652    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-serving-cert\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.674728 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.674686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-service-ca\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.674728 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.674714    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-oauth-serving-cert\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.675029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.674741    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khp49\" (UniqueName: \"kubernetes.io/projected/706609d5-d59f-4bbb-a5bb-4f1b956faaca-kube-api-access-khp49\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.675029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.674842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-trusted-ca-bundle\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.675029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.674888    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-oauth-config\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.675029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.674913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-config\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.776190 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.776153    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-serving-cert\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.776375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.776197    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-service-ca\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.776375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.776220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-oauth-serving-cert\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.776375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.776244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp49\" (UniqueName: \"kubernetes.io/projected/706609d5-d59f-4bbb-a5bb-4f1b956faaca-kube-api-access-khp49\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.776375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.776289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-trusted-ca-bundle\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.776375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.776329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-oauth-config\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.776375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.776351    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-config\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.777772 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.776971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-service-ca\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.777772 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.777103    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-config\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.777772 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.777702    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-oauth-serving-cert\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.778018 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.777952    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-trusted-ca-bundle\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.779763 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.779739    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-serving-cert\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.779939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.779920    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-oauth-config\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.785994 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.785971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khp49\" (UniqueName: \"kubernetes.io/projected/706609d5-d59f-4bbb-a5bb-4f1b956faaca-kube-api-access-khp49\") pod \"console-7d8987d665-9jxtm\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") " pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:52.850973 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:52.850928    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:06:53.040493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:53.040143    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8987d665-9jxtm"]
Jul 27 19:06:53.042793 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:06:53.042760    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706609d5_d59f_4bbb_a5bb_4f1b956faaca.slice/crio-9d40a0dad4bb0e0a8a4b4be7c770a21bb0b39b207129c96649fc30eb48486a92 WatchSource:0}: Error finding container 9d40a0dad4bb0e0a8a4b4be7c770a21bb0b39b207129c96649fc30eb48486a92: Status 404 returned error can't find the container with id 9d40a0dad4bb0e0a8a4b4be7c770a21bb0b39b207129c96649fc30eb48486a92
Jul 27 19:06:53.204955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:53.204922    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cxp86"
Jul 27 19:06:53.401211 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:53.401110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8987d665-9jxtm" event={"ID":"706609d5-d59f-4bbb-a5bb-4f1b956faaca","Type":"ContainerStarted","Data":"9d40a0dad4bb0e0a8a4b4be7c770a21bb0b39b207129c96649fc30eb48486a92"}
Jul 27 19:06:55.415132 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.415071    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerStarted","Data":"d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081"}
Jul 27 19:06:55.415555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.415208    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerStarted","Data":"c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22"}
Jul 27 19:06:55.415555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.415253    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerStarted","Data":"4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6"}
Jul 27 19:06:55.415555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.415294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerStarted","Data":"878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac"}
Jul 27 19:06:55.420621 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.419552    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz" event={"ID":"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456","Type":"ContainerStarted","Data":"d52275b7a7a8a5fce84e81571424e87e8b643f5b63e9bacad6789a6a5d0a7781"}
Jul 27 19:06:55.420746 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.420669    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz" event={"ID":"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456","Type":"ContainerStarted","Data":"873dbbcf542fa2430a9283dde293af8c49c469c23670672e5fc70890438d0efa"}
Jul 27 19:06:55.420746 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.420710    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:06:55.420746 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.420742    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz" event={"ID":"346c1b1c-f058-4ae1-9d29-5e3d5f4cf456","Type":"ContainerStarted","Data":"751a965142fce7108a492392ed4279f4bfcff0b8437767a35cd92b254e290fe3"}
Jul 27 19:06:55.458405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:55.458315    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz" podStartSLOduration=4.244529238 podStartE2EDuration="10.458297173s" totalImagesPullingTime="6.213767935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:55.458038489 +0000 UTC m=+102.165177981" watchObservedRunningTime="2026-07-27 19:06:55.458297173 +0000 UTC m=+102.165436664"
Jul 27 19:06:57.432737 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:57.432695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerStarted","Data":"6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50"}
Jul 27 19:06:57.433224 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:57.432784    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerStarted","Data":"4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c"}
Jul 27 19:06:57.434293 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:57.434266    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8987d665-9jxtm" event={"ID":"706609d5-d59f-4bbb-a5bb-4f1b956faaca","Type":"ContainerStarted","Data":"ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0"}
Jul 27 19:06:57.463529 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:57.463489    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.10698065 podStartE2EDuration="14.463474591s" totalImagesPullingTime="6.319162238s" totalInitContainerRuntime="37.331703ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:57.461320419 +0000 UTC m=+104.168459910" watchObservedRunningTime="2026-07-27 19:06:57.463474591 +0000 UTC m=+104.170614082"
Jul 27 19:06:57.480820 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:06:57.480760    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8987d665-9jxtm" podStartSLOduration=1.274697221 podStartE2EDuration="5.480745593s" totalImagesPullingTime="4.206048372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:57.479629348 +0000 UTC m=+104.186768842" watchObservedRunningTime="2026-07-27 19:06:57.480745593 +0000 UTC m=+104.187885083"
Jul 27 19:07:01.431149 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:01.431122    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f85cbfccd-rnhvz"
Jul 27 19:07:02.851498 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:02.851463    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:07:02.851995 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:02.851528    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:07:02.856323 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:02.856303    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:07:03.472431 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:03.472406    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:07:07.657103 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:07.657063    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d" podUID="777fdac3-a4f7-4b41-b196-80d987abe37e" containerName="registry" containerID="cri-o://0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576" gracePeriod=30
Jul 27 19:07:07.946889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:07.946863    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:07:08.024956 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.024926    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") pod \"777fdac3-a4f7-4b41-b196-80d987abe37e\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") "
Jul 27 19:07:08.025088 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.024967    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-bound-sa-token\") pod \"777fdac3-a4f7-4b41-b196-80d987abe37e\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") "
Jul 27 19:07:08.025088 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.025021    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dncd\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-kube-api-access-6dncd\") pod \"777fdac3-a4f7-4b41-b196-80d987abe37e\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") "
Jul 27 19:07:08.025088 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.025044    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-image-registry-private-configuration\") pod \"777fdac3-a4f7-4b41-b196-80d987abe37e\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") "
Jul 27 19:07:08.025278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.025178    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-certificates\") pod \"777fdac3-a4f7-4b41-b196-80d987abe37e\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") "
Jul 27 19:07:08.025278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.025217    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777fdac3-a4f7-4b41-b196-80d987abe37e-ca-trust-extracted\") pod \"777fdac3-a4f7-4b41-b196-80d987abe37e\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") "
Jul 27 19:07:08.025278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.025244    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-trusted-ca\") pod \"777fdac3-a4f7-4b41-b196-80d987abe37e\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") "
Jul 27 19:07:08.025429 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.025280    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-installation-pull-secrets\") pod \"777fdac3-a4f7-4b41-b196-80d987abe37e\" (UID: \"777fdac3-a4f7-4b41-b196-80d987abe37e\") "
Jul 27 19:07:08.026059 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.026004    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "777fdac3-a4f7-4b41-b196-80d987abe37e" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:08.026198 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.026106    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "777fdac3-a4f7-4b41-b196-80d987abe37e" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:08.027722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.027691    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "777fdac3-a4f7-4b41-b196-80d987abe37e" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:07:08.027994 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.027861    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "777fdac3-a4f7-4b41-b196-80d987abe37e" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:07:08.027994 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.027884    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-kube-api-access-6dncd" (OuterVolumeSpecName: "kube-api-access-6dncd") pod "777fdac3-a4f7-4b41-b196-80d987abe37e" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e"). InnerVolumeSpecName "kube-api-access-6dncd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:07:08.028112 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.028011    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "777fdac3-a4f7-4b41-b196-80d987abe37e" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:07:08.028170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.028141    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "777fdac3-a4f7-4b41-b196-80d987abe37e" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:07:08.033986 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.033958    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777fdac3-a4f7-4b41-b196-80d987abe37e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "777fdac3-a4f7-4b41-b196-80d987abe37e" (UID: "777fdac3-a4f7-4b41-b196-80d987abe37e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:07:08.126370 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.126345    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-installation-pull-secrets\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:07:08.126370 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.126367    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-tls\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:07:08.126370 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.126376    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-bound-sa-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:07:08.126532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.126384    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dncd\" (UniqueName: \"kubernetes.io/projected/777fdac3-a4f7-4b41-b196-80d987abe37e-kube-api-access-6dncd\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:07:08.126532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.126394    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/777fdac3-a4f7-4b41-b196-80d987abe37e-image-registry-private-configuration\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:07:08.126532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.126403    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-registry-certificates\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:07:08.126532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.126410    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/777fdac3-a4f7-4b41-b196-80d987abe37e-ca-trust-extracted\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:07:08.126532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.126419    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/777fdac3-a4f7-4b41-b196-80d987abe37e-trusted-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:07:08.489532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.489498    2557 generic.go:356] "Generic (PLEG): container finished" podID="777fdac3-a4f7-4b41-b196-80d987abe37e" containerID="0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576" exitCode=0
Jul 27 19:07:08.489712 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.489546    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d"
Jul 27 19:07:08.489712 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.489547    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d" event={"ID":"777fdac3-a4f7-4b41-b196-80d987abe37e","Type":"ContainerDied","Data":"0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576"}
Jul 27 19:07:08.489712 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.489596    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fdf799f5-mhh4d" event={"ID":"777fdac3-a4f7-4b41-b196-80d987abe37e","Type":"ContainerDied","Data":"fad7e651cc397f3c38c347c2f49af3aeaf2c5c48abff50d4a9266762bda67ab9"}
Jul 27 19:07:08.489712 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.489624    2557 scope.go:117] "RemoveContainer" containerID="0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576"
Jul 27 19:07:08.498263 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.498246    2557 scope.go:117] "RemoveContainer" containerID="0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576"
Jul 27 19:07:08.498537 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:07:08.498517    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576\": container with ID starting with 0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576 not found: ID does not exist" containerID="0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576"
Jul 27 19:07:08.498586 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.498546    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576"} err="failed to get container status \"0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576\": rpc error: code = NotFound desc = could not find container \"0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576\": container with ID starting with 0fd128f431c1a5b2c61749544ff731b7797399e5469bec88b899087ff8ae1576 not found: ID does not exist"
Jul 27 19:07:08.511675 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.511649    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76fdf799f5-mhh4d"]
Jul 27 19:07:08.516939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:08.516917    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76fdf799f5-mhh4d"]
Jul 27 19:07:09.789683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:09.789648    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777fdac3-a4f7-4b41-b196-80d987abe37e" path="/var/lib/kubelet/pods/777fdac3-a4f7-4b41-b196-80d987abe37e/volumes"
Jul 27 19:07:14.516250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:14.516220    2557 generic.go:356] "Generic (PLEG): container finished" podID="dc0e5d7c-561f-476b-beb9-ab84d87b23fb" containerID="181fb74f90b695ec81b3bdee86a3030077195dfb4178621dcad043fb5dbda4e1" exitCode=0
Jul 27 19:07:14.516656 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:14.516301    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h49xz" event={"ID":"dc0e5d7c-561f-476b-beb9-ab84d87b23fb","Type":"ContainerDied","Data":"181fb74f90b695ec81b3bdee86a3030077195dfb4178621dcad043fb5dbda4e1"}
Jul 27 19:07:14.516656 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:14.516643    2557 scope.go:117] "RemoveContainer" containerID="181fb74f90b695ec81b3bdee86a3030077195dfb4178621dcad043fb5dbda4e1"
Jul 27 19:07:15.522134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:15.522099    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h49xz" event={"ID":"dc0e5d7c-561f-476b-beb9-ab84d87b23fb","Type":"ContainerStarted","Data":"1da95589337afd6e0d61fc87c2e9a95fab53492501029cf6dae46d38f4125c66"}
Jul 27 19:07:29.578892 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:29.578859    2557 generic.go:356] "Generic (PLEG): container finished" podID="d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a" containerID="b127d3be25356f0118205c71f097548f9d541aa071d76cece21bc8fb5cf02ca1" exitCode=0
Jul 27 19:07:29.579368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:29.578939    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5" event={"ID":"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a","Type":"ContainerDied","Data":"b127d3be25356f0118205c71f097548f9d541aa071d76cece21bc8fb5cf02ca1"}
Jul 27 19:07:29.579368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:29.579322    2557 scope.go:117] "RemoveContainer" containerID="b127d3be25356f0118205c71f097548f9d541aa071d76cece21bc8fb5cf02ca1"
Jul 27 19:07:29.580456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:29.580435    2557 generic.go:356] "Generic (PLEG): container finished" podID="08f814de-dd10-44fb-b49f-a95abfbadb2a" containerID="a50fc1a349118a1531029c5990cb7809cc6536d908b005c32d5a179fc1fb808b" exitCode=0
Jul 27 19:07:29.580522 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:29.580473    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7" event={"ID":"08f814de-dd10-44fb-b49f-a95abfbadb2a","Type":"ContainerDied","Data":"a50fc1a349118a1531029c5990cb7809cc6536d908b005c32d5a179fc1fb808b"}
Jul 27 19:07:29.580740 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:29.580727    2557 scope.go:117] "RemoveContainer" containerID="a50fc1a349118a1531029c5990cb7809cc6536d908b005c32d5a179fc1fb808b"
Jul 27 19:07:30.586224 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:30.586186    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5" event={"ID":"d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a","Type":"ContainerStarted","Data":"e9d884cec67631572b3b3fbcdced94f073f4f1b19b95233c20e92ea31723f685"}
Jul 27 19:07:30.587728 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:07:30.587702    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8lnc7" event={"ID":"08f814de-dd10-44fb-b49f-a95abfbadb2a","Type":"ContainerStarted","Data":"9b2bc8be58e14855ec8afad835cf0769dec93909f405073cc9c962cf1492bc12"}
Jul 27 19:08:02.872568 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:02.872528    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:08:02.873134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:02.872931    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="alertmanager" containerID="cri-o://878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac" gracePeriod=120
Jul 27 19:08:02.873134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:02.872962    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy-metric" containerID="cri-o://4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c" gracePeriod=120
Jul 27 19:08:02.873134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:02.873003    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="prom-label-proxy" containerID="cri-o://6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50" gracePeriod=120
Jul 27 19:08:02.873134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:02.873019    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy-web" containerID="cri-o://c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22" gracePeriod=120
Jul 27 19:08:02.873134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:02.873036    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy" containerID="cri-o://d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081" gracePeriod=120
Jul 27 19:08:02.873134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:02.873059    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="config-reloader" containerID="cri-o://4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6" gracePeriod=120
Jul 27 19:08:03.723265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723235    2557 generic.go:356] "Generic (PLEG): container finished" podID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerID="6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50" exitCode=0
Jul 27 19:08:03.723265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723259    2557 generic.go:356] "Generic (PLEG): container finished" podID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerID="4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c" exitCode=0
Jul 27 19:08:03.723265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723265    2557 generic.go:356] "Generic (PLEG): container finished" podID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerID="d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081" exitCode=0
Jul 27 19:08:03.723265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723271    2557 generic.go:356] "Generic (PLEG): container finished" podID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerID="4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6" exitCode=0
Jul 27 19:08:03.723265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723277    2557 generic.go:356] "Generic (PLEG): container finished" podID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerID="878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac" exitCode=0
Jul 27 19:08:03.723549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerDied","Data":"6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50"}
Jul 27 19:08:03.723549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723374    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerDied","Data":"4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c"}
Jul 27 19:08:03.723549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723399    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerDied","Data":"d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081"}
Jul 27 19:08:03.723549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723425    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerDied","Data":"4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6"}
Jul 27 19:08:03.723549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:03.723448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerDied","Data":"878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac"}
Jul 27 19:08:04.120213 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.120189    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.193589 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193562    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-main-db\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.193781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193596    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-config-volume\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.193781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193631    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.193781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193658    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-tls-assets\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.193781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193730    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.193781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193763    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-metric\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.194159 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193802    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-main-tls\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.194159 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193840    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59q64\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-kube-api-access-59q64\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.194159 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193881    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-web-config\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.194159 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193898    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:08:04.194159 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.193934    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-config-out\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.194408 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.194173    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:04.194578 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.194556    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-cluster-tls-config\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.194669 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.194613    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-metrics-client-ca\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.194669 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.194648    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-web\") pod \"83db4a96-d46c-4880-9af0-6c5cadda8856\" (UID: \"83db4a96-d46c-4880-9af0-6c5cadda8856\") "
Jul 27 19:08:04.195245 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.195113    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-main-db\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.195245 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.195133    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.195840 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.195788    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:04.198196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.198153    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-config-volume" (OuterVolumeSpecName: "config-volume") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:04.198196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.198159    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:08:04.198343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.198209    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:04.198343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.198229    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:04.198629 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.198602    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-kube-api-access-59q64" (OuterVolumeSpecName: "kube-api-access-59q64") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "kube-api-access-59q64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:08:04.198753 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.198729    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:04.198921 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.198891    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-config-out" (OuterVolumeSpecName: "config-out") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:08:04.199134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.199111    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:04.202404 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.202384    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:04.209540 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.209513    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-web-config" (OuterVolumeSpecName: "web-config") pod "83db4a96-d46c-4880-9af0-6c5cadda8856" (UID: "83db4a96-d46c-4880-9af0-6c5cadda8856"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:04.295954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295866    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.295954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295896    2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-tls-assets\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.295954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295906    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.295954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295917    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-main-tls\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.295954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295926    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59q64\" (UniqueName: \"kubernetes.io/projected/83db4a96-d46c-4880-9af0-6c5cadda8856-kube-api-access-59q64\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.295954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295935    2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-web-config\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.295954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295942    2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83db4a96-d46c-4880-9af0-6c5cadda8856-config-out\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.295954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295960    2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-cluster-tls-config\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.296301 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295969    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83db4a96-d46c-4880-9af0-6c5cadda8856-metrics-client-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.296301 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295978    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.296301 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.295987    2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/83db4a96-d46c-4880-9af0-6c5cadda8856-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:04.730593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.730560    2557 generic.go:356] "Generic (PLEG): container finished" podID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerID="c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22" exitCode=0
Jul 27 19:08:04.730749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.730632    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.730749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.730639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerDied","Data":"c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22"}
Jul 27 19:08:04.730749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.730709    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"83db4a96-d46c-4880-9af0-6c5cadda8856","Type":"ContainerDied","Data":"86e1507c3a78bb4cba9d1761add9f6dbcc152527167fc3333bc6198d8d65d410"}
Jul 27 19:08:04.730749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.730741    2557 scope.go:117] "RemoveContainer" containerID="6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50"
Jul 27 19:08:04.740533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.740405    2557 scope.go:117] "RemoveContainer" containerID="4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c"
Jul 27 19:08:04.750362 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.750341    2557 scope.go:117] "RemoveContainer" containerID="d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081"
Jul 27 19:08:04.757668 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.757650    2557 scope.go:117] "RemoveContainer" containerID="c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22"
Jul 27 19:08:04.760617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.760598    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:08:04.766431 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.766407    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:08:04.767341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.767318    2557 scope.go:117] "RemoveContainer" containerID="4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6"
Jul 27 19:08:04.774859 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.774842    2557 scope.go:117] "RemoveContainer" containerID="878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac"
Jul 27 19:08:04.782006 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.781980    2557 scope.go:117] "RemoveContainer" containerID="52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805"
Jul 27 19:08:04.789076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.789062    2557 scope.go:117] "RemoveContainer" containerID="6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50"
Jul 27 19:08:04.789333 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:08:04.789314    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50\": container with ID starting with 6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50 not found: ID does not exist" containerID="6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50"
Jul 27 19:08:04.789416 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.789346    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50"} err="failed to get container status \"6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50\": rpc error: code = NotFound desc = could not find container \"6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50\": container with ID starting with 6c03ceb165205cf9f12f3f51da603d9377b731fe28f01c2013ee0a10d0874b50 not found: ID does not exist"
Jul 27 19:08:04.789416 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.789371    2557 scope.go:117] "RemoveContainer" containerID="4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c"
Jul 27 19:08:04.789626 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:08:04.789610    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c\": container with ID starting with 4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c not found: ID does not exist" containerID="4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c"
Jul 27 19:08:04.789660 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.789640    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c"} err="failed to get container status \"4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c\": rpc error: code = NotFound desc = could not find container \"4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c\": container with ID starting with 4547ac0389fa1a133d4e21581e37782258f06548f888b006ee9968b65ddbf35c not found: ID does not exist"
Jul 27 19:08:04.789660 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.789655    2557 scope.go:117] "RemoveContainer" containerID="d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081"
Jul 27 19:08:04.789881 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:08:04.789864    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081\": container with ID starting with d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081 not found: ID does not exist" containerID="d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081"
Jul 27 19:08:04.789929 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.789887    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081"} err="failed to get container status \"d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081\": rpc error: code = NotFound desc = could not find container \"d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081\": container with ID starting with d514dcf9cea13af1a3208796b95c8537183548d4e7de63f9d48133a6e7346081 not found: ID does not exist"
Jul 27 19:08:04.789929 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.789901    2557 scope.go:117] "RemoveContainer" containerID="c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22"
Jul 27 19:08:04.790103 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:08:04.790086    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22\": container with ID starting with c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22 not found: ID does not exist" containerID="c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22"
Jul 27 19:08:04.790142 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.790109    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22"} err="failed to get container status \"c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22\": rpc error: code = NotFound desc = could not find container \"c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22\": container with ID starting with c70933de27d143db9f25fe55a9a2d0c1e43a97d641d9e0442352ce032fbd0d22 not found: ID does not exist"
Jul 27 19:08:04.790142 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.790125    2557 scope.go:117] "RemoveContainer" containerID="4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6"
Jul 27 19:08:04.790319 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:08:04.790304    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6\": container with ID starting with 4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6 not found: ID does not exist" containerID="4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6"
Jul 27 19:08:04.790358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.790327    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6"} err="failed to get container status \"4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6\": rpc error: code = NotFound desc = could not find container \"4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6\": container with ID starting with 4ce8102183137d4c14c59abd3633685fe1c4ca63cb91da9998718444eceb6af6 not found: ID does not exist"
Jul 27 19:08:04.790358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.790342    2557 scope.go:117] "RemoveContainer" containerID="878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac"
Jul 27 19:08:04.790562 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:08:04.790546    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac\": container with ID starting with 878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac not found: ID does not exist" containerID="878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac"
Jul 27 19:08:04.790622 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.790571    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac"} err="failed to get container status \"878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac\": rpc error: code = NotFound desc = could not find container \"878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac\": container with ID starting with 878adf662f1bba2cf889bb70c8d671da1f2a03690c19f7e47c7836d74764deac not found: ID does not exist"
Jul 27 19:08:04.790622 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.790592    2557 scope.go:117] "RemoveContainer" containerID="52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805"
Jul 27 19:08:04.790850 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:08:04.790835    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805\": container with ID starting with 52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805 not found: ID does not exist" containerID="52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805"
Jul 27 19:08:04.790892 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.790854    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805"} err="failed to get container status \"52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805\": rpc error: code = NotFound desc = could not find container \"52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805\": container with ID starting with 52a9eca1444f04bea30eaed370705bc5dad317e5dcc79dd4d1a9910330fb7805 not found: ID does not exist"
Jul 27 19:08:04.805976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.805960    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:08:04.806236 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806225    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777fdac3-a4f7-4b41-b196-80d987abe37e" containerName="registry"
Jul 27 19:08:04.806281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806237    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="777fdac3-a4f7-4b41-b196-80d987abe37e" containerName="registry"
Jul 27 19:08:04.806281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806248    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="prom-label-proxy"
Jul 27 19:08:04.806281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806253    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="prom-label-proxy"
Jul 27 19:08:04.806281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806262    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy"
Jul 27 19:08:04.806281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806267    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy"
Jul 27 19:08:04.806281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806274    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="init-config-reloader"
Jul 27 19:08:04.806281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806280    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="init-config-reloader"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806291    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="config-reloader"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806296    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="config-reloader"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806303    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy-metric"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806308    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy-metric"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806315    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="alertmanager"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806320    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="alertmanager"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806326    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy-web"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806331    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy-web"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806395    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="alertmanager"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806402    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="777fdac3-a4f7-4b41-b196-80d987abe37e" containerName="registry"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806408    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy-web"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806413    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806419    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="prom-label-proxy"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806423    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="config-reloader"
Jul 27 19:08:04.806495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.806429    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" containerName="kube-rbac-proxy-metric"
Jul 27 19:08:04.809946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.809932    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.813051 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.813036    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 19:08:04.813289 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.813271    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 19:08:04.814186 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.814172    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bfqsl\""
Jul 27 19:08:04.814278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.814261    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 19:08:04.815192 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.815176    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 19:08:04.815262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.815214    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 19:08:04.815550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.815534    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 19:08:04.815649 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.815566    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 19:08:04.820079 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.820062    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 19:08:04.821722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.821705    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 19:08:04.839729 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.839706    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:08:04.901554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901532    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901686 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901564    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e05c319e-4e24-41fd-8650-58db8e119822-config-out\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901686 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901582    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901686 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05c319e-4e24-41fd-8650-58db8e119822-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901686 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901619    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-config-volume\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901686 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901660    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05c319e-4e24-41fd-8650-58db8e119822-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901752    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e05c319e-4e24-41fd-8650-58db8e119822-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtqjt\" (UniqueName: \"kubernetes.io/projected/e05c319e-4e24-41fd-8650-58db8e119822-kube-api-access-xtqjt\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901857    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-web-config\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e05c319e-4e24-41fd-8650-58db8e119822-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:04.901946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:04.901927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.002941 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.002871    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.002941 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.002907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e05c319e-4e24-41fd-8650-58db8e119822-config-out\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.002941 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.002925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05c319e-4e24-41fd-8650-58db8e119822-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003071    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-config-volume\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05c319e-4e24-41fd-8650-58db8e119822-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003144    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003173    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e05c319e-4e24-41fd-8650-58db8e119822-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003208    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtqjt\" (UniqueName: \"kubernetes.io/projected/e05c319e-4e24-41fd-8650-58db8e119822-kube-api-access-xtqjt\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003250    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-web-config\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e05c319e-4e24-41fd-8650-58db8e119822-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.003605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.003369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.004067 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.004038    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05c319e-4e24-41fd-8650-58db8e119822-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.004384 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.004355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05c319e-4e24-41fd-8650-58db8e119822-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.006320 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.006216    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e05c319e-4e24-41fd-8650-58db8e119822-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.006320 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.006258    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.006320 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.006263    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e05c319e-4e24-41fd-8650-58db8e119822-config-out\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.006900 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.006398    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.006900 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.006578    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e05c319e-4e24-41fd-8650-58db8e119822-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.006900 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.006786    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.006900 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.006848    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-config-volume\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.007083 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.006947    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.007344 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.007320    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.008388 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.008373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e05c319e-4e24-41fd-8650-58db8e119822-web-config\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.017107 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.017084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtqjt\" (UniqueName: \"kubernetes.io/projected/e05c319e-4e24-41fd-8650-58db8e119822-kube-api-access-xtqjt\") pod \"alertmanager-main-0\" (UID: \"e05c319e-4e24-41fd-8650-58db8e119822\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.119389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.119358    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:08:05.273689 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.273663    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:08:05.275655 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:08:05.275629    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05c319e_4e24_41fd_8650_58db8e119822.slice/crio-97b3bbaa07de5317e9aa9be3b0ed6d57f6ea11301fcb6f6182f57e4db14346f3 WatchSource:0}: Error finding container 97b3bbaa07de5317e9aa9be3b0ed6d57f6ea11301fcb6f6182f57e4db14346f3: Status 404 returned error can't find the container with id 97b3bbaa07de5317e9aa9be3b0ed6d57f6ea11301fcb6f6182f57e4db14346f3
Jul 27 19:08:05.736887 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.736857    2557 generic.go:356] "Generic (PLEG): container finished" podID="e05c319e-4e24-41fd-8650-58db8e119822" containerID="09b86e71c48307c43d7358ecb640aa80297198118fcd2b026ac7d9c4868f2db1" exitCode=0
Jul 27 19:08:05.737044 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.736927    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e05c319e-4e24-41fd-8650-58db8e119822","Type":"ContainerDied","Data":"09b86e71c48307c43d7358ecb640aa80297198118fcd2b026ac7d9c4868f2db1"}
Jul 27 19:08:05.737044 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.736985    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e05c319e-4e24-41fd-8650-58db8e119822","Type":"ContainerStarted","Data":"97b3bbaa07de5317e9aa9be3b0ed6d57f6ea11301fcb6f6182f57e4db14346f3"}
Jul 27 19:08:05.788802 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:05.788778    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83db4a96-d46c-4880-9af0-6c5cadda8856" path="/var/lib/kubelet/pods/83db4a96-d46c-4880-9af0-6c5cadda8856/volumes"
Jul 27 19:08:06.743952 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:06.743919    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e05c319e-4e24-41fd-8650-58db8e119822","Type":"ContainerStarted","Data":"6e2ac07965a00b4a571bd00100ee24acb1c7bf2075f20496af950f361d2a902b"}
Jul 27 19:08:06.744314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:06.744002    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e05c319e-4e24-41fd-8650-58db8e119822","Type":"ContainerStarted","Data":"898279d08a731a9f2b6b47a71ca01f8bd27a9e1649aef8d9d0b400e50155b8ab"}
Jul 27 19:08:06.744314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:06.744032    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e05c319e-4e24-41fd-8650-58db8e119822","Type":"ContainerStarted","Data":"e39a358b7a196d0f237563d32b97dad7e7cfe59d2e894c062214c2530246da66"}
Jul 27 19:08:06.744314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:06.744063    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e05c319e-4e24-41fd-8650-58db8e119822","Type":"ContainerStarted","Data":"f23d89ad61cd3358d20eb943c9504914ddc4cac5190e3ab9ea1bb560c632b96e"}
Jul 27 19:08:06.744314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:06.744107    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e05c319e-4e24-41fd-8650-58db8e119822","Type":"ContainerStarted","Data":"0955e845a1f675c711b079565e16ee2eea5d66a5ad630116bdf8e2765154d994"}
Jul 27 19:08:06.744314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:06.744137    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e05c319e-4e24-41fd-8650-58db8e119822","Type":"ContainerStarted","Data":"72184507cc13e24a34d1e9a8134acf8d6f90132c7eee34acb465fd2e1ae9d779"}
Jul 27 19:08:18.215967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.215904    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=14.200020741 podStartE2EDuration="14.215870609s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.849868ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:08:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:08:06.802896583 +0000 UTC m=+173.510036074" watchObservedRunningTime="2026-07-27 19:08:18.215870609 +0000 UTC m=+184.923010101"
Jul 27 19:08:18.218098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.218073    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665d6b7f88-rv42t"]
Jul 27 19:08:18.221441 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.221422    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.231784 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.231759    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665d6b7f88-rv42t"]
Jul 27 19:08:18.309343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.309312    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-service-ca\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.309343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.309346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4hrn\" (UniqueName: \"kubernetes.io/projected/3382ec05-0014-4dc6-9905-da2688909e8a-kube-api-access-v4hrn\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.309513 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.309364    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-trusted-ca-bundle\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.309513 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.309428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-serving-cert\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.309513 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.309456    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-oauth-serving-cert\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.309603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.309529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-console-config\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.309603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.309553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-oauth-config\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.410164 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-console-config\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.410331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410172    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-oauth-config\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.410331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-service-ca\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.410331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4hrn\" (UniqueName: \"kubernetes.io/projected/3382ec05-0014-4dc6-9905-da2688909e8a-kube-api-access-v4hrn\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.410331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-trusted-ca-bundle\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.410331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410278    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-serving-cert\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.410331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-oauth-serving-cert\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.411028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-service-ca\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.411028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.410991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-console-config\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.411207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.411134    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-trusted-ca-bundle\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.411330 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.411306    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-oauth-serving-cert\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.412796 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.412771    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-oauth-config\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.412930 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.412912    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-serving-cert\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.419676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.419656    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4hrn\" (UniqueName: \"kubernetes.io/projected/3382ec05-0014-4dc6-9905-da2688909e8a-kube-api-access-v4hrn\") pod \"console-665d6b7f88-rv42t\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") " pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.532869 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.532773    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:18.675558 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.675526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665d6b7f88-rv42t"]
Jul 27 19:08:18.680402 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:08:18.680375    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3382ec05_0014_4dc6_9905_da2688909e8a.slice/crio-e40a98582042dae2db4cb7f13c0d4ab1a8be530aeab04b1dac2c303ded30880c WatchSource:0}: Error finding container e40a98582042dae2db4cb7f13c0d4ab1a8be530aeab04b1dac2c303ded30880c: Status 404 returned error can't find the container with id e40a98582042dae2db4cb7f13c0d4ab1a8be530aeab04b1dac2c303ded30880c
Jul 27 19:08:18.797476 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.797392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d6b7f88-rv42t" event={"ID":"3382ec05-0014-4dc6-9905-da2688909e8a","Type":"ContainerStarted","Data":"be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0"}
Jul 27 19:08:18.797476 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.797454    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d6b7f88-rv42t" event={"ID":"3382ec05-0014-4dc6-9905-da2688909e8a","Type":"ContainerStarted","Data":"e40a98582042dae2db4cb7f13c0d4ab1a8be530aeab04b1dac2c303ded30880c"}
Jul 27 19:08:18.842090 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:18.842041    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665d6b7f88-rv42t" podStartSLOduration=0.842027289 podStartE2EDuration="842.027289ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:08:18.841907664 +0000 UTC m=+185.549047156" watchObservedRunningTime="2026-07-27 19:08:18.842027289 +0000 UTC m=+185.549166780"
Jul 27 19:08:28.533955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:28.533909    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:28.534427 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:28.534001    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:28.538701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:28.538681    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:28.839454 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:28.839371    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:08:28.907707 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:28.907680    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8987d665-9jxtm"]
Jul 27 19:08:53.928751 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:53.928699    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d8987d665-9jxtm" podUID="706609d5-d59f-4bbb-a5bb-4f1b956faaca" containerName="console" containerID="cri-o://ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0" gracePeriod=15
Jul 27 19:08:54.173576 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.173552    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:08:54.313951 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.313866    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-config\") pod \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") "
Jul 27 19:08:54.313951 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.313904    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khp49\" (UniqueName: \"kubernetes.io/projected/706609d5-d59f-4bbb-a5bb-4f1b956faaca-kube-api-access-khp49\") pod \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") "
Jul 27 19:08:54.314174 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.313954    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-oauth-serving-cert\") pod \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") "
Jul 27 19:08:54.314174 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314159    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-serving-cert\") pod \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") "
Jul 27 19:08:54.314282 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314206    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-trusted-ca-bundle\") pod \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") "
Jul 27 19:08:54.314282 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314235    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-oauth-config\") pod \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") "
Jul 27 19:08:54.314282 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314265    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-service-ca\") pod \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\" (UID: \"706609d5-d59f-4bbb-a5bb-4f1b956faaca\") "
Jul 27 19:08:54.314427 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314359    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-config" (OuterVolumeSpecName: "console-config") pod "706609d5-d59f-4bbb-a5bb-4f1b956faaca" (UID: "706609d5-d59f-4bbb-a5bb-4f1b956faaca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:54.314427 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314364    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "706609d5-d59f-4bbb-a5bb-4f1b956faaca" (UID: "706609d5-d59f-4bbb-a5bb-4f1b956faaca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:54.314756 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314659    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-service-ca" (OuterVolumeSpecName: "service-ca") pod "706609d5-d59f-4bbb-a5bb-4f1b956faaca" (UID: "706609d5-d59f-4bbb-a5bb-4f1b956faaca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:54.314756 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314665    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "706609d5-d59f-4bbb-a5bb-4f1b956faaca" (UID: "706609d5-d59f-4bbb-a5bb-4f1b956faaca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:54.314756 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314685    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-oauth-serving-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:54.314756 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.314708    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-config\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:54.316477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.316445    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "706609d5-d59f-4bbb-a5bb-4f1b956faaca" (UID: "706609d5-d59f-4bbb-a5bb-4f1b956faaca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:54.316477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.316464    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706609d5-d59f-4bbb-a5bb-4f1b956faaca-kube-api-access-khp49" (OuterVolumeSpecName: "kube-api-access-khp49") pod "706609d5-d59f-4bbb-a5bb-4f1b956faaca" (UID: "706609d5-d59f-4bbb-a5bb-4f1b956faaca"). InnerVolumeSpecName "kube-api-access-khp49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:08:54.316605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.316481    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "706609d5-d59f-4bbb-a5bb-4f1b956faaca" (UID: "706609d5-d59f-4bbb-a5bb-4f1b956faaca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:54.416030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.415996    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-serving-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:54.416030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.416025    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-trusted-ca-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:54.416030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.416034    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/706609d5-d59f-4bbb-a5bb-4f1b956faaca-console-oauth-config\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:54.416255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.416042    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/706609d5-d59f-4bbb-a5bb-4f1b956faaca-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:54.416255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.416051    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khp49\" (UniqueName: \"kubernetes.io/projected/706609d5-d59f-4bbb-a5bb-4f1b956faaca-kube-api-access-khp49\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:08:54.937399 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.937366    2557 generic.go:356] "Generic (PLEG): container finished" podID="706609d5-d59f-4bbb-a5bb-4f1b956faaca" containerID="ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0" exitCode=0
Jul 27 19:08:54.937776 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.937409    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8987d665-9jxtm"
Jul 27 19:08:54.937776 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.937452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8987d665-9jxtm" event={"ID":"706609d5-d59f-4bbb-a5bb-4f1b956faaca","Type":"ContainerDied","Data":"ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0"}
Jul 27 19:08:54.937776 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.937505    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8987d665-9jxtm" event={"ID":"706609d5-d59f-4bbb-a5bb-4f1b956faaca","Type":"ContainerDied","Data":"9d40a0dad4bb0e0a8a4b4be7c770a21bb0b39b207129c96649fc30eb48486a92"}
Jul 27 19:08:54.937776 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.937525    2557 scope.go:117] "RemoveContainer" containerID="ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0"
Jul 27 19:08:54.953007 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.952975    2557 scope.go:117] "RemoveContainer" containerID="ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0"
Jul 27 19:08:54.953448 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:08:54.953427    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0\": container with ID starting with ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0 not found: ID does not exist" containerID="ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0"
Jul 27 19:08:54.953511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.953457    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0"} err="failed to get container status \"ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0\": rpc error: code = NotFound desc = could not find container \"ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0\": container with ID starting with ae94f4485701fd1817d6c0d2ccc89e1515e54a8c401843601b4e445821a849d0 not found: ID does not exist"
Jul 27 19:08:54.967823 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.967788    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8987d665-9jxtm"]
Jul 27 19:08:54.971518 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:54.971499    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8987d665-9jxtm"]
Jul 27 19:08:55.790128 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:08:55.790095    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="706609d5-d59f-4bbb-a5bb-4f1b956faaca" path="/var/lib/kubelet/pods/706609d5-d59f-4bbb-a5bb-4f1b956faaca/volumes"
Jul 27 19:09:06.619067 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.619025    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"]
Jul 27 19:09:06.619654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.619498    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706609d5-d59f-4bbb-a5bb-4f1b956faaca" containerName="console"
Jul 27 19:09:06.619654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.619517    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="706609d5-d59f-4bbb-a5bb-4f1b956faaca" containerName="console"
Jul 27 19:09:06.619654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.619625    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="706609d5-d59f-4bbb-a5bb-4f1b956faaca" containerName="console"
Jul 27 19:09:06.621828 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.621793    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.624957 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.624940    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 19:09:06.626164 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.626148    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 19:09:06.626266 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.626148    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngpwd\""
Jul 27 19:09:06.638741 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.638721    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"]
Jul 27 19:09:06.718282 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.718253    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtkxn\" (UniqueName: \"kubernetes.io/projected/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-kube-api-access-qtkxn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.718446 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.718288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.718446 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.718362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.819568 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.819516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtkxn\" (UniqueName: \"kubernetes.io/projected/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-kube-api-access-qtkxn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.819568 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.819575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.819841 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.819635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.819996 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.819973    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.820055 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.820010    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.829435 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.829413    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtkxn\" (UniqueName: \"kubernetes.io/projected/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-kube-api-access-qtkxn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:06.930836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:06.930792    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:07.068750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:07.068721    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"]
Jul 27 19:09:07.072282 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:09:07.072256    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3a0be8_64b3_4cff_9c89_daa40b96d01e.slice/crio-119926f94044f63551ab25aee7a8908bf9f7d39fa5436a0f056617c93046d4d3 WatchSource:0}: Error finding container 119926f94044f63551ab25aee7a8908bf9f7d39fa5436a0f056617c93046d4d3: Status 404 returned error can't find the container with id 119926f94044f63551ab25aee7a8908bf9f7d39fa5436a0f056617c93046d4d3
Jul 27 19:09:07.997515 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:07.997482    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb" event={"ID":"3b3a0be8-64b3-4cff-9c89-daa40b96d01e","Type":"ContainerStarted","Data":"119926f94044f63551ab25aee7a8908bf9f7d39fa5436a0f056617c93046d4d3"}
Jul 27 19:09:15.031418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:15.031363    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerID="991e406b4fa2def9b8f8b686616b75fec88a79aee86aba01a6c8824de2c19142" exitCode=0
Jul 27 19:09:15.031795 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:15.031480    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb" event={"ID":"3b3a0be8-64b3-4cff-9c89-daa40b96d01e","Type":"ContainerDied","Data":"991e406b4fa2def9b8f8b686616b75fec88a79aee86aba01a6c8824de2c19142"}
Jul 27 19:09:18.047384 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:18.047347    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerID="3cbd577ee937e107286f4647d9040ad055d3b7cdb5b1fe9f54bbfcaa8da07856" exitCode=0
Jul 27 19:09:18.047789 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:18.047393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb" event={"ID":"3b3a0be8-64b3-4cff-9c89-daa40b96d01e","Type":"ContainerDied","Data":"3cbd577ee937e107286f4647d9040ad055d3b7cdb5b1fe9f54bbfcaa8da07856"}
Jul 27 19:09:27.092116 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:27.092079    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerID="f188081a3000fad8c8147bb982563ee4ae659b39e6cc8d48d6a1e699b5b256f5" exitCode=0
Jul 27 19:09:27.092509 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:27.092148    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb" event={"ID":"3b3a0be8-64b3-4cff-9c89-daa40b96d01e","Type":"ContainerDied","Data":"f188081a3000fad8c8147bb982563ee4ae659b39e6cc8d48d6a1e699b5b256f5"}
Jul 27 19:09:28.222944 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.222911    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:28.308662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.308640    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-util\") pod \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") "
Jul 27 19:09:28.308836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.308678    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-bundle\") pod \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") "
Jul 27 19:09:28.308836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.308773    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtkxn\" (UniqueName: \"kubernetes.io/projected/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-kube-api-access-qtkxn\") pod \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\" (UID: \"3b3a0be8-64b3-4cff-9c89-daa40b96d01e\") "
Jul 27 19:09:28.309435 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.309402    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-bundle" (OuterVolumeSpecName: "bundle") pod "3b3a0be8-64b3-4cff-9c89-daa40b96d01e" (UID: "3b3a0be8-64b3-4cff-9c89-daa40b96d01e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:09:28.310974 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.310948    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-kube-api-access-qtkxn" (OuterVolumeSpecName: "kube-api-access-qtkxn") pod "3b3a0be8-64b3-4cff-9c89-daa40b96d01e" (UID: "3b3a0be8-64b3-4cff-9c89-daa40b96d01e"). InnerVolumeSpecName "kube-api-access-qtkxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:09:28.313307 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.313285    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-util" (OuterVolumeSpecName: "util") pod "3b3a0be8-64b3-4cff-9c89-daa40b96d01e" (UID: "3b3a0be8-64b3-4cff-9c89-daa40b96d01e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:09:28.409525 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.409461    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtkxn\" (UniqueName: \"kubernetes.io/projected/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-kube-api-access-qtkxn\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:09:28.409525 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.409487    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-util\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:09:28.409525 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:28.409496    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b3a0be8-64b3-4cff-9c89-daa40b96d01e-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:09:29.101434 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:29.101404    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb" event={"ID":"3b3a0be8-64b3-4cff-9c89-daa40b96d01e","Type":"ContainerDied","Data":"119926f94044f63551ab25aee7a8908bf9f7d39fa5436a0f056617c93046d4d3"}
Jul 27 19:09:29.101605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:29.101449    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="119926f94044f63551ab25aee7a8908bf9f7d39fa5436a0f056617c93046d4d3"
Jul 27 19:09:29.101605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:29.101500    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sqcrb"
Jul 27 19:09:34.689343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.689265    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"]
Jul 27 19:09:34.689773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.689620    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerName="extract"
Jul 27 19:09:34.689773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.689631    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerName="extract"
Jul 27 19:09:34.689773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.689642    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerName="pull"
Jul 27 19:09:34.689773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.689647    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerName="pull"
Jul 27 19:09:34.689773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.689657    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerName="util"
Jul 27 19:09:34.689773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.689663    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerName="util"
Jul 27 19:09:34.689773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.689710    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b3a0be8-64b3-4cff-9c89-daa40b96d01e" containerName="extract"
Jul 27 19:09:34.703733 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.703713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"
Jul 27 19:09:34.707995 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.707969    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 19:09:34.708154 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.707983    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g4z4v\""
Jul 27 19:09:34.708224 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.708175    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:09:34.709802 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.709778    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"]
Jul 27 19:09:34.864564 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.864532    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/338442cb-51e9-49c4-a8b5-e7ca1411c35c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvv6f\" (UID: \"338442cb-51e9-49c4-a8b5-e7ca1411c35c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"
Jul 27 19:09:34.864728 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.864639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8rzb\" (UniqueName: \"kubernetes.io/projected/338442cb-51e9-49c4-a8b5-e7ca1411c35c-kube-api-access-r8rzb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvv6f\" (UID: \"338442cb-51e9-49c4-a8b5-e7ca1411c35c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"
Jul 27 19:09:34.966016 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.965935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/338442cb-51e9-49c4-a8b5-e7ca1411c35c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvv6f\" (UID: \"338442cb-51e9-49c4-a8b5-e7ca1411c35c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"
Jul 27 19:09:34.966178 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.966038    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8rzb\" (UniqueName: \"kubernetes.io/projected/338442cb-51e9-49c4-a8b5-e7ca1411c35c-kube-api-access-r8rzb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvv6f\" (UID: \"338442cb-51e9-49c4-a8b5-e7ca1411c35c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"
Jul 27 19:09:34.966398 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.966373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/338442cb-51e9-49c4-a8b5-e7ca1411c35c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvv6f\" (UID: \"338442cb-51e9-49c4-a8b5-e7ca1411c35c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"
Jul 27 19:09:34.980312 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:34.980290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8rzb\" (UniqueName: \"kubernetes.io/projected/338442cb-51e9-49c4-a8b5-e7ca1411c35c-kube-api-access-r8rzb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvv6f\" (UID: \"338442cb-51e9-49c4-a8b5-e7ca1411c35c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"
Jul 27 19:09:35.013625 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:35.013600    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"
Jul 27 19:09:35.176854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:35.176824    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f"]
Jul 27 19:09:35.180759 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:09:35.180726    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338442cb_51e9_49c4_a8b5_e7ca1411c35c.slice/crio-0dd77f8f53a56bc5003c387a24134880e435413da0009975f67a439281f363f6 WatchSource:0}: Error finding container 0dd77f8f53a56bc5003c387a24134880e435413da0009975f67a439281f363f6: Status 404 returned error can't find the container with id 0dd77f8f53a56bc5003c387a24134880e435413da0009975f67a439281f363f6
Jul 27 19:09:36.137977 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:36.137938    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f" event={"ID":"338442cb-51e9-49c4-a8b5-e7ca1411c35c","Type":"ContainerStarted","Data":"0dd77f8f53a56bc5003c387a24134880e435413da0009975f67a439281f363f6"}
Jul 27 19:09:37.144491 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:37.144456    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f" event={"ID":"338442cb-51e9-49c4-a8b5-e7ca1411c35c","Type":"ContainerStarted","Data":"74d80b957f0d13911356490e7540f6f8d42bc083c5856929ef8ac768c6123dda"}
Jul 27 19:09:37.172747 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:37.172691    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvv6f" podStartSLOduration=1.400159547 podStartE2EDuration="3.172670979s" totalImagesPullingTime="1.772511432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:09:37.172242865 +0000 UTC m=+263.879382358" watchObservedRunningTime="2026-07-27 19:09:37.172670979 +0000 UTC m=+263.879810471"
Jul 27 19:09:38.381829 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.381780    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"]
Jul 27 19:09:38.384481 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.384460    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.387505 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.387485    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngpwd\""
Jul 27 19:09:38.387611 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.387487    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 19:09:38.388534 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.388518    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 19:09:38.397200 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.397180    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"]
Jul 27 19:09:38.398028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.398010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qjmw\" (UniqueName: \"kubernetes.io/projected/0b30ab3e-08e8-454a-8808-71376c190cf5-kube-api-access-7qjmw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.398107 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.398037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.398107 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.398069    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.498762 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.498732    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qjmw\" (UniqueName: \"kubernetes.io/projected/0b30ab3e-08e8-454a-8808-71376c190cf5-kube-api-access-7qjmw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.498762 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.498767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.499014 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.498798    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.499146 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.499123    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.499219 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.499189    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.509881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.509842    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qjmw\" (UniqueName: \"kubernetes.io/projected/0b30ab3e-08e8-454a-8808-71376c190cf5-kube-api-access-7qjmw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.693714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.693684    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:38.829149 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:38.829122    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"]
Jul 27 19:09:38.830716 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:09:38.830678    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b30ab3e_08e8_454a_8808_71376c190cf5.slice/crio-811383bd667ad0b522448ae540ed9e137775603a9c3c195dd8af446c79342b69 WatchSource:0}: Error finding container 811383bd667ad0b522448ae540ed9e137775603a9c3c195dd8af446c79342b69: Status 404 returned error can't find the container with id 811383bd667ad0b522448ae540ed9e137775603a9c3c195dd8af446c79342b69
Jul 27 19:09:39.155524 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:39.155433    2557 generic.go:356] "Generic (PLEG): container finished" podID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerID="a3d8e2151bcd8ba14e632f678484cd2d8a46062b9e4c663e3d8cae44f93c1976" exitCode=0
Jul 27 19:09:39.155524 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:39.155491    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586" event={"ID":"0b30ab3e-08e8-454a-8808-71376c190cf5","Type":"ContainerDied","Data":"a3d8e2151bcd8ba14e632f678484cd2d8a46062b9e4c663e3d8cae44f93c1976"}
Jul 27 19:09:39.155754 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:39.155545    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586" event={"ID":"0b30ab3e-08e8-454a-8808-71376c190cf5","Type":"ContainerStarted","Data":"811383bd667ad0b522448ae540ed9e137775603a9c3c195dd8af446c79342b69"}
Jul 27 19:09:41.166789 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:41.166762    2557 generic.go:356] "Generic (PLEG): container finished" podID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerID="9cecb01bd6665d6d5795be76c8c10c4e0fbd7a70f0c5172d3bdae880bc403bef" exitCode=0
Jul 27 19:09:41.167140 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:41.166840    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586" event={"ID":"0b30ab3e-08e8-454a-8808-71376c190cf5","Type":"ContainerDied","Data":"9cecb01bd6665d6d5795be76c8c10c4e0fbd7a70f0c5172d3bdae880bc403bef"}
Jul 27 19:09:42.173201 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:42.173173    2557 generic.go:356] "Generic (PLEG): container finished" podID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerID="99e28cac839ad62a52e24efd200c64a45d75797f042bbe82fa377c27eadfa57a" exitCode=0
Jul 27 19:09:42.173540 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:42.173268    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586" event={"ID":"0b30ab3e-08e8-454a-8808-71376c190cf5","Type":"ContainerDied","Data":"99e28cac839ad62a52e24efd200c64a45d75797f042bbe82fa377c27eadfa57a"}
Jul 27 19:09:43.303082 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.303059    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:43.335873 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.335847    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-util\") pod \"0b30ab3e-08e8-454a-8808-71376c190cf5\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") "
Jul 27 19:09:43.335977 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.335961    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qjmw\" (UniqueName: \"kubernetes.io/projected/0b30ab3e-08e8-454a-8808-71376c190cf5-kube-api-access-7qjmw\") pod \"0b30ab3e-08e8-454a-8808-71376c190cf5\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") "
Jul 27 19:09:43.336030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.336004    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-bundle\") pod \"0b30ab3e-08e8-454a-8808-71376c190cf5\" (UID: \"0b30ab3e-08e8-454a-8808-71376c190cf5\") "
Jul 27 19:09:43.336394 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.336366    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-bundle" (OuterVolumeSpecName: "bundle") pod "0b30ab3e-08e8-454a-8808-71376c190cf5" (UID: "0b30ab3e-08e8-454a-8808-71376c190cf5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:09:43.338185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.338158    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b30ab3e-08e8-454a-8808-71376c190cf5-kube-api-access-7qjmw" (OuterVolumeSpecName: "kube-api-access-7qjmw") pod "0b30ab3e-08e8-454a-8808-71376c190cf5" (UID: "0b30ab3e-08e8-454a-8808-71376c190cf5"). InnerVolumeSpecName "kube-api-access-7qjmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:09:43.343555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.343528    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-util" (OuterVolumeSpecName: "util") pod "0b30ab3e-08e8-454a-8808-71376c190cf5" (UID: "0b30ab3e-08e8-454a-8808-71376c190cf5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:09:43.437132 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.437071    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qjmw\" (UniqueName: \"kubernetes.io/projected/0b30ab3e-08e8-454a-8808-71376c190cf5-kube-api-access-7qjmw\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:09:43.437132 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.437096    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:09:43.437132 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:43.437105    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b30ab3e-08e8-454a-8808-71376c190cf5-util\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:09:44.185206 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:44.185169    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586" event={"ID":"0b30ab3e-08e8-454a-8808-71376c190cf5","Type":"ContainerDied","Data":"811383bd667ad0b522448ae540ed9e137775603a9c3c195dd8af446c79342b69"}
Jul 27 19:09:44.185388 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:44.185224    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="811383bd667ad0b522448ae540ed9e137775603a9c3c195dd8af446c79342b69"
Jul 27 19:09:44.185388 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:44.185223    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcs586"
Jul 27 19:09:47.217701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.217671    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"]
Jul 27 19:09:47.218185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.218060    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerName="extract"
Jul 27 19:09:47.218185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.218073    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerName="extract"
Jul 27 19:09:47.218185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.218083    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerName="pull"
Jul 27 19:09:47.218185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.218089    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerName="pull"
Jul 27 19:09:47.218185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.218103    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerName="util"
Jul 27 19:09:47.218185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.218108    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerName="util"
Jul 27 19:09:47.218185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.218168    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b30ab3e-08e8-454a-8808-71376c190cf5" containerName="extract"
Jul 27 19:09:47.220063 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.220046    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"
Jul 27 19:09:47.223068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.223051    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 19:09:47.224184 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.224166    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 19:09:47.224296 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.224171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-p9bkn\""
Jul 27 19:09:47.233572 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.233549    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"]
Jul 27 19:09:47.270617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.270596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bn7f\" (UniqueName: \"kubernetes.io/projected/ddf1db1f-c13f-48be-b915-7b4d1b26525c-kube-api-access-8bn7f\") pod \"cert-manager-cainjector-559cdd8c87-cfn7k\" (UID: \"ddf1db1f-c13f-48be-b915-7b4d1b26525c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"
Jul 27 19:09:47.270743 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.270694    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddf1db1f-c13f-48be-b915-7b4d1b26525c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfn7k\" (UID: \"ddf1db1f-c13f-48be-b915-7b4d1b26525c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"
Jul 27 19:09:47.371694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.371650    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bn7f\" (UniqueName: \"kubernetes.io/projected/ddf1db1f-c13f-48be-b915-7b4d1b26525c-kube-api-access-8bn7f\") pod \"cert-manager-cainjector-559cdd8c87-cfn7k\" (UID: \"ddf1db1f-c13f-48be-b915-7b4d1b26525c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"
Jul 27 19:09:47.371861 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.371726    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddf1db1f-c13f-48be-b915-7b4d1b26525c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfn7k\" (UID: \"ddf1db1f-c13f-48be-b915-7b4d1b26525c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"
Jul 27 19:09:47.381935 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.381912    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddf1db1f-c13f-48be-b915-7b4d1b26525c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfn7k\" (UID: \"ddf1db1f-c13f-48be-b915-7b4d1b26525c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"
Jul 27 19:09:47.383263 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.383238    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bn7f\" (UniqueName: \"kubernetes.io/projected/ddf1db1f-c13f-48be-b915-7b4d1b26525c-kube-api-access-8bn7f\") pod \"cert-manager-cainjector-559cdd8c87-cfn7k\" (UID: \"ddf1db1f-c13f-48be-b915-7b4d1b26525c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"
Jul 27 19:09:47.541862 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.541757    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"
Jul 27 19:09:47.667936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:47.667909    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k"]
Jul 27 19:09:47.669872 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:09:47.669846    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddf1db1f_c13f_48be_b915_7b4d1b26525c.slice/crio-d930999eeaff2e92d828a70badd4e7c10641e342712ac20af2d26b1999cb63e6 WatchSource:0}: Error finding container d930999eeaff2e92d828a70badd4e7c10641e342712ac20af2d26b1999cb63e6: Status 404 returned error can't find the container with id d930999eeaff2e92d828a70badd4e7c10641e342712ac20af2d26b1999cb63e6
Jul 27 19:09:48.204717 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.204680    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k" event={"ID":"ddf1db1f-c13f-48be-b915-7b4d1b26525c","Type":"ContainerStarted","Data":"d930999eeaff2e92d828a70badd4e7c10641e342712ac20af2d26b1999cb63e6"}
Jul 27 19:09:48.263997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.263969    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"]
Jul 27 19:09:48.269881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.268885    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"
Jul 27 19:09:48.272481 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.272459    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zgrhj\""
Jul 27 19:09:48.273613 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.273597    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 19:09:48.273613 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.273605    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:09:48.278840 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.278794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbv6v\" (UniqueName: \"kubernetes.io/projected/77cb3dfa-92d9-4842-8319-cfb1149d18cc-kube-api-access-xbv6v\") pod \"openshift-lws-operator-fd8ccff4c-5kbpc\" (UID: \"77cb3dfa-92d9-4842-8319-cfb1149d18cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"
Jul 27 19:09:48.278922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.278852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77cb3dfa-92d9-4842-8319-cfb1149d18cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5kbpc\" (UID: \"77cb3dfa-92d9-4842-8319-cfb1149d18cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"
Jul 27 19:09:48.279503 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.279487    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"]
Jul 27 19:09:48.379499 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.379473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbv6v\" (UniqueName: \"kubernetes.io/projected/77cb3dfa-92d9-4842-8319-cfb1149d18cc-kube-api-access-xbv6v\") pod \"openshift-lws-operator-fd8ccff4c-5kbpc\" (UID: \"77cb3dfa-92d9-4842-8319-cfb1149d18cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"
Jul 27 19:09:48.379644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.379505    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77cb3dfa-92d9-4842-8319-cfb1149d18cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5kbpc\" (UID: \"77cb3dfa-92d9-4842-8319-cfb1149d18cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"
Jul 27 19:09:48.379844 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.379828    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77cb3dfa-92d9-4842-8319-cfb1149d18cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5kbpc\" (UID: \"77cb3dfa-92d9-4842-8319-cfb1149d18cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"
Jul 27 19:09:48.388732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.388704    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbv6v\" (UniqueName: \"kubernetes.io/projected/77cb3dfa-92d9-4842-8319-cfb1149d18cc-kube-api-access-xbv6v\") pod \"openshift-lws-operator-fd8ccff4c-5kbpc\" (UID: \"77cb3dfa-92d9-4842-8319-cfb1149d18cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"
Jul 27 19:09:48.579644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.579577    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"
Jul 27 19:09:48.708834 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:48.708795    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc"]
Jul 27 19:09:48.710858 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:09:48.710833    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77cb3dfa_92d9_4842_8319_cfb1149d18cc.slice/crio-a0058bbe9393e9920f86cf5fd997153d5eb7819e97606aa13c9d7806ad680435 WatchSource:0}: Error finding container a0058bbe9393e9920f86cf5fd997153d5eb7819e97606aa13c9d7806ad680435: Status 404 returned error can't find the container with id a0058bbe9393e9920f86cf5fd997153d5eb7819e97606aa13c9d7806ad680435
Jul 27 19:09:49.210877 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:49.210842    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc" event={"ID":"77cb3dfa-92d9-4842-8319-cfb1149d18cc","Type":"ContainerStarted","Data":"a0058bbe9393e9920f86cf5fd997153d5eb7819e97606aa13c9d7806ad680435"}
Jul 27 19:09:52.229151 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:52.229117    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k" event={"ID":"ddf1db1f-c13f-48be-b915-7b4d1b26525c","Type":"ContainerStarted","Data":"5078fad43fbf97b2ea8132686dc7db621f469535121eca5b8be2487d7b199e5f"}
Jul 27 19:09:52.231001 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:52.230955    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc" event={"ID":"77cb3dfa-92d9-4842-8319-cfb1149d18cc","Type":"ContainerStarted","Data":"2448cfd5044c4be7ee6ed446ffae019e298cb57f85769cf0ff4080dc9d673866"}
Jul 27 19:09:52.249538 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:52.249490    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfn7k" podStartSLOduration=0.887281548 podStartE2EDuration="5.249474895s" totalImagesPullingTime="4.362193347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:09:52.247156269 +0000 UTC m=+278.954295759" watchObservedRunningTime="2026-07-27 19:09:52.249474895 +0000 UTC m=+278.956614386"
Jul 27 19:09:52.265623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:52.265579    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5kbpc" podStartSLOduration=0.947517455 podStartE2EDuration="4.265559171s" totalImagesPullingTime="3.318041716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:09:52.264692088 +0000 UTC m=+278.971831578" watchObservedRunningTime="2026-07-27 19:09:52.265559171 +0000 UTC m=+278.972698670"
Jul 27 19:09:55.206400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.206364    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"]
Jul 27 19:09:55.208986 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.208970    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.211778 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.211760    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 19:09:55.211984 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.211967    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 19:09:55.212269 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.212035    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngpwd\""
Jul 27 19:09:55.218330 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.218309    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"]
Jul 27 19:09:55.237979 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.237949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.238085 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.237996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9smq\" (UniqueName: \"kubernetes.io/projected/e04fc12a-12c4-4490-bdab-fc177d60d600-kube-api-access-w9smq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.238085 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.238017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.339141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.339113    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.339321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.339165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9smq\" (UniqueName: \"kubernetes.io/projected/e04fc12a-12c4-4490-bdab-fc177d60d600-kube-api-access-w9smq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.339321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.339200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.339563 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.339541    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.339624 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.339558    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.347628 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.347606    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9smq\" (UniqueName: \"kubernetes.io/projected/e04fc12a-12c4-4490-bdab-fc177d60d600-kube-api-access-w9smq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.518932 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.518848    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:09:55.649954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:55.649833    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"]
Jul 27 19:09:55.652550 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:09:55.652519    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04fc12a_12c4_4490_bdab_fc177d60d600.slice/crio-7d6e9eebb1bbfc0ec53ecbf2782dc5d89dc5cec82b819f25f7c399fc03f31d09 WatchSource:0}: Error finding container 7d6e9eebb1bbfc0ec53ecbf2782dc5d89dc5cec82b819f25f7c399fc03f31d09: Status 404 returned error can't find the container with id 7d6e9eebb1bbfc0ec53ecbf2782dc5d89dc5cec82b819f25f7c399fc03f31d09
Jul 27 19:09:56.249976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:56.249942    2557 generic.go:356] "Generic (PLEG): container finished" podID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerID="f16fd427619a974b9fb6bb00bc252047e119310573ed02bbd58bf1894f18ac3b" exitCode=0
Jul 27 19:09:56.250393 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:56.250024    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k" event={"ID":"e04fc12a-12c4-4490-bdab-fc177d60d600","Type":"ContainerDied","Data":"f16fd427619a974b9fb6bb00bc252047e119310573ed02bbd58bf1894f18ac3b"}
Jul 27 19:09:56.250393 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:56.250071    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k" event={"ID":"e04fc12a-12c4-4490-bdab-fc177d60d600","Type":"ContainerStarted","Data":"7d6e9eebb1bbfc0ec53ecbf2782dc5d89dc5cec82b819f25f7c399fc03f31d09"}
Jul 27 19:09:58.261662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:58.261625    2557 generic.go:356] "Generic (PLEG): container finished" podID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerID="36e51982795a3ad31991a87b19ad8fd5576326fbdad6a1081c6f16c5dd2683db" exitCode=0
Jul 27 19:09:58.262234 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:58.261696    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k" event={"ID":"e04fc12a-12c4-4490-bdab-fc177d60d600","Type":"ContainerDied","Data":"36e51982795a3ad31991a87b19ad8fd5576326fbdad6a1081c6f16c5dd2683db"}
Jul 27 19:09:59.268622 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:59.268591    2557 generic.go:356] "Generic (PLEG): container finished" podID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerID="5b8a9df762274d3db2dd66a25ecd8a1f404947f175d049b4d6bf23203894c5a0" exitCode=0
Jul 27 19:09:59.269015 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:09:59.268640    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k" event={"ID":"e04fc12a-12c4-4490-bdab-fc177d60d600","Type":"ContainerDied","Data":"5b8a9df762274d3db2dd66a25ecd8a1f404947f175d049b4d6bf23203894c5a0"}
Jul 27 19:10:00.404887 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.404862    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:10:00.479182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.479157    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9smq\" (UniqueName: \"kubernetes.io/projected/e04fc12a-12c4-4490-bdab-fc177d60d600-kube-api-access-w9smq\") pod \"e04fc12a-12c4-4490-bdab-fc177d60d600\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") "
Jul 27 19:10:00.479350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.479197    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-util\") pod \"e04fc12a-12c4-4490-bdab-fc177d60d600\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") "
Jul 27 19:10:00.479350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.479237    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-bundle\") pod \"e04fc12a-12c4-4490-bdab-fc177d60d600\" (UID: \"e04fc12a-12c4-4490-bdab-fc177d60d600\") "
Jul 27 19:10:00.479971 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.479948    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-bundle" (OuterVolumeSpecName: "bundle") pod "e04fc12a-12c4-4490-bdab-fc177d60d600" (UID: "e04fc12a-12c4-4490-bdab-fc177d60d600"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:10:00.481634 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.481609    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e04fc12a-12c4-4490-bdab-fc177d60d600-kube-api-access-w9smq" (OuterVolumeSpecName: "kube-api-access-w9smq") pod "e04fc12a-12c4-4490-bdab-fc177d60d600" (UID: "e04fc12a-12c4-4490-bdab-fc177d60d600"). InnerVolumeSpecName "kube-api-access-w9smq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:10:00.484533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.484500    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-util" (OuterVolumeSpecName: "util") pod "e04fc12a-12c4-4490-bdab-fc177d60d600" (UID: "e04fc12a-12c4-4490-bdab-fc177d60d600"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:10:00.579947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.579864    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9smq\" (UniqueName: \"kubernetes.io/projected/e04fc12a-12c4-4490-bdab-fc177d60d600-kube-api-access-w9smq\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:00.579947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.579889    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-util\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:00.579947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:00.579898    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e04fc12a-12c4-4490-bdab-fc177d60d600-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:01.281310 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:01.281282    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k"
Jul 27 19:10:01.281310 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:01.281300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxjk6k" event={"ID":"e04fc12a-12c4-4490-bdab-fc177d60d600","Type":"ContainerDied","Data":"7d6e9eebb1bbfc0ec53ecbf2782dc5d89dc5cec82b819f25f7c399fc03f31d09"}
Jul 27 19:10:01.281549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:01.281343    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d6e9eebb1bbfc0ec53ecbf2782dc5d89dc5cec82b819f25f7c399fc03f31d09"
Jul 27 19:10:12.906134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.906099    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"]
Jul 27 19:10:12.907331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.907304    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerName="util"
Jul 27 19:10:12.907488 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.907477    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerName="util"
Jul 27 19:10:12.907572 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.907562    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerName="extract"
Jul 27 19:10:12.907635 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.907627    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerName="extract"
Jul 27 19:10:12.907739 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.907730    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerName="pull"
Jul 27 19:10:12.907823 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.907796    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerName="pull"
Jul 27 19:10:12.908087 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.908072    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e04fc12a-12c4-4490-bdab-fc177d60d600" containerName="extract"
Jul 27 19:10:12.911511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.911492    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:12.918675 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.918658    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:10:12.918984 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.918960    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dzws5\""
Jul 27 19:10:12.919117 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.919100    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:10:12.919213 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.919197    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 19:10:12.919275 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.919212    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:10:12.936195 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.936176    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"]
Jul 27 19:10:12.985252 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.985227    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f4cea95-f704-4075-9f41-647c7833d23e-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:12.985387 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.985265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f4cea95-f704-4075-9f41-647c7833d23e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:12.985387 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.985288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbp5b\" (UniqueName: \"kubernetes.io/projected/6f4cea95-f704-4075-9f41-647c7833d23e-kube-api-access-gbp5b\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:12.985387 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.985379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f4cea95-f704-4075-9f41-647c7833d23e-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:12.985489 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:12.985419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f4cea95-f704-4075-9f41-647c7833d23e-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.086524 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.086496    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f4cea95-f704-4075-9f41-647c7833d23e-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.086654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.086541    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f4cea95-f704-4075-9f41-647c7833d23e-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.086654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.086606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f4cea95-f704-4075-9f41-647c7833d23e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.086654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.086640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbp5b\" (UniqueName: \"kubernetes.io/projected/6f4cea95-f704-4075-9f41-647c7833d23e-kube-api-access-gbp5b\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.086791 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.086688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f4cea95-f704-4075-9f41-647c7833d23e-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.086976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.086956    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f4cea95-f704-4075-9f41-647c7833d23e-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.088905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.088883    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f4cea95-f704-4075-9f41-647c7833d23e-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.089138 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.089119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f4cea95-f704-4075-9f41-647c7833d23e-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.089202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.089127    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f4cea95-f704-4075-9f41-647c7833d23e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.099638 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.099613    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbp5b\" (UniqueName: \"kubernetes.io/projected/6f4cea95-f704-4075-9f41-647c7833d23e-kube-api-access-gbp5b\") pod \"opendatahub-operator-controller-manager-9459789d9-tp56r\" (UID: \"6f4cea95-f704-4075-9f41-647c7833d23e\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.221462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.221426    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:13.358215 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.358192    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"]
Jul 27 19:10:13.359912 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:10:13.359885    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4cea95_f704_4075_9f41_647c7833d23e.slice/crio-02a7187530a6ee7d1ffa5d9346513516437e7cb7185e472b8c752c0e292b1f01 WatchSource:0}: Error finding container 02a7187530a6ee7d1ffa5d9346513516437e7cb7185e472b8c752c0e292b1f01: Status 404 returned error can't find the container with id 02a7187530a6ee7d1ffa5d9346513516437e7cb7185e472b8c752c0e292b1f01
Jul 27 19:10:13.681445 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.681416    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:10:13.681597 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.681463    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:10:13.687215 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.687191    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:10:13.687383 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.687365    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:10:13.693590 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:13.693573    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 19:10:14.347564 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:14.347528    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r" event={"ID":"6f4cea95-f704-4075-9f41-647c7833d23e","Type":"ContainerStarted","Data":"02a7187530a6ee7d1ffa5d9346513516437e7cb7185e472b8c752c0e292b1f01"}
Jul 27 19:10:17.363645 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:17.363608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r" event={"ID":"6f4cea95-f704-4075-9f41-647c7833d23e","Type":"ContainerStarted","Data":"96e0146a987bd905abe48725ffe5b870c00d37b4ca22b2e43847ebcdec79dbfb"}
Jul 27 19:10:18.370090 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:18.370058    2557 generic.go:356] "Generic (PLEG): container finished" podID="6f4cea95-f704-4075-9f41-647c7833d23e" containerID="96e0146a987bd905abe48725ffe5b870c00d37b4ca22b2e43847ebcdec79dbfb" exitCode=0
Jul 27 19:10:18.370472 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:18.370132    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r" event={"ID":"6f4cea95-f704-4075-9f41-647c7833d23e","Type":"ContainerDied","Data":"96e0146a987bd905abe48725ffe5b870c00d37b4ca22b2e43847ebcdec79dbfb"}
Jul 27 19:10:18.370615 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:18.370601    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:10:19.377085 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:19.377050    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r" event={"ID":"6f4cea95-f704-4075-9f41-647c7833d23e","Type":"ContainerStarted","Data":"03e5ac7fa49f4eb2b8689fc564f27e3affc42fedce5469f010c3c4fb3020e260"}
Jul 27 19:10:19.377512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:19.377168    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:19.399400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:19.399354    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r" podStartSLOduration=2.813234708 podStartE2EDuration="7.399338739s" totalImagesPullingTime="3.571165308s" totalInitContainerRuntime="1.014938723s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:19.397389642 +0000 UTC m=+306.104529145" watchObservedRunningTime="2026-07-27 19:10:19.399338739 +0000 UTC m=+306.106478267"
Jul 27 19:10:30.383802 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:30.383772    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-tp56r"
Jul 27 19:10:33.971313 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:33.971279    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"]
Jul 27 19:10:33.973843 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:33.973799    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:33.977867 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:33.977846    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 19:10:33.979292 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:33.979273    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 19:10:34.003743 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.003722    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"]
Jul 27 19:10:34.069505 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.069479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3721133b-3593-4bbe-81c5-54721da8df09-tmp\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.069646 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.069548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fwbm\" (UniqueName: \"kubernetes.io/projected/3721133b-3593-4bbe-81c5-54721da8df09-kube-api-access-5fwbm\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.069646 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.069615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3721133b-3593-4bbe-81c5-54721da8df09-tls-certs\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.171057 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.171021    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fwbm\" (UniqueName: \"kubernetes.io/projected/3721133b-3593-4bbe-81c5-54721da8df09-kube-api-access-5fwbm\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.171057 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.171059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3721133b-3593-4bbe-81c5-54721da8df09-tls-certs\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.171242 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.171103    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3721133b-3593-4bbe-81c5-54721da8df09-tmp\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.173456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.173432    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3721133b-3593-4bbe-81c5-54721da8df09-tmp\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.173570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.173545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3721133b-3593-4bbe-81c5-54721da8df09-tls-certs\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.198442 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.198415    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6zxxd"]
Jul 27 19:10:34.200918 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.200904    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:34.203826 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.203785    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vd7hk\""
Jul 27 19:10:34.203930 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.203911    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 19:10:34.204446 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.204427    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fwbm\" (UniqueName: \"kubernetes.io/projected/3721133b-3593-4bbe-81c5-54721da8df09-kube-api-access-5fwbm\") pod \"kube-auth-proxy-5dd59b47cf-nbqnw\" (UID: \"3721133b-3593-4bbe-81c5-54721da8df09\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.216681 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.216658    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6zxxd"]
Jul 27 19:10:34.282937 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.282863    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"
Jul 27 19:10:34.372481 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.372443    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78cls\" (UniqueName: \"kubernetes.io/projected/3ca466e8-37d0-4c65-a989-0091b37535a7-kube-api-access-78cls\") pod \"odh-model-controller-7998c67dc4-6zxxd\" (UID: \"3ca466e8-37d0-4c65-a989-0091b37535a7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:34.372640 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.372618    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ca466e8-37d0-4c65-a989-0091b37535a7-cert\") pod \"odh-model-controller-7998c67dc4-6zxxd\" (UID: \"3ca466e8-37d0-4c65-a989-0091b37535a7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:34.432649 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.432623    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw"]
Jul 27 19:10:34.433855 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:10:34.433831    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3721133b_3593_4bbe_81c5_54721da8df09.slice/crio-1e6a8b9944e9079ef8c943d748db8753660d0ebd8dc908297f15808324469fd3 WatchSource:0}: Error finding container 1e6a8b9944e9079ef8c943d748db8753660d0ebd8dc908297f15808324469fd3: Status 404 returned error can't find the container with id 1e6a8b9944e9079ef8c943d748db8753660d0ebd8dc908297f15808324469fd3
Jul 27 19:10:34.452839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.452789    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw" event={"ID":"3721133b-3593-4bbe-81c5-54721da8df09","Type":"ContainerStarted","Data":"1e6a8b9944e9079ef8c943d748db8753660d0ebd8dc908297f15808324469fd3"}
Jul 27 19:10:34.473176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.473154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ca466e8-37d0-4c65-a989-0091b37535a7-cert\") pod \"odh-model-controller-7998c67dc4-6zxxd\" (UID: \"3ca466e8-37d0-4c65-a989-0091b37535a7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:34.473276 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.473196    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78cls\" (UniqueName: \"kubernetes.io/projected/3ca466e8-37d0-4c65-a989-0091b37535a7-kube-api-access-78cls\") pod \"odh-model-controller-7998c67dc4-6zxxd\" (UID: \"3ca466e8-37d0-4c65-a989-0091b37535a7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:34.475695 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.475672    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ca466e8-37d0-4c65-a989-0091b37535a7-cert\") pod \"odh-model-controller-7998c67dc4-6zxxd\" (UID: \"3ca466e8-37d0-4c65-a989-0091b37535a7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:34.486716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.486690    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78cls\" (UniqueName: \"kubernetes.io/projected/3ca466e8-37d0-4c65-a989-0091b37535a7-kube-api-access-78cls\") pod \"odh-model-controller-7998c67dc4-6zxxd\" (UID: \"3ca466e8-37d0-4c65-a989-0091b37535a7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:34.519587 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.519561    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:34.670969 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:34.670935    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6zxxd"]
Jul 27 19:10:34.674215 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:10:34.674190    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca466e8_37d0_4c65_a989_0091b37535a7.slice/crio-adad4345b48b14b42881deff085fe0a0455972f3320c43940d15b406e01b6837 WatchSource:0}: Error finding container adad4345b48b14b42881deff085fe0a0455972f3320c43940d15b406e01b6837: Status 404 returned error can't find the container with id adad4345b48b14b42881deff085fe0a0455972f3320c43940d15b406e01b6837
Jul 27 19:10:35.465089 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.465011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd" event={"ID":"3ca466e8-37d0-4c65-a989-0091b37535a7","Type":"ContainerStarted","Data":"adad4345b48b14b42881deff085fe0a0455972f3320c43940d15b406e01b6837"}
Jul 27 19:10:35.570289 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.570252    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"]
Jul 27 19:10:35.593012 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.592496    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"]
Jul 27 19:10:35.593012 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.592673    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.596022 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.595524    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p6fq9\""
Jul 27 19:10:35.596022 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.595800    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 19:10:35.596022 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.595850    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 19:10:35.596336 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.596046    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 19:10:35.596336 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.596209    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 19:10:35.788169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.788076    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkwkk\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-kube-api-access-qkwkk\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.788169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.788130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.788403 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.788195    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.788403 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.788282    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.788403 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.788379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.788584 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.788418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.788584 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.788453    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.889695 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.889659    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.889922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.889721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.889922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.889791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.889922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.889881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.890175 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.890150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.890277 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.890191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.890337 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.890285    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkwkk\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-kube-api-access-qkwkk\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.890432 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.890408    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.893852 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.893798    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.893972 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.893910    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.895736 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.895693    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.896379 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.896357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.900344 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.900321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkwkk\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-kube-api-access-qkwkk\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.900682 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.900660    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hc7jb\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:35.907743 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:35.907677    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:36.073799 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:36.073651    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"]
Jul 27 19:10:36.076599 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:10:36.076559    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad0ec54_7f6b_4c96_9def_8ab953c9469d.slice/crio-18e3ad26a80449d31dfdec63d5efaac0b41eeb0663a9cec47049752be88b9c49 WatchSource:0}: Error finding container 18e3ad26a80449d31dfdec63d5efaac0b41eeb0663a9cec47049752be88b9c49: Status 404 returned error can't find the container with id 18e3ad26a80449d31dfdec63d5efaac0b41eeb0663a9cec47049752be88b9c49
Jul 27 19:10:36.474206 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:36.474166    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb" event={"ID":"1ad0ec54-7f6b-4c96-9def-8ab953c9469d","Type":"ContainerStarted","Data":"18e3ad26a80449d31dfdec63d5efaac0b41eeb0663a9cec47049752be88b9c49"}
Jul 27 19:10:38.492285 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:38.492244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw" event={"ID":"3721133b-3593-4bbe-81c5-54721da8df09","Type":"ContainerStarted","Data":"f0d02cedc9f30e549eeceb692678daba009b6e1e88040fb0ad863e564a53e860"}
Jul 27 19:10:38.495042 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:38.495011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd" event={"ID":"3ca466e8-37d0-4c65-a989-0091b37535a7","Type":"ContainerStarted","Data":"4f51ba8e37aaf328b8d75682006361842b30ba64d7991dfc6bc56bb671482893"}
Jul 27 19:10:38.495450 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:38.495427    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:38.511790 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:38.511691    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-nbqnw" podStartSLOduration=1.8214888930000002 podStartE2EDuration="5.511670192s" totalImagesPullingTime="3.690181299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:38.510902557 +0000 UTC m=+325.218042064" watchObservedRunningTime="2026-07-27 19:10:38.511670192 +0000 UTC m=+325.218809680"
Jul 27 19:10:38.533631 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:38.533315    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd" podStartSLOduration=1.079294872 podStartE2EDuration="4.533292642s" totalImagesPullingTime="3.45399777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:38.530584027 +0000 UTC m=+325.237723519" watchObservedRunningTime="2026-07-27 19:10:38.533292642 +0000 UTC m=+325.240432134"
Jul 27 19:10:39.946356 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:39.946323    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:10:39.946617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:39.946388    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:10:40.509244 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:40.509214    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb" event={"ID":"1ad0ec54-7f6b-4c96-9def-8ab953c9469d","Type":"ContainerStarted","Data":"33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736"}
Jul 27 19:10:40.509411 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:40.509332    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:40.530739 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:40.530698    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb" podStartSLOduration=1.663952952 podStartE2EDuration="5.530683934s" totalImagesPullingTime="3.866730982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:40.528606213 +0000 UTC m=+327.235745719" watchObservedRunningTime="2026-07-27 19:10:40.530683934 +0000 UTC m=+327.237823424"
Jul 27 19:10:41.516451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:41.516419    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:42.002856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.002822    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"]
Jul 27 19:10:42.005337 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.005319    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.028564 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.028534    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"]
Jul 27 19:10:42.040510 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.040484    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prm65\" (UniqueName: \"kubernetes.io/projected/1236f2fb-ebba-4d24-b16b-c9317418de00-kube-api-access-prm65\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.040640 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.040542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.040640 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.040581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.040640 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.040615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.040896 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.040688    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1236f2fb-ebba-4d24-b16b-c9317418de00-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.040896 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.040757    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.040896 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.040834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.141368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.141339    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1236f2fb-ebba-4d24-b16b-c9317418de00-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.141509 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.141393    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.141509 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.141415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.141509 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.141440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prm65\" (UniqueName: \"kubernetes.io/projected/1236f2fb-ebba-4d24-b16b-c9317418de00-kube-api-access-prm65\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.141509 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.141469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.141509 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.141490    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.141753 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.141519    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.142259 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.142232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.143910 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.143885    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.144035 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.144013    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.144150 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.144130    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1236f2fb-ebba-4d24-b16b-c9317418de00-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.144188 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.144154    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.150070 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.150046    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1236f2fb-ebba-4d24-b16b-c9317418de00-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.150168 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.150090    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prm65\" (UniqueName: \"kubernetes.io/projected/1236f2fb-ebba-4d24-b16b-c9317418de00-kube-api-access-prm65\") pod \"istiod-openshift-gateway-5677ccb49b-k22wq\" (UID: \"1236f2fb-ebba-4d24-b16b-c9317418de00\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.315077 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.314997    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:42.464753 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.464730    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"]
Jul 27 19:10:42.466729 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:10:42.466700    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1236f2fb_ebba_4d24_b16b_c9317418de00.slice/crio-7df2f7a93950d48250e7163b734f44e50c65a45a5509613e148630040f76262a WatchSource:0}: Error finding container 7df2f7a93950d48250e7163b734f44e50c65a45a5509613e148630040f76262a: Status 404 returned error can't find the container with id 7df2f7a93950d48250e7163b734f44e50c65a45a5509613e148630040f76262a
Jul 27 19:10:42.469906 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.469870    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:10:42.470028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.469933    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:10:42.521972 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:42.521950    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq" event={"ID":"1236f2fb-ebba-4d24-b16b-c9317418de00","Type":"ContainerStarted","Data":"7df2f7a93950d48250e7163b734f44e50c65a45a5509613e148630040f76262a"}
Jul 27 19:10:43.528265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.528223    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq" event={"ID":"1236f2fb-ebba-4d24-b16b-c9317418de00","Type":"ContainerStarted","Data":"31856a7bfe861736157d7a467d2abd81fecab284760aa068e66d53b08dfe72b9"}
Jul 27 19:10:43.528699 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.528290    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:43.530102 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.530082    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq"
Jul 27 19:10:43.556218 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.556172    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k22wq" podStartSLOduration=2.5561587279999998 podStartE2EDuration="2.556158728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:43.553863844 +0000 UTC m=+330.261003339" watchObservedRunningTime="2026-07-27 19:10:43.556158728 +0000 UTC m=+330.263298218"
Jul 27 19:10:43.612595 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.612563    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"]
Jul 27 19:10:43.612854 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.612784    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb" podUID="1ad0ec54-7f6b-4c96-9def-8ab953c9469d" containerName="discovery" containerID="cri-o://33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736" gracePeriod=30
Jul 27 19:10:43.859396 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.859365    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:43.956644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.956611    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-kubeconfig\") pod \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") "
Jul 27 19:10:43.956644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.956650    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkwkk\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-kube-api-access-qkwkk\") pod \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") "
Jul 27 19:10:43.956905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.956667    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-local-certs\") pod \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") "
Jul 27 19:10:43.956905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.956691    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-cacerts\") pod \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") "
Jul 27 19:10:43.956905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.956715    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-dns-cert\") pod \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") "
Jul 27 19:10:43.956905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.956739    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-token\") pod \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") "
Jul 27 19:10:43.956905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.956845    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-ca-configmap\") pod \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\" (UID: \"1ad0ec54-7f6b-4c96-9def-8ab953c9469d\") "
Jul 27 19:10:43.957701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.957666    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1ad0ec54-7f6b-4c96-9def-8ab953c9469d" (UID: "1ad0ec54-7f6b-4c96-9def-8ab953c9469d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:10:43.959273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.959227    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1ad0ec54-7f6b-4c96-9def-8ab953c9469d" (UID: "1ad0ec54-7f6b-4c96-9def-8ab953c9469d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:10:43.959395 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.959295    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1ad0ec54-7f6b-4c96-9def-8ab953c9469d" (UID: "1ad0ec54-7f6b-4c96-9def-8ab953c9469d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:10:43.959564 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.959540    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-local-certs" (OuterVolumeSpecName: "local-certs") pod "1ad0ec54-7f6b-4c96-9def-8ab953c9469d" (UID: "1ad0ec54-7f6b-4c96-9def-8ab953c9469d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:10:43.959674 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.959566    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-kube-api-access-qkwkk" (OuterVolumeSpecName: "kube-api-access-qkwkk") pod "1ad0ec54-7f6b-4c96-9def-8ab953c9469d" (UID: "1ad0ec54-7f6b-4c96-9def-8ab953c9469d"). InnerVolumeSpecName "kube-api-access-qkwkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:10:43.959674 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.959591    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-cacerts" (OuterVolumeSpecName: "cacerts") pod "1ad0ec54-7f6b-4c96-9def-8ab953c9469d" (UID: "1ad0ec54-7f6b-4c96-9def-8ab953c9469d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:10:43.959758 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:43.959673    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ad0ec54-7f6b-4c96-9def-8ab953c9469d" (UID: "1ad0ec54-7f6b-4c96-9def-8ab953c9469d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:10:44.058172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.058140    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkwkk\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-kube-api-access-qkwkk\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:44.058172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.058164    2557 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-local-certs\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:44.058172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.058175    2557 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-cacerts\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:44.058172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.058183    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-dns-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:44.058412 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.058191    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:44.058412 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.058199    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-csr-ca-configmap\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:44.058412 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.058208    2557 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad0ec54-7f6b-4c96-9def-8ab953c9469d-istio-kubeconfig\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:10:44.536393 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.536363    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ad0ec54-7f6b-4c96-9def-8ab953c9469d" containerID="33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736" exitCode=0
Jul 27 19:10:44.536864 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.536429    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"
Jul 27 19:10:44.536864 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.536462    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb" event={"ID":"1ad0ec54-7f6b-4c96-9def-8ab953c9469d","Type":"ContainerDied","Data":"33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736"}
Jul 27 19:10:44.536864 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.536534    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb" event={"ID":"1ad0ec54-7f6b-4c96-9def-8ab953c9469d","Type":"ContainerDied","Data":"18e3ad26a80449d31dfdec63d5efaac0b41eeb0663a9cec47049752be88b9c49"}
Jul 27 19:10:44.536864 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.536560    2557 scope.go:117] "RemoveContainer" containerID="33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736"
Jul 27 19:10:44.546060 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.546045    2557 scope.go:117] "RemoveContainer" containerID="33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736"
Jul 27 19:10:44.546311 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:10:44.546283    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736\": container with ID starting with 33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736 not found: ID does not exist" containerID="33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736"
Jul 27 19:10:44.546389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.546310    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736"} err="failed to get container status \"33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736\": rpc error: code = NotFound desc = could not find container \"33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736\": container with ID starting with 33de23d14b139ff7434515aaf5dca0fc1968cb4fa5b37272ad545270b5d91736 not found: ID does not exist"
Jul 27 19:10:44.566773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.566749    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"]
Jul 27 19:10:44.573732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:44.573707    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hc7jb"]
Jul 27 19:10:45.089296 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.089261    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"]
Jul 27 19:10:45.089658 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.089645    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad0ec54-7f6b-4c96-9def-8ab953c9469d" containerName="discovery"
Jul 27 19:10:45.089718 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.089660    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad0ec54-7f6b-4c96-9def-8ab953c9469d" containerName="discovery"
Jul 27 19:10:45.089759 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.089733    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad0ec54-7f6b-4c96-9def-8ab953c9469d" containerName="discovery"
Jul 27 19:10:45.092759 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.092742    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:45.096362 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.096340    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 19:10:45.096648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.096634    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6gkbd\""
Jul 27 19:10:45.109277 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.109257    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"]
Jul 27 19:10:45.168114 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.168086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3808157f-f65a-48eb-b595-3ca7ad156c37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m4sn9\" (UID: \"3808157f-f65a-48eb-b595-3ca7ad156c37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:45.168260 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.168128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4q2f\" (UniqueName: \"kubernetes.io/projected/3808157f-f65a-48eb-b595-3ca7ad156c37-kube-api-access-q4q2f\") pod \"llmisvc-controller-manager-777c6bd7d5-m4sn9\" (UID: \"3808157f-f65a-48eb-b595-3ca7ad156c37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:45.269500 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.269464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3808157f-f65a-48eb-b595-3ca7ad156c37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m4sn9\" (UID: \"3808157f-f65a-48eb-b595-3ca7ad156c37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:45.269664 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.269516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4q2f\" (UniqueName: \"kubernetes.io/projected/3808157f-f65a-48eb-b595-3ca7ad156c37-kube-api-access-q4q2f\") pod \"llmisvc-controller-manager-777c6bd7d5-m4sn9\" (UID: \"3808157f-f65a-48eb-b595-3ca7ad156c37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:45.269664 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:10:45.269642    2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 27 19:10:45.269737 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:10:45.269707    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3808157f-f65a-48eb-b595-3ca7ad156c37-cert podName:3808157f-f65a-48eb-b595-3ca7ad156c37 nodeName:}" failed. No retries permitted until 2026-07-27 19:10:45.769688471 +0000 UTC m=+332.476827954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3808157f-f65a-48eb-b595-3ca7ad156c37-cert") pod "llmisvc-controller-manager-777c6bd7d5-m4sn9" (UID: "3808157f-f65a-48eb-b595-3ca7ad156c37") : secret "llmisvc-webhook-server-cert" not found
Jul 27 19:10:45.284292 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.284255    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4q2f\" (UniqueName: \"kubernetes.io/projected/3808157f-f65a-48eb-b595-3ca7ad156c37-kube-api-access-q4q2f\") pod \"llmisvc-controller-manager-777c6bd7d5-m4sn9\" (UID: \"3808157f-f65a-48eb-b595-3ca7ad156c37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:45.775588 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.775552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3808157f-f65a-48eb-b595-3ca7ad156c37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m4sn9\" (UID: \"3808157f-f65a-48eb-b595-3ca7ad156c37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:45.778095 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.778059    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3808157f-f65a-48eb-b595-3ca7ad156c37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m4sn9\" (UID: \"3808157f-f65a-48eb-b595-3ca7ad156c37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:45.790660 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:45.790636    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad0ec54-7f6b-4c96-9def-8ab953c9469d" path="/var/lib/kubelet/pods/1ad0ec54-7f6b-4c96-9def-8ab953c9469d/volumes"
Jul 27 19:10:46.001869 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:46.001836    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:46.150390 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:46.150363    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"]
Jul 27 19:10:46.151745 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:10:46.151716    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3808157f_f65a_48eb_b595_3ca7ad156c37.slice/crio-83e472b8c4313aae7f9cd6287dd4775a5fb466064989775d758109904583022e WatchSource:0}: Error finding container 83e472b8c4313aae7f9cd6287dd4775a5fb466064989775d758109904583022e: Status 404 returned error can't find the container with id 83e472b8c4313aae7f9cd6287dd4775a5fb466064989775d758109904583022e
Jul 27 19:10:46.550448 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:46.550399    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9" event={"ID":"3808157f-f65a-48eb-b595-3ca7ad156c37","Type":"ContainerStarted","Data":"83e472b8c4313aae7f9cd6287dd4775a5fb466064989775d758109904583022e"}
Jul 27 19:10:49.502968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:49.502931    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6zxxd"
Jul 27 19:10:51.578126 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:51.578090    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9" event={"ID":"3808157f-f65a-48eb-b595-3ca7ad156c37","Type":"ContainerStarted","Data":"4f39787aa868baac7f039d122922dd5a864bd225d74f4d99a4e6d01c6fecaf87"}
Jul 27 19:10:51.578610 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:51.578180    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:10:51.595079 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:10:51.595034    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9" podStartSLOduration=2.237795297 podStartE2EDuration="6.595020465s" totalImagesPullingTime="4.357225168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:51.594166024 +0000 UTC m=+338.301305516" watchObservedRunningTime="2026-07-27 19:10:51.595020465 +0000 UTC m=+338.302159956"
Jul 27 19:11:22.585204 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:22.585166    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4sn9"
Jul 27 19:11:34.977272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:34.977234    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6p58m"]
Jul 27 19:11:34.980596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:34.980564    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6p58m"
Jul 27 19:11:34.983591 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:34.983564    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:11:34.984722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:34.984700    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:11:34.984851 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:34.984756    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2mlls\""
Jul 27 19:11:34.992331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:34.992308    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6p58m"]
Jul 27 19:11:34.995164 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:34.995141    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nsb8\" (UniqueName: \"kubernetes.io/projected/045ee576-cb9f-49b6-832e-b792300a5def-kube-api-access-6nsb8\") pod \"kuadrant-operator-catalog-6p58m\" (UID: \"045ee576-cb9f-49b6-832e-b792300a5def\") " pod="kuadrant-system/kuadrant-operator-catalog-6p58m"
Jul 27 19:11:35.096155 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.096124    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nsb8\" (UniqueName: \"kubernetes.io/projected/045ee576-cb9f-49b6-832e-b792300a5def-kube-api-access-6nsb8\") pod \"kuadrant-operator-catalog-6p58m\" (UID: \"045ee576-cb9f-49b6-832e-b792300a5def\") " pod="kuadrant-system/kuadrant-operator-catalog-6p58m"
Jul 27 19:11:35.104205 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.104173    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nsb8\" (UniqueName: \"kubernetes.io/projected/045ee576-cb9f-49b6-832e-b792300a5def-kube-api-access-6nsb8\") pod \"kuadrant-operator-catalog-6p58m\" (UID: \"045ee576-cb9f-49b6-832e-b792300a5def\") " pod="kuadrant-system/kuadrant-operator-catalog-6p58m"
Jul 27 19:11:35.292070 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.291977    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6p58m"
Jul 27 19:11:35.348339 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.348304    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6p58m"]
Jul 27 19:11:35.424514 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.424490    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6p58m"]
Jul 27 19:11:35.426630 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:11:35.426605    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045ee576_cb9f_49b6_832e_b792300a5def.slice/crio-1cc104974fc4367bb7a81786eb5e98750bd4e01383a90d537526da99e239eee7 WatchSource:0}: Error finding container 1cc104974fc4367bb7a81786eb5e98750bd4e01383a90d537526da99e239eee7: Status 404 returned error can't find the container with id 1cc104974fc4367bb7a81786eb5e98750bd4e01383a90d537526da99e239eee7
Jul 27 19:11:35.555781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.555713    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fl264"]
Jul 27 19:11:35.560182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.560166    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:35.566066 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.566034    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fl264"]
Jul 27 19:11:35.601963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.601937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq2sj\" (UniqueName: \"kubernetes.io/projected/7a879a55-e1d2-466d-b695-babc997a4bc3-kube-api-access-qq2sj\") pod \"kuadrant-operator-catalog-fl264\" (UID: \"7a879a55-e1d2-466d-b695-babc997a4bc3\") " pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:35.702738 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.702708    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq2sj\" (UniqueName: \"kubernetes.io/projected/7a879a55-e1d2-466d-b695-babc997a4bc3-kube-api-access-qq2sj\") pod \"kuadrant-operator-catalog-fl264\" (UID: \"7a879a55-e1d2-466d-b695-babc997a4bc3\") " pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:35.710654 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.710626    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq2sj\" (UniqueName: \"kubernetes.io/projected/7a879a55-e1d2-466d-b695-babc997a4bc3-kube-api-access-qq2sj\") pod \"kuadrant-operator-catalog-fl264\" (UID: \"7a879a55-e1d2-466d-b695-babc997a4bc3\") " pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:35.801573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.801542    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6p58m" event={"ID":"045ee576-cb9f-49b6-832e-b792300a5def","Type":"ContainerStarted","Data":"1cc104974fc4367bb7a81786eb5e98750bd4e01383a90d537526da99e239eee7"}
Jul 27 19:11:35.870691 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:35.870610    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:36.017866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:36.017843    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fl264"]
Jul 27 19:11:36.019940 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:11:36.019914    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a879a55_e1d2_466d_b695_babc997a4bc3.slice/crio-5e02f67ddb8ee5564334f7f39022bb00c6ae6bed11a727ec4cb8dd8b38716e3d WatchSource:0}: Error finding container 5e02f67ddb8ee5564334f7f39022bb00c6ae6bed11a727ec4cb8dd8b38716e3d: Status 404 returned error can't find the container with id 5e02f67ddb8ee5564334f7f39022bb00c6ae6bed11a727ec4cb8dd8b38716e3d
Jul 27 19:11:36.808782 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:36.808750    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fl264" event={"ID":"7a879a55-e1d2-466d-b695-babc997a4bc3","Type":"ContainerStarted","Data":"5e02f67ddb8ee5564334f7f39022bb00c6ae6bed11a727ec4cb8dd8b38716e3d"}
Jul 27 19:11:37.816430 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:37.816387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fl264" event={"ID":"7a879a55-e1d2-466d-b695-babc997a4bc3","Type":"ContainerStarted","Data":"014450bef4e089cabc3cb63ed92deb44244ba67f7dfacc7338ec487490ea9f75"}
Jul 27 19:11:37.818609 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:37.818132    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6p58m" event={"ID":"045ee576-cb9f-49b6-832e-b792300a5def","Type":"ContainerStarted","Data":"8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310"}
Jul 27 19:11:37.818609 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:37.818267    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6p58m" podUID="045ee576-cb9f-49b6-832e-b792300a5def" containerName="registry-server" containerID="cri-o://8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310" gracePeriod=2
Jul 27 19:11:37.832593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:37.832540    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fl264" podStartSLOduration=1.171276242 podStartE2EDuration="2.832520738s" totalImagesPullingTime="1.661244496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:37.831064637 +0000 UTC m=+384.538204129" watchObservedRunningTime="2026-07-27 19:11:37.832520738 +0000 UTC m=+384.539660231"
Jul 27 19:11:37.847350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:37.847299    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6p58m" podStartSLOduration=1.595570148 podStartE2EDuration="3.847283608s" totalImagesPullingTime="2.25171346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:37.845229882 +0000 UTC m=+384.552369374" watchObservedRunningTime="2026-07-27 19:11:37.847283608 +0000 UTC m=+384.554423099"
Jul 27 19:11:38.070066 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.070042    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6p58m_045ee576-cb9f-49b6-832e-b792300a5def/registry-server/0.log"
Jul 27 19:11:38.072302 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.072284    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6p58m"
Jul 27 19:11:38.125070 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.125044    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nsb8\" (UniqueName: \"kubernetes.io/projected/045ee576-cb9f-49b6-832e-b792300a5def-kube-api-access-6nsb8\") pod \"045ee576-cb9f-49b6-832e-b792300a5def\" (UID: \"045ee576-cb9f-49b6-832e-b792300a5def\") "
Jul 27 19:11:38.127335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.127310    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045ee576-cb9f-49b6-832e-b792300a5def-kube-api-access-6nsb8" (OuterVolumeSpecName: "kube-api-access-6nsb8") pod "045ee576-cb9f-49b6-832e-b792300a5def" (UID: "045ee576-cb9f-49b6-832e-b792300a5def"). InnerVolumeSpecName "kube-api-access-6nsb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:38.226321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.226251    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nsb8\" (UniqueName: \"kubernetes.io/projected/045ee576-cb9f-49b6-832e-b792300a5def-kube-api-access-6nsb8\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:38.824107 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.824077    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6p58m_045ee576-cb9f-49b6-832e-b792300a5def/registry-server/0.log"
Jul 27 19:11:38.824554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.824118    2557 generic.go:356] "Generic (PLEG): container finished" podID="045ee576-cb9f-49b6-832e-b792300a5def" containerID="8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310" exitCode=1
Jul 27 19:11:38.824554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.824194    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6p58m"
Jul 27 19:11:38.824554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.824209    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6p58m" event={"ID":"045ee576-cb9f-49b6-832e-b792300a5def","Type":"ContainerDied","Data":"8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310"}
Jul 27 19:11:38.824554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.824259    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6p58m" event={"ID":"045ee576-cb9f-49b6-832e-b792300a5def","Type":"ContainerDied","Data":"1cc104974fc4367bb7a81786eb5e98750bd4e01383a90d537526da99e239eee7"}
Jul 27 19:11:38.824554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.824278    2557 scope.go:117] "RemoveContainer" containerID="8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310"
Jul 27 19:11:38.833874 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.833859    2557 scope.go:117] "RemoveContainer" containerID="8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310"
Jul 27 19:11:38.834105 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:11:38.834087    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310\": container with ID starting with 8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310 not found: ID does not exist" containerID="8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310"
Jul 27 19:11:38.834151 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.834113    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310"} err="failed to get container status \"8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310\": rpc error: code = NotFound desc = could not find container \"8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310\": container with ID starting with 8f2a75f1498b31183bf3a949da57b58ea13c174a76ae138740a17ad56dc10310 not found: ID does not exist"
Jul 27 19:11:38.845385 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.845365    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6p58m"]
Jul 27 19:11:38.847319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:38.847296    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6p58m"]
Jul 27 19:11:39.789935 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:39.789906    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045ee576-cb9f-49b6-832e-b792300a5def" path="/var/lib/kubelet/pods/045ee576-cb9f-49b6-832e-b792300a5def/volumes"
Jul 27 19:11:45.871620 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:45.871585    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:45.872148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:45.871634    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:45.892924 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:45.892896    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:46.886164 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:46.886137    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fl264"
Jul 27 19:11:50.394188 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.394156    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"]
Jul 27 19:11:50.394546 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.394529    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="045ee576-cb9f-49b6-832e-b792300a5def" containerName="registry-server"
Jul 27 19:11:50.394546 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.394540    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="045ee576-cb9f-49b6-832e-b792300a5def" containerName="registry-server"
Jul 27 19:11:50.394616 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.394594    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="045ee576-cb9f-49b6-832e-b792300a5def" containerName="registry-server"
Jul 27 19:11:50.399055 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.399040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.401958 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.401940    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sqrg8\""
Jul 27 19:11:50.408345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.408323    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"]
Jul 27 19:11:50.528883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.528853    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qzf\" (UniqueName: \"kubernetes.io/projected/f85c885a-eb46-4bfc-80ef-a2def0fdd015-kube-api-access-q5qzf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.529014 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.528910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.529014 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.529003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.630295 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.630272    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.630405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.630315    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qzf\" (UniqueName: \"kubernetes.io/projected/f85c885a-eb46-4bfc-80ef-a2def0fdd015-kube-api-access-q5qzf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.630405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.630379    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.630708 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.630684    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.630749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.630693    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.638963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.638939    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qzf\" (UniqueName: \"kubernetes.io/projected/f85c885a-eb46-4bfc-80ef-a2def0fdd015-kube-api-access-q5qzf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.708886 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.708853    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:50.845029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.844973    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"]
Jul 27 19:11:50.847479 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:11:50.847455    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85c885a_eb46_4bfc_80ef_a2def0fdd015.slice/crio-169314b8a3e61972f7eb4babd8b00ad5a09eab00704f3a3d0cc6f5955f47b181 WatchSource:0}: Error finding container 169314b8a3e61972f7eb4babd8b00ad5a09eab00704f3a3d0cc6f5955f47b181: Status 404 returned error can't find the container with id 169314b8a3e61972f7eb4babd8b00ad5a09eab00704f3a3d0cc6f5955f47b181
Jul 27 19:11:50.885967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.885944    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr" event={"ID":"f85c885a-eb46-4bfc-80ef-a2def0fdd015","Type":"ContainerStarted","Data":"169314b8a3e61972f7eb4babd8b00ad5a09eab00704f3a3d0cc6f5955f47b181"}
Jul 27 19:11:50.991125 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.991057    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"]
Jul 27 19:11:50.994678 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:50.994648    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.003030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.002994    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"]
Jul 27 19:11:51.033860 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.033830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.033860 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.033858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.034048 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.033882    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwdds\" (UniqueName: \"kubernetes.io/projected/a078f27a-3b79-470c-a48c-9c1080c47dce-kube-api-access-kwdds\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.135344 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.135309    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwdds\" (UniqueName: \"kubernetes.io/projected/a078f27a-3b79-470c-a48c-9c1080c47dce-kube-api-access-kwdds\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.135466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.135410    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.135466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.135428    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.135734 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.135719    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.135781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.135762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.144307 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.144279    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwdds\" (UniqueName: \"kubernetes.io/projected/a078f27a-3b79-470c-a48c-9c1080c47dce-kube-api-access-kwdds\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.304931 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.304848    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:51.398246 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.398213    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"]
Jul 27 19:11:51.403899 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.403880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.412484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.411228    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"]
Jul 27 19:11:51.443638 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.443615    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"]
Jul 27 19:11:51.445506 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:11:51.445483    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda078f27a_3b79_470c_a48c_9c1080c47dce.slice/crio-3b261efdebdb8bad3284bf5b5d742a6a29a057406c51a5b154acd50cdbcd5540 WatchSource:0}: Error finding container 3b261efdebdb8bad3284bf5b5d742a6a29a057406c51a5b154acd50cdbcd5540: Status 404 returned error can't find the container with id 3b261efdebdb8bad3284bf5b5d742a6a29a057406c51a5b154acd50cdbcd5540
Jul 27 19:11:51.539083 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.539051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkkdg\" (UniqueName: \"kubernetes.io/projected/2e3d6089-231f-4093-a237-30f83d92e80f-kube-api-access-vkkdg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.539224 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.539110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.539224 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.539156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.640470 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.640404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.640470 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.640444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.640674 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.640521    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkkdg\" (UniqueName: \"kubernetes.io/projected/2e3d6089-231f-4093-a237-30f83d92e80f-kube-api-access-vkkdg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.640862 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.640842    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.640931 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.640851    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.650322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.650294    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkkdg\" (UniqueName: \"kubernetes.io/projected/2e3d6089-231f-4093-a237-30f83d92e80f-kube-api-access-vkkdg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.716324 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.716299    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:51.803896 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.803684    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"]
Jul 27 19:11:51.808940 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.808920    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:51.817076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.817048    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"]
Jul 27 19:11:51.856361 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.856335    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"]
Jul 27 19:11:51.858137 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:11:51.858100    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3d6089_231f_4093_a237_30f83d92e80f.slice/crio-00c577625911e360eca8c6882585a88e9889d587d7c0b98d75fe477c09155b00 WatchSource:0}: Error finding container 00c577625911e360eca8c6882585a88e9889d587d7c0b98d75fe477c09155b00: Status 404 returned error can't find the container with id 00c577625911e360eca8c6882585a88e9889d587d7c0b98d75fe477c09155b00
Jul 27 19:11:51.892217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.892159    2557 generic.go:356] "Generic (PLEG): container finished" podID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerID="4e469c55b9a28fd0be43830d6b5d808c877af3d37b3d340d03e53172666242f2" exitCode=0
Jul 27 19:11:51.892304 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.892235    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr" event={"ID":"f85c885a-eb46-4bfc-80ef-a2def0fdd015","Type":"ContainerDied","Data":"4e469c55b9a28fd0be43830d6b5d808c877af3d37b3d340d03e53172666242f2"}
Jul 27 19:11:51.893513 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.893489    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng" event={"ID":"2e3d6089-231f-4093-a237-30f83d92e80f","Type":"ContainerStarted","Data":"00c577625911e360eca8c6882585a88e9889d587d7c0b98d75fe477c09155b00"}
Jul 27 19:11:51.895262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.895172    2557 generic.go:356] "Generic (PLEG): container finished" podID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerID="b1be333329e1bd7a64b676bc6df94b437f03f1cec4ef5b330fc25d309fd74f7c" exitCode=0
Jul 27 19:11:51.895333 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.895276    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx" event={"ID":"a078f27a-3b79-470c-a48c-9c1080c47dce","Type":"ContainerDied","Data":"b1be333329e1bd7a64b676bc6df94b437f03f1cec4ef5b330fc25d309fd74f7c"}
Jul 27 19:11:51.895333 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.895313    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx" event={"ID":"a078f27a-3b79-470c-a48c-9c1080c47dce","Type":"ContainerStarted","Data":"3b261efdebdb8bad3284bf5b5d742a6a29a057406c51a5b154acd50cdbcd5540"}
Jul 27 19:11:51.943356 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.943329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:51.943461 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.943393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:51.943522 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:51.943460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9f7f\" (UniqueName: \"kubernetes.io/projected/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-kube-api-access-w9f7f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:52.044289 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.044257    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9f7f\" (UniqueName: \"kubernetes.io/projected/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-kube-api-access-w9f7f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:52.044417 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.044316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:52.044417 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.044349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:52.044661 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.044644    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:52.044697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.044652    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:52.055437 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.055414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9f7f\" (UniqueName: \"kubernetes.io/projected/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-kube-api-access-w9f7f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:52.120468 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.120445    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:52.254838 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.253998    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"]
Jul 27 19:11:52.257851 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:11:52.255531    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5b3d8c_cb52_49cb_bfb6_32d1b706cb67.slice/crio-a9445cc53b8a78cd99fad05a14401e9faca9cdf9ced1e66860bd7e6020c2a158 WatchSource:0}: Error finding container a9445cc53b8a78cd99fad05a14401e9faca9cdf9ced1e66860bd7e6020c2a158: Status 404 returned error can't find the container with id a9445cc53b8a78cd99fad05a14401e9faca9cdf9ced1e66860bd7e6020c2a158
Jul 27 19:11:52.902350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.902323    2557 generic.go:356] "Generic (PLEG): container finished" podID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerID="4a92feecc5199c18d22d4add5192a19fa9362f0d84898014d8decc2a112fe732" exitCode=0
Jul 27 19:11:52.902651 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.902403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr" event={"ID":"f85c885a-eb46-4bfc-80ef-a2def0fdd015","Type":"ContainerDied","Data":"4a92feecc5199c18d22d4add5192a19fa9362f0d84898014d8decc2a112fe732"}
Jul 27 19:11:52.903858 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.903836    2557 generic.go:356] "Generic (PLEG): container finished" podID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerID="2b7560d3c8483102a4d686cb94761958de9e6ec943b71af2c57d2daef3a5708b" exitCode=0
Jul 27 19:11:52.903970 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.903940    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7" event={"ID":"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67","Type":"ContainerDied","Data":"2b7560d3c8483102a4d686cb94761958de9e6ec943b71af2c57d2daef3a5708b"}
Jul 27 19:11:52.904040 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.903980    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7" event={"ID":"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67","Type":"ContainerStarted","Data":"a9445cc53b8a78cd99fad05a14401e9faca9cdf9ced1e66860bd7e6020c2a158"}
Jul 27 19:11:52.905505 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.905479    2557 generic.go:356] "Generic (PLEG): container finished" podID="2e3d6089-231f-4093-a237-30f83d92e80f" containerID="24be4283b9ee0800bb1367e5a7c2ff443541b4a9230ac613aab6ab9034a9b902" exitCode=0
Jul 27 19:11:52.905610 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:52.905595    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng" event={"ID":"2e3d6089-231f-4093-a237-30f83d92e80f","Type":"ContainerDied","Data":"24be4283b9ee0800bb1367e5a7c2ff443541b4a9230ac613aab6ab9034a9b902"}
Jul 27 19:11:53.913046 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:53.913017    2557 generic.go:356] "Generic (PLEG): container finished" podID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerID="660abbb1c03da9ec6d6c03b1c0bb422259b233e049038ce6afc788ca2ff61849" exitCode=0
Jul 27 19:11:53.913408 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:53.913089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr" event={"ID":"f85c885a-eb46-4bfc-80ef-a2def0fdd015","Type":"ContainerDied","Data":"660abbb1c03da9ec6d6c03b1c0bb422259b233e049038ce6afc788ca2ff61849"}
Jul 27 19:11:53.915182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:53.915152    2557 generic.go:356] "Generic (PLEG): container finished" podID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerID="41885226ed9d5026f24418e42ac679f9c3a76a2ca60b9cfcdf623f58eef7e36b" exitCode=0
Jul 27 19:11:53.915280 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:53.915222    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7" event={"ID":"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67","Type":"ContainerDied","Data":"41885226ed9d5026f24418e42ac679f9c3a76a2ca60b9cfcdf623f58eef7e36b"}
Jul 27 19:11:53.917140 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:53.917113    2557 generic.go:356] "Generic (PLEG): container finished" podID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerID="22712abc87b177b1f49c589d64bbb6c27b80eacecc6b7de6ae433af39a3e9caf" exitCode=0
Jul 27 19:11:53.917342 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:53.917198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx" event={"ID":"a078f27a-3b79-470c-a48c-9c1080c47dce","Type":"ContainerDied","Data":"22712abc87b177b1f49c589d64bbb6c27b80eacecc6b7de6ae433af39a3e9caf"}
Jul 27 19:11:54.925436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:54.925357    2557 generic.go:356] "Generic (PLEG): container finished" podID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerID="8e1be76ddc56e420d39356a810687666cd3d4b9c6770c98bbf4eb738c95fb744" exitCode=0
Jul 27 19:11:54.925869 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:54.925434    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7" event={"ID":"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67","Type":"ContainerDied","Data":"8e1be76ddc56e420d39356a810687666cd3d4b9c6770c98bbf4eb738c95fb744"}
Jul 27 19:11:54.933939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:54.933911    2557 generic.go:356] "Generic (PLEG): container finished" podID="2e3d6089-231f-4093-a237-30f83d92e80f" containerID="ac47a582954519450594b5ff853af9e4275e3fa2009a88057f780d1eb9075903" exitCode=0
Jul 27 19:11:54.934085 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:54.933998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng" event={"ID":"2e3d6089-231f-4093-a237-30f83d92e80f","Type":"ContainerDied","Data":"ac47a582954519450594b5ff853af9e4275e3fa2009a88057f780d1eb9075903"}
Jul 27 19:11:54.936222 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:54.936202    2557 generic.go:356] "Generic (PLEG): container finished" podID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerID="10e998029245239a71b81210da698525802a73a49ec7c57de560bd7744cfc6f5" exitCode=0
Jul 27 19:11:54.936332 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:54.936281    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx" event={"ID":"a078f27a-3b79-470c-a48c-9c1080c47dce","Type":"ContainerDied","Data":"10e998029245239a71b81210da698525802a73a49ec7c57de560bd7744cfc6f5"}
Jul 27 19:11:55.138931 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.138906    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:55.273491 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.273459    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-bundle\") pod \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") "
Jul 27 19:11:55.273491 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.273494    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-util\") pod \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") "
Jul 27 19:11:55.273744 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.273587    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5qzf\" (UniqueName: \"kubernetes.io/projected/f85c885a-eb46-4bfc-80ef-a2def0fdd015-kube-api-access-q5qzf\") pod \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\" (UID: \"f85c885a-eb46-4bfc-80ef-a2def0fdd015\") "
Jul 27 19:11:55.273978 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.273945    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-bundle" (OuterVolumeSpecName: "bundle") pod "f85c885a-eb46-4bfc-80ef-a2def0fdd015" (UID: "f85c885a-eb46-4bfc-80ef-a2def0fdd015"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:11:55.275885 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.275860    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85c885a-eb46-4bfc-80ef-a2def0fdd015-kube-api-access-q5qzf" (OuterVolumeSpecName: "kube-api-access-q5qzf") pod "f85c885a-eb46-4bfc-80ef-a2def0fdd015" (UID: "f85c885a-eb46-4bfc-80ef-a2def0fdd015"). InnerVolumeSpecName "kube-api-access-q5qzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:55.278744 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.278698    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-util" (OuterVolumeSpecName: "util") pod "f85c885a-eb46-4bfc-80ef-a2def0fdd015" (UID: "f85c885a-eb46-4bfc-80ef-a2def0fdd015"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:11:55.374573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.374540    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5qzf\" (UniqueName: \"kubernetes.io/projected/f85c885a-eb46-4bfc-80ef-a2def0fdd015-kube-api-access-q5qzf\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:55.374573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.374567    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:55.374573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.374575    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f85c885a-eb46-4bfc-80ef-a2def0fdd015-util\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:55.598090 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.597991    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-697bdbd84f-2qfqf"]
Jul 27 19:11:55.598649 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.598622    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerName="extract"
Jul 27 19:11:55.598649 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.598651    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerName="extract"
Jul 27 19:11:55.598875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.598677    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerName="util"
Jul 27 19:11:55.598875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.598686    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerName="util"
Jul 27 19:11:55.598875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.598701    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerName="pull"
Jul 27 19:11:55.598875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.598711    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerName="pull"
Jul 27 19:11:55.598875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.598852    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85c885a-eb46-4bfc-80ef-a2def0fdd015" containerName="extract"
Jul 27 19:11:55.602571 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.602546    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.614904 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.614884    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697bdbd84f-2qfqf"]
Jul 27 19:11:55.677209 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.677174    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-config\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.677209 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.677207    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-oauth-serving-cert\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.677398 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.677229    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-trusted-ca-bundle\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.677398 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.677303    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-serving-cert\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.677398 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.677342    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-service-ca\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.677398 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.677388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcbzh\" (UniqueName: \"kubernetes.io/projected/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-kube-api-access-wcbzh\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.677518 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.677445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-oauth-config\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.778661 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.778622    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-oauth-config\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.778852 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.778675    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-config\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.778852 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.778781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-oauth-serving-cert\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.778852 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.778846    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-trusted-ca-bundle\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.778967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.778902    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-serving-cert\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.778967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.778926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-service-ca\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.779123 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.778974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcbzh\" (UniqueName: \"kubernetes.io/projected/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-kube-api-access-wcbzh\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.779473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.779448    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-config\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.779690 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.779647    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-oauth-serving-cert\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.779802 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.779787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-trusted-ca-bundle\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.779967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.779942    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-service-ca\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.781295 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.781276    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-oauth-config\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.781403 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.781386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-console-serving-cert\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.788636 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.788614    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcbzh\" (UniqueName: \"kubernetes.io/projected/cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c-kube-api-access-wcbzh\") pod \"console-697bdbd84f-2qfqf\" (UID: \"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c\") " pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.912880 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.912788    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:11:55.944172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.944144    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr"
Jul 27 19:11:55.944172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.944157    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr" event={"ID":"f85c885a-eb46-4bfc-80ef-a2def0fdd015","Type":"ContainerDied","Data":"169314b8a3e61972f7eb4babd8b00ad5a09eab00704f3a3d0cc6f5955f47b181"}
Jul 27 19:11:55.944577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.944205    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="169314b8a3e61972f7eb4babd8b00ad5a09eab00704f3a3d0cc6f5955f47b181"
Jul 27 19:11:55.946988 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.946957    2557 generic.go:356] "Generic (PLEG): container finished" podID="2e3d6089-231f-4093-a237-30f83d92e80f" containerID="3c38071f67750130d0016f24570273c0d610fe4603b63d6344faf9cb60be88bb" exitCode=0
Jul 27 19:11:55.947120 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:55.947042    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng" event={"ID":"2e3d6089-231f-4093-a237-30f83d92e80f","Type":"ContainerDied","Data":"3c38071f67750130d0016f24570273c0d610fe4603b63d6344faf9cb60be88bb"}
Jul 27 19:11:56.127911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.127886    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:56.129719 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.129702    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:56.183241 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.183213    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-bundle\") pod \"a078f27a-3b79-470c-a48c-9c1080c47dce\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") "
Jul 27 19:11:56.183426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.183257    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-bundle\") pod \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") "
Jul 27 19:11:56.183426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.183294    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-util\") pod \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") "
Jul 27 19:11:56.183426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.183328    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-util\") pod \"a078f27a-3b79-470c-a48c-9c1080c47dce\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") "
Jul 27 19:11:56.183426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.183408    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9f7f\" (UniqueName: \"kubernetes.io/projected/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-kube-api-access-w9f7f\") pod \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\" (UID: \"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67\") "
Jul 27 19:11:56.183662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.183451    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwdds\" (UniqueName: \"kubernetes.io/projected/a078f27a-3b79-470c-a48c-9c1080c47dce-kube-api-access-kwdds\") pod \"a078f27a-3b79-470c-a48c-9c1080c47dce\" (UID: \"a078f27a-3b79-470c-a48c-9c1080c47dce\") "
Jul 27 19:11:56.184062 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.183871    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-bundle" (OuterVolumeSpecName: "bundle") pod "a078f27a-3b79-470c-a48c-9c1080c47dce" (UID: "a078f27a-3b79-470c-a48c-9c1080c47dce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:11:56.184206 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.184180    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-bundle" (OuterVolumeSpecName: "bundle") pod "db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" (UID: "db5b3d8c-cb52-49cb-bfb6-32d1b706cb67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:11:56.186012 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.185990    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a078f27a-3b79-470c-a48c-9c1080c47dce-kube-api-access-kwdds" (OuterVolumeSpecName: "kube-api-access-kwdds") pod "a078f27a-3b79-470c-a48c-9c1080c47dce" (UID: "a078f27a-3b79-470c-a48c-9c1080c47dce"). InnerVolumeSpecName "kube-api-access-kwdds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:56.192055 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.192014    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-util" (OuterVolumeSpecName: "util") pod "a078f27a-3b79-470c-a48c-9c1080c47dce" (UID: "a078f27a-3b79-470c-a48c-9c1080c47dce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:11:56.192435 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.192418    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-util" (OuterVolumeSpecName: "util") pod "db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" (UID: "db5b3d8c-cb52-49cb-bfb6-32d1b706cb67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:11:56.193562 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.193541    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-kube-api-access-w9f7f" (OuterVolumeSpecName: "kube-api-access-w9f7f") pod "db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" (UID: "db5b3d8c-cb52-49cb-bfb6-32d1b706cb67"). InnerVolumeSpecName "kube-api-access-w9f7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:56.266386 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.266360    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697bdbd84f-2qfqf"]
Jul 27 19:11:56.268566 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:11:56.268539    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf548cb5_3e8a_4d5a_8481_c0a1ec90bb4c.slice/crio-ec48bbd8eabb4bd1ab3622db040c7aebd91ba0fef977b7081d6e1cfcc2ee2906 WatchSource:0}: Error finding container ec48bbd8eabb4bd1ab3622db040c7aebd91ba0fef977b7081d6e1cfcc2ee2906: Status 404 returned error can't find the container with id ec48bbd8eabb4bd1ab3622db040c7aebd91ba0fef977b7081d6e1cfcc2ee2906
Jul 27 19:11:56.285070 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.285053    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-util\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:56.285137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.285073    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9f7f\" (UniqueName: \"kubernetes.io/projected/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-kube-api-access-w9f7f\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:56.285137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.285082    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwdds\" (UniqueName: \"kubernetes.io/projected/a078f27a-3b79-470c-a48c-9c1080c47dce-kube-api-access-kwdds\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:56.285137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.285091    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a078f27a-3b79-470c-a48c-9c1080c47dce-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:56.285137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.285099    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:56.285137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.285107    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db5b3d8c-cb52-49cb-bfb6-32d1b706cb67-util\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:56.955922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.955898    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7"
Jul 27 19:11:56.956351 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.955893    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7" event={"ID":"db5b3d8c-cb52-49cb-bfb6-32d1b706cb67","Type":"ContainerDied","Data":"a9445cc53b8a78cd99fad05a14401e9faca9cdf9ced1e66860bd7e6020c2a158"}
Jul 27 19:11:56.956351 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.956021    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9445cc53b8a78cd99fad05a14401e9faca9cdf9ced1e66860bd7e6020c2a158"
Jul 27 19:11:56.957440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.957416    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697bdbd84f-2qfqf" event={"ID":"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c","Type":"ContainerStarted","Data":"ef074110fcd763888d8f11fa95d159bf6657cebfcee1f386c11f2cbbabc654fb"}
Jul 27 19:11:56.957564 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.957456    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697bdbd84f-2qfqf" event={"ID":"cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c","Type":"ContainerStarted","Data":"ec48bbd8eabb4bd1ab3622db040c7aebd91ba0fef977b7081d6e1cfcc2ee2906"}
Jul 27 19:11:56.959333 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.959314    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx" event={"ID":"a078f27a-3b79-470c-a48c-9c1080c47dce","Type":"ContainerDied","Data":"3b261efdebdb8bad3284bf5b5d742a6a29a057406c51a5b154acd50cdbcd5540"}
Jul 27 19:11:56.959439 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.959353    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b261efdebdb8bad3284bf5b5d742a6a29a057406c51a5b154acd50cdbcd5540"
Jul 27 19:11:56.959439 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.959321    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx"
Jul 27 19:11:56.976543 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:56.976478    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-697bdbd84f-2qfqf" podStartSLOduration=1.976464377 podStartE2EDuration="1.976464377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:56.976025829 +0000 UTC m=+403.683165333" watchObservedRunningTime="2026-07-27 19:11:56.976464377 +0000 UTC m=+403.683603916"
Jul 27 19:11:57.095124 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.095101    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:57.192891 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.192593    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkkdg\" (UniqueName: \"kubernetes.io/projected/2e3d6089-231f-4093-a237-30f83d92e80f-kube-api-access-vkkdg\") pod \"2e3d6089-231f-4093-a237-30f83d92e80f\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") "
Jul 27 19:11:57.193068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.192972    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-bundle\") pod \"2e3d6089-231f-4093-a237-30f83d92e80f\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") "
Jul 27 19:11:57.193068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.193019    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-util\") pod \"2e3d6089-231f-4093-a237-30f83d92e80f\" (UID: \"2e3d6089-231f-4093-a237-30f83d92e80f\") "
Jul 27 19:11:57.193407 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.193378    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-bundle" (OuterVolumeSpecName: "bundle") pod "2e3d6089-231f-4093-a237-30f83d92e80f" (UID: "2e3d6089-231f-4093-a237-30f83d92e80f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:11:57.195062 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.195038    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3d6089-231f-4093-a237-30f83d92e80f-kube-api-access-vkkdg" (OuterVolumeSpecName: "kube-api-access-vkkdg") pod "2e3d6089-231f-4093-a237-30f83d92e80f" (UID: "2e3d6089-231f-4093-a237-30f83d92e80f"). InnerVolumeSpecName "kube-api-access-vkkdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:57.198836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.198816    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-util" (OuterVolumeSpecName: "util") pod "2e3d6089-231f-4093-a237-30f83d92e80f" (UID: "2e3d6089-231f-4093-a237-30f83d92e80f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:11:57.294170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.294136    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkkdg\" (UniqueName: \"kubernetes.io/projected/2e3d6089-231f-4093-a237-30f83d92e80f-kube-api-access-vkkdg\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:57.294170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.294167    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:57.294170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.294177    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e3d6089-231f-4093-a237-30f83d92e80f-util\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:11:57.967023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.966990    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng"
Jul 27 19:11:57.967475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.967021    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng" event={"ID":"2e3d6089-231f-4093-a237-30f83d92e80f","Type":"ContainerDied","Data":"00c577625911e360eca8c6882585a88e9889d587d7c0b98d75fe477c09155b00"}
Jul 27 19:11:57.967475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:11:57.967070    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00c577625911e360eca8c6882585a88e9889d587d7c0b98d75fe477c09155b00"
Jul 27 19:12:05.913296 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:05.913261    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:12:05.913751 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:05.913317    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:12:05.918179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:05.918158    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:12:06.013288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.013263    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-697bdbd84f-2qfqf"
Jul 27 19:12:06.060954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.060922    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665d6b7f88-rv42t"]
Jul 27 19:12:06.370565 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370535    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"]
Jul 27 19:12:06.370930 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370917    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerName="pull"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370932    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerName="pull"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370943    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerName="extract"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370948    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerName="extract"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370954    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerName="extract"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370959    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerName="extract"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370977    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerName="util"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370982    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerName="util"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370987    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3d6089-231f-4093-a237-30f83d92e80f" containerName="util"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.370992    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3d6089-231f-4093-a237-30f83d92e80f" containerName="util"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371007    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerName="util"
Jul 27 19:12:06.371009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371013    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerName="util"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371020    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerName="pull"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371025    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerName="pull"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371033    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3d6089-231f-4093-a237-30f83d92e80f" containerName="pull"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371038    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3d6089-231f-4093-a237-30f83d92e80f" containerName="pull"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371047    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3d6089-231f-4093-a237-30f83d92e80f" containerName="extract"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371052    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3d6089-231f-4093-a237-30f83d92e80f" containerName="extract"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371107    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="db5b3d8c-cb52-49cb-bfb6-32d1b706cb67" containerName="extract"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371116    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3d6089-231f-4093-a237-30f83d92e80f" containerName="extract"
Jul 27 19:12:06.371372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.371124    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a078f27a-3b79-470c-a48c-9c1080c47dce" containerName="extract"
Jul 27 19:12:06.373250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.373234    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"
Jul 27 19:12:06.375985 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.375966    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 19:12:06.376566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.376553    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vbp7j\""
Jul 27 19:12:06.389560 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.389541    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"]
Jul 27 19:12:06.469018 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.468983    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rx4\" (UniqueName: \"kubernetes.io/projected/475507cd-7cc3-47ed-8458-d989dbe5b905-kube-api-access-86rx4\") pod \"dns-operator-controller-manager-864dd78c4c-cvd4s\" (UID: \"475507cd-7cc3-47ed-8458-d989dbe5b905\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"
Jul 27 19:12:06.570134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.570096    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rx4\" (UniqueName: \"kubernetes.io/projected/475507cd-7cc3-47ed-8458-d989dbe5b905-kube-api-access-86rx4\") pod \"dns-operator-controller-manager-864dd78c4c-cvd4s\" (UID: \"475507cd-7cc3-47ed-8458-d989dbe5b905\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"
Jul 27 19:12:06.581222 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.581194    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rx4\" (UniqueName: \"kubernetes.io/projected/475507cd-7cc3-47ed-8458-d989dbe5b905-kube-api-access-86rx4\") pod \"dns-operator-controller-manager-864dd78c4c-cvd4s\" (UID: \"475507cd-7cc3-47ed-8458-d989dbe5b905\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"
Jul 27 19:12:06.683925 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.683892    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"
Jul 27 19:12:06.828675 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:06.828647    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"]
Jul 27 19:12:06.830555 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:12:06.830524    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475507cd_7cc3_47ed_8458_d989dbe5b905.slice/crio-075298d4ac5f1e7469f4e9be78e54007eba818f3c045db4c4a22e2c01188c433 WatchSource:0}: Error finding container 075298d4ac5f1e7469f4e9be78e54007eba818f3c045db4c4a22e2c01188c433: Status 404 returned error can't find the container with id 075298d4ac5f1e7469f4e9be78e54007eba818f3c045db4c4a22e2c01188c433
Jul 27 19:12:07.016652 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:07.016554    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s" event={"ID":"475507cd-7cc3-47ed-8458-d989dbe5b905","Type":"ContainerStarted","Data":"075298d4ac5f1e7469f4e9be78e54007eba818f3c045db4c4a22e2c01188c433"}
Jul 27 19:12:09.029423 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:09.029392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s" event={"ID":"475507cd-7cc3-47ed-8458-d989dbe5b905","Type":"ContainerStarted","Data":"28b4dc95fbbe754843270ce71962150607ba6eb37bea309ec19bdb40f3af00fe"}
Jul 27 19:12:09.029790 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:09.029535    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"
Jul 27 19:12:09.047632 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:09.047550    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s" podStartSLOduration=1.081634411 podStartE2EDuration="3.047535766s" totalImagesPullingTime="1.965901355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:09.046364512 +0000 UTC m=+415.753504004" watchObservedRunningTime="2026-07-27 19:12:09.047535766 +0000 UTC m=+415.754675257"
Jul 27 19:12:11.839154 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:11.839120    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"]
Jul 27 19:12:11.843539 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:11.843519    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:11.846788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:11.846770    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b6r4n\""
Jul 27 19:12:11.875012 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:11.874979    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"]
Jul 27 19:12:11.918685 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:11.918649    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e61a83a9-7c05-48d7-85a1-f958b925ccad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" (UID: \"e61a83a9-7c05-48d7-85a1-f958b925ccad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:11.918866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:11.918730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzs4\" (UniqueName: \"kubernetes.io/projected/e61a83a9-7c05-48d7-85a1-f958b925ccad-kube-api-access-wpzs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" (UID: \"e61a83a9-7c05-48d7-85a1-f958b925ccad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:12.019430 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:12.019400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzs4\" (UniqueName: \"kubernetes.io/projected/e61a83a9-7c05-48d7-85a1-f958b925ccad-kube-api-access-wpzs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" (UID: \"e61a83a9-7c05-48d7-85a1-f958b925ccad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:12.019588 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:12.019470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e61a83a9-7c05-48d7-85a1-f958b925ccad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" (UID: \"e61a83a9-7c05-48d7-85a1-f958b925ccad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:12.019850 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:12.019828    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e61a83a9-7c05-48d7-85a1-f958b925ccad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" (UID: \"e61a83a9-7c05-48d7-85a1-f958b925ccad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:12.028182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:12.028158    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzs4\" (UniqueName: \"kubernetes.io/projected/e61a83a9-7c05-48d7-85a1-f958b925ccad-kube-api-access-wpzs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" (UID: \"e61a83a9-7c05-48d7-85a1-f958b925ccad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:12.153939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:12.153865    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:12.295165 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:12.295138    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"]
Jul 27 19:12:12.297024 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:12:12.296997    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61a83a9_7c05_48d7_85a1_f958b925ccad.slice/crio-9ca50e3079cfe21189a96f302bc00fad2a852dc192ac8c7901447a44953a62f1 WatchSource:0}: Error finding container 9ca50e3079cfe21189a96f302bc00fad2a852dc192ac8c7901447a44953a62f1: Status 404 returned error can't find the container with id 9ca50e3079cfe21189a96f302bc00fad2a852dc192ac8c7901447a44953a62f1
Jul 27 19:12:13.052186 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:13.052156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p" event={"ID":"e61a83a9-7c05-48d7-85a1-f958b925ccad","Type":"ContainerStarted","Data":"9ca50e3079cfe21189a96f302bc00fad2a852dc192ac8c7901447a44953a62f1"}
Jul 27 19:12:19.088976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:19.088936    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p" event={"ID":"e61a83a9-7c05-48d7-85a1-f958b925ccad","Type":"ContainerStarted","Data":"8e851e28f0d15390ea860c55afd25032473b64b90101c728b9e868cbbdb1bda2"}
Jul 27 19:12:19.089403 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:19.089006    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:19.109232 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:19.109188    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p" podStartSLOduration=1.538124404 podStartE2EDuration="8.109174323s" totalImagesPullingTime="6.571049919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:19.106850104 +0000 UTC m=+425.813989595" watchObservedRunningTime="2026-07-27 19:12:19.109174323 +0000 UTC m=+425.816313813"
Jul 27 19:12:20.037496 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:20.037461    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cvd4s"
Jul 27 19:12:30.097219 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:30.097186    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:31.083981 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.083945    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-665d6b7f88-rv42t" podUID="3382ec05-0014-4dc6-9905-da2688909e8a" containerName="console" containerID="cri-o://be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0" gracePeriod=15
Jul 27 19:12:31.261325 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.261294    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"]
Jul 27 19:12:31.264381 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.264360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:31.281946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.281922    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"]
Jul 27 19:12:31.296752 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.296724    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8psfg\" (UniqueName: \"kubernetes.io/projected/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-kube-api-access-8psfg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" (UID: \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:31.296892 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.296830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" (UID: \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:31.334139 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.334087    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:12:31.397770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.397736    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-serving-cert\") pod \"3382ec05-0014-4dc6-9905-da2688909e8a\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") "
Jul 27 19:12:31.397968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.397784    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-trusted-ca-bundle\") pod \"3382ec05-0014-4dc6-9905-da2688909e8a\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") "
Jul 27 19:12:31.397968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.397836    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-console-config\") pod \"3382ec05-0014-4dc6-9905-da2688909e8a\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") "
Jul 27 19:12:31.397968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.397868    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-oauth-config\") pod \"3382ec05-0014-4dc6-9905-da2688909e8a\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") "
Jul 27 19:12:31.397968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.397960    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4hrn\" (UniqueName: \"kubernetes.io/projected/3382ec05-0014-4dc6-9905-da2688909e8a-kube-api-access-v4hrn\") pod \"3382ec05-0014-4dc6-9905-da2688909e8a\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") "
Jul 27 19:12:31.398177 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.397989    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-oauth-serving-cert\") pod \"3382ec05-0014-4dc6-9905-da2688909e8a\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") "
Jul 27 19:12:31.398177 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398018    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-service-ca\") pod \"3382ec05-0014-4dc6-9905-da2688909e8a\" (UID: \"3382ec05-0014-4dc6-9905-da2688909e8a\") "
Jul 27 19:12:31.398382 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398240    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-console-config" (OuterVolumeSpecName: "console-config") pod "3382ec05-0014-4dc6-9905-da2688909e8a" (UID: "3382ec05-0014-4dc6-9905-da2688909e8a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:12:31.398493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398445    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-service-ca" (OuterVolumeSpecName: "service-ca") pod "3382ec05-0014-4dc6-9905-da2688909e8a" (UID: "3382ec05-0014-4dc6-9905-da2688909e8a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:12:31.398493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398466    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3382ec05-0014-4dc6-9905-da2688909e8a" (UID: "3382ec05-0014-4dc6-9905-da2688909e8a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:12:31.398493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398379    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3382ec05-0014-4dc6-9905-da2688909e8a" (UID: "3382ec05-0014-4dc6-9905-da2688909e8a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:12:31.398701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8psfg\" (UniqueName: \"kubernetes.io/projected/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-kube-api-access-8psfg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" (UID: \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:31.398761 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398711    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" (UID: \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:31.398866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398848    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-trusted-ca-bundle\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:31.398936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398873    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-console-config\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:31.398936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398887    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-oauth-serving-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:31.398936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.398918    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3382ec05-0014-4dc6-9905-da2688909e8a-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:31.399137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.399119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" (UID: \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:31.400356 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.400329    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3382ec05-0014-4dc6-9905-da2688909e8a" (UID: "3382ec05-0014-4dc6-9905-da2688909e8a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:12:31.400693 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.400677    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3382ec05-0014-4dc6-9905-da2688909e8a-kube-api-access-v4hrn" (OuterVolumeSpecName: "kube-api-access-v4hrn") pod "3382ec05-0014-4dc6-9905-da2688909e8a" (UID: "3382ec05-0014-4dc6-9905-da2688909e8a"). InnerVolumeSpecName "kube-api-access-v4hrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:12:31.400757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.400687    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3382ec05-0014-4dc6-9905-da2688909e8a" (UID: "3382ec05-0014-4dc6-9905-da2688909e8a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:12:31.406768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.406746    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8psfg\" (UniqueName: \"kubernetes.io/projected/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-kube-api-access-8psfg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" (UID: \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:31.499696 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.499668    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-oauth-config\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:31.499696 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.499692    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4hrn\" (UniqueName: \"kubernetes.io/projected/3382ec05-0014-4dc6-9905-da2688909e8a-kube-api-access-v4hrn\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:31.499696 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.499702    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3382ec05-0014-4dc6-9905-da2688909e8a-console-serving-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:31.575539 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.575506    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:31.717682 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.717658    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"]
Jul 27 19:12:31.719750 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:12:31.719729    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ac5586_1d6c_4e4d_9dee_c95b2c8057e2.slice/crio-a1005fc4b8d3f1b513d31df7626bf79aca6eb23aee954343e9416198bd4d7096 WatchSource:0}: Error finding container a1005fc4b8d3f1b513d31df7626bf79aca6eb23aee954343e9416198bd4d7096: Status 404 returned error can't find the container with id a1005fc4b8d3f1b513d31df7626bf79aca6eb23aee954343e9416198bd4d7096
Jul 27 19:12:31.963111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.963080    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"]
Jul 27 19:12:31.967684 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.967656    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"]
Jul 27 19:12:31.979843 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.979799    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"]
Jul 27 19:12:31.980021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.979999    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" containerName="manager" containerID="cri-o://8e851e28f0d15390ea860c55afd25032473b64b90101c728b9e868cbbdb1bda2" gracePeriod=2
Jul 27 19:12:31.985478 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:31.985442    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:31.987633 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.987515    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"]
Jul 27 19:12:31.994903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.994874    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"]
Jul 27 19:12:31.995322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995301    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3382ec05-0014-4dc6-9905-da2688909e8a" containerName="console"
Jul 27 19:12:31.995322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995324    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3382ec05-0014-4dc6-9905-da2688909e8a" containerName="console"
Jul 27 19:12:31.995477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995371    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" containerName="manager"
Jul 27 19:12:31.995477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995376    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" containerName="manager"
Jul 27 19:12:31.995477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995385    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" containerName="manager"
Jul 27 19:12:31.995477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995394    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" containerName="manager"
Jul 27 19:12:31.995477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995450    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" containerName="manager"
Jul 27 19:12:31.995477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995459    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3382ec05-0014-4dc6-9905-da2688909e8a" containerName="console"
Jul 27 19:12:31.995477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.995467    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" containerName="manager"
Jul 27 19:12:31.997440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:31.997425    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:32.002950 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.002921    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:32.011427 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.011129    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"]
Jul 27 19:12:32.013568 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.013548    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:32.017214 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.017185    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"]
Jul 27 19:12:32.035082 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.035034    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:32.036231 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.036190    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"]
Jul 27 19:12:32.104440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.104417    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzt45\" (UniqueName: \"kubernetes.io/projected/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-kube-api-access-xzt45\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h2lkp\" (UID: \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:32.104567 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.104463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22da2896-d6ae-474b-8063-753dc60be0a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6dptb\" (UID: \"22da2896-d6ae-474b-8063-753dc60be0a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:32.104629 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.104568    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8djm\" (UniqueName: \"kubernetes.io/projected/22da2896-d6ae-474b-8063-753dc60be0a6-kube-api-access-d8djm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6dptb\" (UID: \"22da2896-d6ae-474b-8063-753dc60be0a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:32.104688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.104669    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h2lkp\" (UID: \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:32.161024 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.160991    2557 generic.go:356] "Generic (PLEG): container finished" podID="3382ec05-0014-4dc6-9905-da2688909e8a" containerID="be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0" exitCode=0
Jul 27 19:12:32.161194 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.161060    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d6b7f88-rv42t"
Jul 27 19:12:32.161194 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.161083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d6b7f88-rv42t" event={"ID":"3382ec05-0014-4dc6-9905-da2688909e8a","Type":"ContainerDied","Data":"be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0"}
Jul 27 19:12:32.161194 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.161138    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d6b7f88-rv42t" event={"ID":"3382ec05-0014-4dc6-9905-da2688909e8a","Type":"ContainerDied","Data":"e40a98582042dae2db4cb7f13c0d4ab1a8be530aeab04b1dac2c303ded30880c"}
Jul 27 19:12:32.161194 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.161169    2557 scope.go:117] "RemoveContainer" containerID="be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0"
Jul 27 19:12:32.163294 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.163260    2557 generic.go:356] "Generic (PLEG): container finished" podID="e61a83a9-7c05-48d7-85a1-f958b925ccad" containerID="8e851e28f0d15390ea860c55afd25032473b64b90101c728b9e868cbbdb1bda2" exitCode=0
Jul 27 19:12:32.163946 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.163694    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:32.165775 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.165758    2557 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh" container="manager"
Jul 27 19:12:32.169990 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.169961    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:32.172113 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.172083    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:32.172462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.172444    2557 scope.go:117] "RemoveContainer" containerID="be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0"
Jul 27 19:12:32.172794 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.172734    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0\": container with ID starting with be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0 not found: ID does not exist" containerID="be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0"
Jul 27 19:12:32.172794 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.172768    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0"} err="failed to get container status \"be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0\": rpc error: code = NotFound desc = could not find container \"be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0\": container with ID starting with be93a374e57a2bf26a6172d4f5b0ff17457b993bf0a83a4bff7982aac443b0f0 not found: ID does not exist"
Jul 27 19:12:32.187789 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.187763    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665d6b7f88-rv42t"]
Jul 27 19:12:32.191139 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.191119    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665d6b7f88-rv42t"]
Jul 27 19:12:32.205249 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.205227    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22da2896-d6ae-474b-8063-753dc60be0a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6dptb\" (UID: \"22da2896-d6ae-474b-8063-753dc60be0a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:32.205333 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.205282    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8djm\" (UniqueName: \"kubernetes.io/projected/22da2896-d6ae-474b-8063-753dc60be0a6-kube-api-access-d8djm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6dptb\" (UID: \"22da2896-d6ae-474b-8063-753dc60be0a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:32.205333 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.205330    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h2lkp\" (UID: \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:32.205450 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.205353    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzt45\" (UniqueName: \"kubernetes.io/projected/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-kube-api-access-xzt45\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h2lkp\" (UID: \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:32.205595 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.205577    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22da2896-d6ae-474b-8063-753dc60be0a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6dptb\" (UID: \"22da2896-d6ae-474b-8063-753dc60be0a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:32.205727 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.205705    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h2lkp\" (UID: \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:32.213744 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.213693    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8djm\" (UniqueName: \"kubernetes.io/projected/22da2896-d6ae-474b-8063-753dc60be0a6-kube-api-access-d8djm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6dptb\" (UID: \"22da2896-d6ae-474b-8063-753dc60be0a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:32.213851 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.213741    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzt45\" (UniqueName: \"kubernetes.io/projected/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-kube-api-access-xzt45\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h2lkp\" (UID: \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:32.229695 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.229676    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:32.232156 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.232134    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:32.234069 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:32.234050    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:32.306612 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.306582    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpzs4\" (UniqueName: \"kubernetes.io/projected/e61a83a9-7c05-48d7-85a1-f958b925ccad-kube-api-access-wpzs4\") pod \"e61a83a9-7c05-48d7-85a1-f958b925ccad\" (UID: \"e61a83a9-7c05-48d7-85a1-f958b925ccad\") "
Jul 27 19:12:32.306950 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.306661    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e61a83a9-7c05-48d7-85a1-f958b925ccad-extensions-socket-volume\") pod \"e61a83a9-7c05-48d7-85a1-f958b925ccad\" (UID: \"e61a83a9-7c05-48d7-85a1-f958b925ccad\") "
Jul 27 19:12:32.307168 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.307147    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61a83a9-7c05-48d7-85a1-f958b925ccad-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e61a83a9-7c05-48d7-85a1-f958b925ccad" (UID: "e61a83a9-7c05-48d7-85a1-f958b925ccad"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:12:32.308787 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.308764    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e61a83a9-7c05-48d7-85a1-f958b925ccad-kube-api-access-wpzs4" (OuterVolumeSpecName: "kube-api-access-wpzs4") pod "e61a83a9-7c05-48d7-85a1-f958b925ccad" (UID: "e61a83a9-7c05-48d7-85a1-f958b925ccad"). InnerVolumeSpecName "kube-api-access-wpzs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:12:32.348917 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.348890    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:32.354642 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.354620    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:32.408215 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.407718    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpzs4\" (UniqueName: \"kubernetes.io/projected/e61a83a9-7c05-48d7-85a1-f958b925ccad-kube-api-access-wpzs4\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:32.408435 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.407750    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e61a83a9-7c05-48d7-85a1-f958b925ccad-extensions-socket-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:32.523821 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.523765    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"]
Jul 27 19:12:32.525043 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:12:32.525018    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22da2896_d6ae_474b_8063_753dc60be0a6.slice/crio-f4bf0d65caac03af5eb1b0b451e757eb96149c9d448d34436382655f454668b2 WatchSource:0}: Error finding container f4bf0d65caac03af5eb1b0b451e757eb96149c9d448d34436382655f454668b2: Status 404 returned error can't find the container with id f4bf0d65caac03af5eb1b0b451e757eb96149c9d448d34436382655f454668b2
Jul 27 19:12:32.528994 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:32.528975    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"]
Jul 27 19:12:32.530469 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:12:32.530450    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb5660c_ea6b_40b8_8301_f06d82eafc7d.slice/crio-1961047bf1504d587243496c7dc4e4974768c8b74eec004ddaa4323b7ba48563 WatchSource:0}: Error finding container 1961047bf1504d587243496c7dc4e4974768c8b74eec004ddaa4323b7ba48563: Status 404 returned error can't find the container with id 1961047bf1504d587243496c7dc4e4974768c8b74eec004ddaa4323b7ba48563
Jul 27 19:12:33.173334 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.173300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb" event={"ID":"22da2896-d6ae-474b-8063-753dc60be0a6","Type":"ContainerStarted","Data":"79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46"}
Jul 27 19:12:33.173520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.173360    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:33.173520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.173377    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb" event={"ID":"22da2896-d6ae-474b-8063-753dc60be0a6","Type":"ContainerStarted","Data":"f4bf0d65caac03af5eb1b0b451e757eb96149c9d448d34436382655f454668b2"}
Jul 27 19:12:33.175701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.175684    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:33.175844 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.175686    2557 scope.go:117] "RemoveContainer" containerID="8e851e28f0d15390ea860c55afd25032473b64b90101c728b9e868cbbdb1bda2"
Jul 27 19:12:33.177075 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.177049    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:33.177383 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.177356    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" containerName="manager" containerID="cri-o://38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7" gracePeriod=2
Jul 27 19:12:33.179233 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.179211    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp" event={"ID":"4fb5660c-ea6b-40b8-8301-f06d82eafc7d","Type":"ContainerStarted","Data":"201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a"}
Jul 27 19:12:33.179343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.179255    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp" event={"ID":"4fb5660c-ea6b-40b8-8301-f06d82eafc7d","Type":"ContainerStarted","Data":"1961047bf1504d587243496c7dc4e4974768c8b74eec004ddaa4323b7ba48563"}
Jul 27 19:12:33.179343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.179325    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:33.179950 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.179931    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:33.210792 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.210752    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb" podStartSLOduration=2.210737772 podStartE2EDuration="2.210737772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:33.208455212 +0000 UTC m=+439.915594702" watchObservedRunningTime="2026-07-27 19:12:33.210737772 +0000 UTC m=+439.917877262"
Jul 27 19:12:33.210938 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.210770    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:33.258764 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.258720    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp" podStartSLOduration=2.258703993 podStartE2EDuration="2.258703993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:33.258111941 +0000 UTC m=+439.965251432" watchObservedRunningTime="2026-07-27 19:12:33.258703993 +0000 UTC m=+439.965843485"
Jul 27 19:12:33.261346 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.261324    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:33.263897 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.263875    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:33.266365 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.266341    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:33.427004 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.426942    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:33.429474 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.429449    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:33.432117 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.432086    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:33.518527 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.518495    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8psfg\" (UniqueName: \"kubernetes.io/projected/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-kube-api-access-8psfg\") pod \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\" (UID: \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\") "
Jul 27 19:12:33.518710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.518529    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-extensions-socket-volume\") pod \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\" (UID: \"45ac5586-1d6c-4e4d-9dee-c95b2c8057e2\") "
Jul 27 19:12:33.518780 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.518755    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" (UID: "45ac5586-1d6c-4e4d-9dee-c95b2c8057e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:12:33.518884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.518871    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-extensions-socket-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:33.520697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.520672    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-kube-api-access-8psfg" (OuterVolumeSpecName: "kube-api-access-8psfg") pod "45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" (UID: "45ac5586-1d6c-4e4d-9dee-c95b2c8057e2"). InnerVolumeSpecName "kube-api-access-8psfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:12:33.619599 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.619568    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8psfg\" (UniqueName: \"kubernetes.io/projected/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2-kube-api-access-8psfg\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:33.790523 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.790479    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-scn2p\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-scn2p"
Jul 27 19:12:33.793475 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:33.793423    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:33.793601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.793482    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3382ec05-0014-4dc6-9905-da2688909e8a" path="/var/lib/kubelet/pods/3382ec05-0014-4dc6-9905-da2688909e8a/volumes"
Jul 27 19:12:33.793880 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.793867    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" path="/var/lib/kubelet/pods/45ac5586-1d6c-4e4d-9dee-c95b2c8057e2/volumes"
Jul 27 19:12:33.794169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:33.794158    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e61a83a9-7c05-48d7-85a1-f958b925ccad" path="/var/lib/kubelet/pods/e61a83a9-7c05-48d7-85a1-f958b925ccad/volumes"
Jul 27 19:12:34.187449 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:34.187419    2557 generic.go:356] "Generic (PLEG): container finished" podID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" containerID="38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7" exitCode=2
Jul 27 19:12:34.187635 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:34.187464    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:34.187635 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:34.187519    2557 scope.go:117] "RemoveContainer" containerID="38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7"
Jul 27 19:12:34.193007 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:34.192973    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4gczh\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="45ac5586-1d6c-4e4d-9dee-c95b2c8057e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4gczh"
Jul 27 19:12:34.197478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:34.197460    2557 scope.go:117] "RemoveContainer" containerID="38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7"
Jul 27 19:12:34.197716 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:34.197690    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7\": container with ID starting with 38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7 not found: ID does not exist" containerID="38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7"
Jul 27 19:12:34.197777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:34.197724    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7"} err="failed to get container status \"38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7\": rpc error: code = NotFound desc = could not find container \"38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7\": container with ID starting with 38c603692a5b82ca85cb1aebc9429cf19e9a11accfc1b7445c9fbe40492f4fa7 not found: ID does not exist"
Jul 27 19:12:44.189974 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.189943    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:44.190521 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.190018    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:12:44.260664 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.260635    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"]
Jul 27 19:12:44.260873 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.260851    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp" podUID="4fb5660c-ea6b-40b8-8301-f06d82eafc7d" containerName="manager" containerID="cri-o://201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a" gracePeriod=10
Jul 27 19:12:44.512942 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.512916    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:44.614062 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.614037    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzt45\" (UniqueName: \"kubernetes.io/projected/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-kube-api-access-xzt45\") pod \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\" (UID: \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\") "
Jul 27 19:12:44.614206 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.614079    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-extensions-socket-volume\") pod \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\" (UID: \"4fb5660c-ea6b-40b8-8301-f06d82eafc7d\") "
Jul 27 19:12:44.614470 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.614441    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4fb5660c-ea6b-40b8-8301-f06d82eafc7d" (UID: "4fb5660c-ea6b-40b8-8301-f06d82eafc7d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:12:44.616202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.616179    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-kube-api-access-xzt45" (OuterVolumeSpecName: "kube-api-access-xzt45") pod "4fb5660c-ea6b-40b8-8301-f06d82eafc7d" (UID: "4fb5660c-ea6b-40b8-8301-f06d82eafc7d"). InnerVolumeSpecName "kube-api-access-xzt45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:12:44.715565 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.715532    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzt45\" (UniqueName: \"kubernetes.io/projected/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-kube-api-access-xzt45\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:44.715565 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:44.715559    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb5660c-ea6b-40b8-8301-f06d82eafc7d-extensions-socket-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:12:45.255140 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.255107    2557 generic.go:356] "Generic (PLEG): container finished" podID="4fb5660c-ea6b-40b8-8301-f06d82eafc7d" containerID="201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a" exitCode=0
Jul 27 19:12:45.255593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.255157    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"
Jul 27 19:12:45.255593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.255196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp" event={"ID":"4fb5660c-ea6b-40b8-8301-f06d82eafc7d","Type":"ContainerDied","Data":"201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a"}
Jul 27 19:12:45.255593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.255247    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp" event={"ID":"4fb5660c-ea6b-40b8-8301-f06d82eafc7d","Type":"ContainerDied","Data":"1961047bf1504d587243496c7dc4e4974768c8b74eec004ddaa4323b7ba48563"}
Jul 27 19:12:45.255593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.255268    2557 scope.go:117] "RemoveContainer" containerID="201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a"
Jul 27 19:12:45.266515 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.266423    2557 scope.go:117] "RemoveContainer" containerID="201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a"
Jul 27 19:12:45.266802 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:12:45.266772    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a\": container with ID starting with 201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a not found: ID does not exist" containerID="201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a"
Jul 27 19:12:45.266980 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.266948    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a"} err="failed to get container status \"201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a\": rpc error: code = NotFound desc = could not find container \"201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a\": container with ID starting with 201ae56d49ee90dc007210b6d3069a52292235e87ccd8f20d6e77ede41ef2d1a not found: ID does not exist"
Jul 27 19:12:45.284554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.284532    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"]
Jul 27 19:12:45.288967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.288947    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h2lkp"]
Jul 27 19:12:45.790945 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:12:45.790907    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb5660c-ea6b-40b8-8301-f06d82eafc7d" path="/var/lib/kubelet/pods/4fb5660c-ea6b-40b8-8301-f06d82eafc7d/volumes"
Jul 27 19:13:02.301036 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.300996    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"]
Jul 27 19:13:02.301567 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.301234    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb" podUID="22da2896-d6ae-474b-8063-753dc60be0a6" containerName="manager" containerID="cri-o://79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46" gracePeriod=10
Jul 27 19:13:02.554785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.554717    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:13:02.668713 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.668684    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8djm\" (UniqueName: \"kubernetes.io/projected/22da2896-d6ae-474b-8063-753dc60be0a6-kube-api-access-d8djm\") pod \"22da2896-d6ae-474b-8063-753dc60be0a6\" (UID: \"22da2896-d6ae-474b-8063-753dc60be0a6\") "
Jul 27 19:13:02.668961 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.668742    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22da2896-d6ae-474b-8063-753dc60be0a6-extensions-socket-volume\") pod \"22da2896-d6ae-474b-8063-753dc60be0a6\" (UID: \"22da2896-d6ae-474b-8063-753dc60be0a6\") "
Jul 27 19:13:02.669157 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.669132    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22da2896-d6ae-474b-8063-753dc60be0a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22da2896-d6ae-474b-8063-753dc60be0a6" (UID: "22da2896-d6ae-474b-8063-753dc60be0a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:13:02.670991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.670963    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22da2896-d6ae-474b-8063-753dc60be0a6-kube-api-access-d8djm" (OuterVolumeSpecName: "kube-api-access-d8djm") pod "22da2896-d6ae-474b-8063-753dc60be0a6" (UID: "22da2896-d6ae-474b-8063-753dc60be0a6"). InnerVolumeSpecName "kube-api-access-d8djm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:02.770235 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.770199    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8djm\" (UniqueName: \"kubernetes.io/projected/22da2896-d6ae-474b-8063-753dc60be0a6-kube-api-access-d8djm\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:13:02.770235 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:02.770227    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22da2896-d6ae-474b-8063-753dc60be0a6-extensions-socket-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:13:03.354598 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.354563    2557 generic.go:356] "Generic (PLEG): container finished" podID="22da2896-d6ae-474b-8063-753dc60be0a6" containerID="79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46" exitCode=0
Jul 27 19:13:03.355099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.354620    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"
Jul 27 19:13:03.355099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.354655    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb" event={"ID":"22da2896-d6ae-474b-8063-753dc60be0a6","Type":"ContainerDied","Data":"79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46"}
Jul 27 19:13:03.355099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.354751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb" event={"ID":"22da2896-d6ae-474b-8063-753dc60be0a6","Type":"ContainerDied","Data":"f4bf0d65caac03af5eb1b0b451e757eb96149c9d448d34436382655f454668b2"}
Jul 27 19:13:03.355099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.354782    2557 scope.go:117] "RemoveContainer" containerID="79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46"
Jul 27 19:13:03.364532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.364515    2557 scope.go:117] "RemoveContainer" containerID="79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46"
Jul 27 19:13:03.364744 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:13:03.364729    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46\": container with ID starting with 79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46 not found: ID does not exist" containerID="79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46"
Jul 27 19:13:03.364796 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.364751    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46"} err="failed to get container status \"79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46\": rpc error: code = NotFound desc = could not find container \"79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46\": container with ID starting with 79f8676f3cafb3ac5c9da3d84b090f159f11928ffd30963ad359a2995cd40b46 not found: ID does not exist"
Jul 27 19:13:03.380692 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.380667    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"]
Jul 27 19:13:03.385474 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.385455    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6dptb"]
Jul 27 19:13:03.790717 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:03.790689    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22da2896-d6ae-474b-8063-753dc60be0a6" path="/var/lib/kubelet/pods/22da2896-d6ae-474b-8063-753dc60be0a6/volumes"
Jul 27 19:13:22.087953 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.087918    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"]
Jul 27 19:13:22.088347 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.088331    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb5660c-ea6b-40b8-8301-f06d82eafc7d" containerName="manager"
Jul 27 19:13:22.088392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.088349    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb5660c-ea6b-40b8-8301-f06d82eafc7d" containerName="manager"
Jul 27 19:13:22.088392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.088359    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22da2896-d6ae-474b-8063-753dc60be0a6" containerName="manager"
Jul 27 19:13:22.088392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.088365    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="22da2896-d6ae-474b-8063-753dc60be0a6" containerName="manager"
Jul 27 19:13:22.088490 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.088431    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb5660c-ea6b-40b8-8301-f06d82eafc7d" containerName="manager"
Jul 27 19:13:22.088490 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.088439    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="22da2896-d6ae-474b-8063-753dc60be0a6" containerName="manager"
Jul 27 19:13:22.091290 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.091264    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:22.093928 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.093908    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 19:13:22.094190 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.094171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sqrg8\""
Jul 27 19:13:22.099496 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.099458    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"]
Jul 27 19:13:22.133003 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.132976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-config-file\") pod \"limitador-limitador-64c94fd64f-x2ccd\" (UID: \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:22.133143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.133019    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmx22\" (UniqueName: \"kubernetes.io/projected/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-kube-api-access-tmx22\") pod \"limitador-limitador-64c94fd64f-x2ccd\" (UID: \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:22.178845 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.178796    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"]
Jul 27 19:13:22.233632 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.233602    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-config-file\") pod \"limitador-limitador-64c94fd64f-x2ccd\" (UID: \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:22.233772 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.233637    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmx22\" (UniqueName: \"kubernetes.io/projected/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-kube-api-access-tmx22\") pod \"limitador-limitador-64c94fd64f-x2ccd\" (UID: \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:22.234210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.234192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-config-file\") pod \"limitador-limitador-64c94fd64f-x2ccd\" (UID: \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:22.242872 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.242849    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmx22\" (UniqueName: \"kubernetes.io/projected/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-kube-api-access-tmx22\") pod \"limitador-limitador-64c94fd64f-x2ccd\" (UID: \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:22.403720 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.403642    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:22.450079 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.450043    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:13:22.453243 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.453224    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:22.463660 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.463621    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:13:22.486577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.486545    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:13:22.536002 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.535973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/08ef8509-cbbc-4df6-a9f9-75d46146c345-config-file\") pod \"limitador-limitador-54d6d988d5-9qskn\" (UID: \"08ef8509-cbbc-4df6-a9f9-75d46146c345\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:22.536192 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.536016    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhnjb\" (UniqueName: \"kubernetes.io/projected/08ef8509-cbbc-4df6-a9f9-75d46146c345-kube-api-access-zhnjb\") pod \"limitador-limitador-54d6d988d5-9qskn\" (UID: \"08ef8509-cbbc-4df6-a9f9-75d46146c345\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:22.543537 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.543518    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"]
Jul 27 19:13:22.545573 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:13:22.545544    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e37d9c1_03bf_46d1_9a9d_7374e73daa02.slice/crio-5f2af4ade87c82bc5e2f7276a0e38bd783bb946768ad17dcca486a7d146af77a WatchSource:0}: Error finding container 5f2af4ade87c82bc5e2f7276a0e38bd783bb946768ad17dcca486a7d146af77a: Status 404 returned error can't find the container with id 5f2af4ade87c82bc5e2f7276a0e38bd783bb946768ad17dcca486a7d146af77a
Jul 27 19:13:22.637156 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.637118    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/08ef8509-cbbc-4df6-a9f9-75d46146c345-config-file\") pod \"limitador-limitador-54d6d988d5-9qskn\" (UID: \"08ef8509-cbbc-4df6-a9f9-75d46146c345\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:22.637156 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.637155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhnjb\" (UniqueName: \"kubernetes.io/projected/08ef8509-cbbc-4df6-a9f9-75d46146c345-kube-api-access-zhnjb\") pod \"limitador-limitador-54d6d988d5-9qskn\" (UID: \"08ef8509-cbbc-4df6-a9f9-75d46146c345\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:22.637691 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.637672    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/08ef8509-cbbc-4df6-a9f9-75d46146c345-config-file\") pod \"limitador-limitador-54d6d988d5-9qskn\" (UID: \"08ef8509-cbbc-4df6-a9f9-75d46146c345\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:22.645443 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.645418    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhnjb\" (UniqueName: \"kubernetes.io/projected/08ef8509-cbbc-4df6-a9f9-75d46146c345-kube-api-access-zhnjb\") pod \"limitador-limitador-54d6d988d5-9qskn\" (UID: \"08ef8509-cbbc-4df6-a9f9-75d46146c345\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:22.770643 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.770612    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:22.907518 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:22.907497    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:13:22.909445 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:13:22.909417    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ef8509_cbbc_4df6_a9f9_75d46146c345.slice/crio-0a464fd79f94ea3a5aa555b64cafdfde24456dfd079a3afc2aacdb0ef37717d3 WatchSource:0}: Error finding container 0a464fd79f94ea3a5aa555b64cafdfde24456dfd079a3afc2aacdb0ef37717d3: Status 404 returned error can't find the container with id 0a464fd79f94ea3a5aa555b64cafdfde24456dfd079a3afc2aacdb0ef37717d3
Jul 27 19:13:23.473440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:23.473403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn" event={"ID":"08ef8509-cbbc-4df6-a9f9-75d46146c345","Type":"ContainerStarted","Data":"0a464fd79f94ea3a5aa555b64cafdfde24456dfd079a3afc2aacdb0ef37717d3"}
Jul 27 19:13:23.476230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:23.476200    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd" event={"ID":"6e37d9c1-03bf-46d1-9a9d-7374e73daa02","Type":"ContainerStarted","Data":"5f2af4ade87c82bc5e2f7276a0e38bd783bb946768ad17dcca486a7d146af77a"}
Jul 27 19:13:26.495867 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:26.495833    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn" event={"ID":"08ef8509-cbbc-4df6-a9f9-75d46146c345","Type":"ContainerStarted","Data":"d2562a61cca712f873a454cecbfd8433e1dc38cf006a6255be4e82022ca13b4f"}
Jul 27 19:13:26.496345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:26.495910    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:26.497394 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:26.497371    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd" event={"ID":"6e37d9c1-03bf-46d1-9a9d-7374e73daa02","Type":"ContainerStarted","Data":"e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023"}
Jul 27 19:13:26.497520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:26.497426    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:26.515780 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:26.515737    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn" podStartSLOduration=1.827094241 podStartE2EDuration="4.515711155s" totalImagesPullingTime="2.688616914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:26.512633481 +0000 UTC m=+493.219772984" watchObservedRunningTime="2026-07-27 19:13:26.515711155 +0000 UTC m=+493.222850684"
Jul 27 19:13:26.529884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:26.529843    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd" podStartSLOduration=1.483664878 podStartE2EDuration="4.529828612s" totalImagesPullingTime="3.046163734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:26.528146868 +0000 UTC m=+493.235286360" watchObservedRunningTime="2026-07-27 19:13:26.529828612 +0000 UTC m=+493.236968098"
Jul 27 19:13:37.504134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:37.504106    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9qskn"
Jul 27 19:13:37.504623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:37.504184    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:37.572601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:37.572566    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"]
Jul 27 19:13:37.572784 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:37.572761    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd" podUID="6e37d9c1-03bf-46d1-9a9d-7374e73daa02" containerName="limitador" containerID="cri-o://e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023" gracePeriod=30
Jul 27 19:13:38.117725 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.117701    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:38.164833 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.164724    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmx22\" (UniqueName: \"kubernetes.io/projected/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-kube-api-access-tmx22\") pod \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\" (UID: \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\") "
Jul 27 19:13:38.164833 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.164777    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-config-file\") pod \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\" (UID: \"6e37d9c1-03bf-46d1-9a9d-7374e73daa02\") "
Jul 27 19:13:38.165159 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.165135    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-config-file" (OuterVolumeSpecName: "config-file") pod "6e37d9c1-03bf-46d1-9a9d-7374e73daa02" (UID: "6e37d9c1-03bf-46d1-9a9d-7374e73daa02"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:13:38.167179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.167155    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-kube-api-access-tmx22" (OuterVolumeSpecName: "kube-api-access-tmx22") pod "6e37d9c1-03bf-46d1-9a9d-7374e73daa02" (UID: "6e37d9c1-03bf-46d1-9a9d-7374e73daa02"). InnerVolumeSpecName "kube-api-access-tmx22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:38.266493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.266462    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmx22\" (UniqueName: \"kubernetes.io/projected/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-kube-api-access-tmx22\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:13:38.266493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.266487    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e37d9c1-03bf-46d1-9a9d-7374e73daa02-config-file\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:13:38.565832 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.565784    2557 generic.go:356] "Generic (PLEG): container finished" podID="6e37d9c1-03bf-46d1-9a9d-7374e73daa02" containerID="e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023" exitCode=0
Jul 27 19:13:38.566236 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.565851    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"
Jul 27 19:13:38.566236 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.565866    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd" event={"ID":"6e37d9c1-03bf-46d1-9a9d-7374e73daa02","Type":"ContainerDied","Data":"e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023"}
Jul 27 19:13:38.566236 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.565918    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x2ccd" event={"ID":"6e37d9c1-03bf-46d1-9a9d-7374e73daa02","Type":"ContainerDied","Data":"5f2af4ade87c82bc5e2f7276a0e38bd783bb946768ad17dcca486a7d146af77a"}
Jul 27 19:13:38.566236 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.565942    2557 scope.go:117] "RemoveContainer" containerID="e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023"
Jul 27 19:13:38.575403 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.575240    2557 scope.go:117] "RemoveContainer" containerID="e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023"
Jul 27 19:13:38.575494 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:13:38.575478    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023\": container with ID starting with e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023 not found: ID does not exist" containerID="e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023"
Jul 27 19:13:38.575535 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.575504    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023"} err="failed to get container status \"e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023\": rpc error: code = NotFound desc = could not find container \"e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023\": container with ID starting with e310abbe883551025a8cdf382f785a09c05779d1be9cde7257dcf97169fa0023 not found: ID does not exist"
Jul 27 19:13:38.587143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.587124    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"]
Jul 27 19:13:38.590873 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:38.590854    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x2ccd"]
Jul 27 19:13:39.739005 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.738974    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"]
Jul 27 19:13:39.739537 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.739518    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e37d9c1-03bf-46d1-9a9d-7374e73daa02" containerName="limitador"
Jul 27 19:13:39.739618 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.739540    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e37d9c1-03bf-46d1-9a9d-7374e73daa02" containerName="limitador"
Jul 27 19:13:39.739679 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.739670    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e37d9c1-03bf-46d1-9a9d-7374e73daa02" containerName="limitador"
Jul 27 19:13:39.742202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.742180    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:39.747997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.747977    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:13:39.748103 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.748003    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 19:13:39.748402 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.748382    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:13:39.749337 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.749307    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2bjcl\""
Jul 27 19:13:39.754158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.754139    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"]
Jul 27 19:13:39.779705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.779676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3149a751-1bc7-4626-bbbc-6ddd07645030-data\") pod \"postgres-69fb4594cf-7jvhk\" (UID: \"3149a751-1bc7-4626-bbbc-6ddd07645030\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:39.779857 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.779746    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns9h9\" (UniqueName: \"kubernetes.io/projected/3149a751-1bc7-4626-bbbc-6ddd07645030-kube-api-access-ns9h9\") pod \"postgres-69fb4594cf-7jvhk\" (UID: \"3149a751-1bc7-4626-bbbc-6ddd07645030\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:39.795869 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.795842    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e37d9c1-03bf-46d1-9a9d-7374e73daa02" path="/var/lib/kubelet/pods/6e37d9c1-03bf-46d1-9a9d-7374e73daa02/volumes"
Jul 27 19:13:39.880679 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.880648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3149a751-1bc7-4626-bbbc-6ddd07645030-data\") pod \"postgres-69fb4594cf-7jvhk\" (UID: \"3149a751-1bc7-4626-bbbc-6ddd07645030\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:39.880849 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.880706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns9h9\" (UniqueName: \"kubernetes.io/projected/3149a751-1bc7-4626-bbbc-6ddd07645030-kube-api-access-ns9h9\") pod \"postgres-69fb4594cf-7jvhk\" (UID: \"3149a751-1bc7-4626-bbbc-6ddd07645030\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:39.881050 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.881032    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3149a751-1bc7-4626-bbbc-6ddd07645030-data\") pod \"postgres-69fb4594cf-7jvhk\" (UID: \"3149a751-1bc7-4626-bbbc-6ddd07645030\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:39.899653 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:39.899630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns9h9\" (UniqueName: \"kubernetes.io/projected/3149a751-1bc7-4626-bbbc-6ddd07645030-kube-api-access-ns9h9\") pod \"postgres-69fb4594cf-7jvhk\" (UID: \"3149a751-1bc7-4626-bbbc-6ddd07645030\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:40.053252 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:40.053181    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:40.186869 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:40.186841    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"]
Jul 27 19:13:40.188472 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:13:40.188439    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3149a751_1bc7_4626_bbbc_6ddd07645030.slice/crio-dba7be4dcfc2088e943b998067e04b67d9644bc5e04924bb8fa3c9a74b8d0375 WatchSource:0}: Error finding container dba7be4dcfc2088e943b998067e04b67d9644bc5e04924bb8fa3c9a74b8d0375: Status 404 returned error can't find the container with id dba7be4dcfc2088e943b998067e04b67d9644bc5e04924bb8fa3c9a74b8d0375
Jul 27 19:13:40.582346 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:40.582317    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk" event={"ID":"3149a751-1bc7-4626-bbbc-6ddd07645030","Type":"ContainerStarted","Data":"dba7be4dcfc2088e943b998067e04b67d9644bc5e04924bb8fa3c9a74b8d0375"}
Jul 27 19:13:45.620167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:45.620118    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk" event={"ID":"3149a751-1bc7-4626-bbbc-6ddd07645030","Type":"ContainerStarted","Data":"09a6119f3fb49cfd4136d63ed6e01e70f9d5c066367aab9b0356b3ca0c744624"}
Jul 27 19:13:45.620613 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:45.620191    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:45.645370 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:45.640164    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk" podStartSLOduration=1.7970495290000001 podStartE2EDuration="6.640146499s" totalImagesPullingTime="4.84309697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:45.638221069 +0000 UTC m=+512.345360561" watchObservedRunningTime="2026-07-27 19:13:45.640146499 +0000 UTC m=+512.347285990"
Jul 27 19:13:51.655306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:51.655275    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7jvhk"
Jul 27 19:13:52.247278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.247243    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9bfg9"]
Jul 27 19:13:52.252977 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.252959    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9bfg9"
Jul 27 19:13:52.256122 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.256087    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n8q5m\""
Jul 27 19:13:52.257490 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.257467    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9bfg9"]
Jul 27 19:13:52.398680 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.398651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qlsb\" (UniqueName: \"kubernetes.io/projected/475b967e-018a-40dc-8ded-64b2e1bcf9ec-kube-api-access-8qlsb\") pod \"authorino-5d4b67c446-9bfg9\" (UID: \"475b967e-018a-40dc-8ded-64b2e1bcf9ec\") " pod="kuadrant-system/authorino-5d4b67c446-9bfg9"
Jul 27 19:13:52.500666 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.500567    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9bfg9"]
Jul 27 19:13:52.501315 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:13:52.501282    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8qlsb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-9bfg9" podUID="475b967e-018a-40dc-8ded-64b2e1bcf9ec"
Jul 27 19:13:52.502126 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.502085    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qlsb\" (UniqueName: \"kubernetes.io/projected/475b967e-018a-40dc-8ded-64b2e1bcf9ec-kube-api-access-8qlsb\") pod \"authorino-5d4b67c446-9bfg9\" (UID: \"475b967e-018a-40dc-8ded-64b2e1bcf9ec\") " pod="kuadrant-system/authorino-5d4b67c446-9bfg9"
Jul 27 19:13:52.512916 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.512888    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qlsb\" (UniqueName: \"kubernetes.io/projected/475b967e-018a-40dc-8ded-64b2e1bcf9ec-kube-api-access-8qlsb\") pod \"authorino-5d4b67c446-9bfg9\" (UID: \"475b967e-018a-40dc-8ded-64b2e1bcf9ec\") " pod="kuadrant-system/authorino-5d4b67c446-9bfg9"
Jul 27 19:13:52.656972 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.656944    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9bfg9"
Jul 27 19:13:52.664385 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.664362    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9bfg9"
Jul 27 19:13:52.703320 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.703296    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-845c85cc44-hcwbz"]
Jul 27 19:13:52.707154 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.707137    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:13:52.709663 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.709646    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 19:13:52.715547 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.715526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-845c85cc44-hcwbz"]
Jul 27 19:13:52.805252 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.805175    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qlsb\" (UniqueName: \"kubernetes.io/projected/475b967e-018a-40dc-8ded-64b2e1bcf9ec-kube-api-access-8qlsb\") pod \"475b967e-018a-40dc-8ded-64b2e1bcf9ec\" (UID: \"475b967e-018a-40dc-8ded-64b2e1bcf9ec\") "
Jul 27 19:13:52.805390 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.805323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc56206a-e254-4ec9-a7c3-014154f97a84-tls-cert\") pod \"authorino-845c85cc44-hcwbz\" (UID: \"dc56206a-e254-4ec9-a7c3-014154f97a84\") " pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:13:52.805390 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.805367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krcpj\" (UniqueName: \"kubernetes.io/projected/dc56206a-e254-4ec9-a7c3-014154f97a84-kube-api-access-krcpj\") pod \"authorino-845c85cc44-hcwbz\" (UID: \"dc56206a-e254-4ec9-a7c3-014154f97a84\") " pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:13:52.807297 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.807269    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/475b967e-018a-40dc-8ded-64b2e1bcf9ec-kube-api-access-8qlsb" (OuterVolumeSpecName: "kube-api-access-8qlsb") pod "475b967e-018a-40dc-8ded-64b2e1bcf9ec" (UID: "475b967e-018a-40dc-8ded-64b2e1bcf9ec"). InnerVolumeSpecName "kube-api-access-8qlsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:52.906540 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.906513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc56206a-e254-4ec9-a7c3-014154f97a84-tls-cert\") pod \"authorino-845c85cc44-hcwbz\" (UID: \"dc56206a-e254-4ec9-a7c3-014154f97a84\") " pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:13:52.906628 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.906563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krcpj\" (UniqueName: \"kubernetes.io/projected/dc56206a-e254-4ec9-a7c3-014154f97a84-kube-api-access-krcpj\") pod \"authorino-845c85cc44-hcwbz\" (UID: \"dc56206a-e254-4ec9-a7c3-014154f97a84\") " pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:13:52.906628 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.906607    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qlsb\" (UniqueName: \"kubernetes.io/projected/475b967e-018a-40dc-8ded-64b2e1bcf9ec-kube-api-access-8qlsb\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:13:52.909046 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.909024    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc56206a-e254-4ec9-a7c3-014154f97a84-tls-cert\") pod \"authorino-845c85cc44-hcwbz\" (UID: \"dc56206a-e254-4ec9-a7c3-014154f97a84\") " pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:13:52.916884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:52.916860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krcpj\" (UniqueName: \"kubernetes.io/projected/dc56206a-e254-4ec9-a7c3-014154f97a84-kube-api-access-krcpj\") pod \"authorino-845c85cc44-hcwbz\" (UID: \"dc56206a-e254-4ec9-a7c3-014154f97a84\") " pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:13:53.016506 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:53.016478    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:13:53.151111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:53.151084    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-845c85cc44-hcwbz"]
Jul 27 19:13:53.152294 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:13:53.152262    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc56206a_e254_4ec9_a7c3_014154f97a84.slice/crio-8334a110f0ecd7b11003a66610c234794fe98e3a095e94f44130b68014a9b1f7 WatchSource:0}: Error finding container 8334a110f0ecd7b11003a66610c234794fe98e3a095e94f44130b68014a9b1f7: Status 404 returned error can't find the container with id 8334a110f0ecd7b11003a66610c234794fe98e3a095e94f44130b68014a9b1f7
Jul 27 19:13:53.664663 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:53.664634    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-845c85cc44-hcwbz" event={"ID":"dc56206a-e254-4ec9-a7c3-014154f97a84","Type":"ContainerStarted","Data":"8334a110f0ecd7b11003a66610c234794fe98e3a095e94f44130b68014a9b1f7"}
Jul 27 19:13:53.664663 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:53.664642    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9bfg9"
Jul 27 19:13:53.694620 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:53.694591    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9bfg9"]
Jul 27 19:13:53.697981 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:53.697958    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9bfg9"]
Jul 27 19:13:53.794198 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:53.794168    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="475b967e-018a-40dc-8ded-64b2e1bcf9ec" path="/var/lib/kubelet/pods/475b967e-018a-40dc-8ded-64b2e1bcf9ec/volumes"
Jul 27 19:13:57.692201 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:57.692168    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-845c85cc44-hcwbz" event={"ID":"dc56206a-e254-4ec9-a7c3-014154f97a84","Type":"ContainerStarted","Data":"3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5"}
Jul 27 19:13:57.709639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:13:57.709597    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-845c85cc44-hcwbz" podStartSLOduration=1.4548780940000001 podStartE2EDuration="5.709582282s" totalImagesPullingTime="4.254704188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:57.707325381 +0000 UTC m=+524.414464874" watchObservedRunningTime="2026-07-27 19:13:57.709582282 +0000 UTC m=+524.416721772"
Jul 27 19:14:02.709417 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.709384    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-847bd7794d-qzt5x"]
Jul 27 19:14:02.711997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.711978    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:02.715576 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.715550    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 19:14:02.715700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.715582    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 19:14:02.715700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.715583    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4p2wz\""
Jul 27 19:14:02.723968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.723945    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-847bd7794d-qzt5x"]
Jul 27 19:14:02.795065 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.795030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert\") pod \"maas-controller-847bd7794d-qzt5x\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") " pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:02.795236 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.795074    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4d6\" (UniqueName: \"kubernetes.io/projected/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-kube-api-access-dw4d6\") pod \"maas-controller-847bd7794d-qzt5x\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") " pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:02.890671 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.890637    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-c8qnl"]
Jul 27 19:14:02.893419 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.893400    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:02.896056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.896035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert\") pod \"maas-controller-847bd7794d-qzt5x\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") " pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:02.896140 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.896093    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4d6\" (UniqueName: \"kubernetes.io/projected/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-kube-api-access-dw4d6\") pod \"maas-controller-847bd7794d-qzt5x\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") " pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:02.896229 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:14:02.896213    2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 27 19:14:02.896292 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:14:02.896281    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert podName:b2edd37e-4834-4100-8dca-09bd0d3c4b8c nodeName:}" failed. No retries permitted until 2026-07-27 19:14:03.396261883 +0000 UTC m=+530.103401354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert") pod "maas-controller-847bd7794d-qzt5x" (UID: "b2edd37e-4834-4100-8dca-09bd0d3c4b8c") : secret "maas-controller-webhook-cert" not found
Jul 27 19:14:02.910770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.910743    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-c8qnl"]
Jul 27 19:14:02.911063 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.911036    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4d6\" (UniqueName: \"kubernetes.io/projected/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-kube-api-access-dw4d6\") pod \"maas-controller-847bd7794d-qzt5x\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") " pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:02.996922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.996833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee3117fb-6435-419d-91ea-3d0b9fc4baec-webhook-cert\") pod \"maas-controller-7c6f6dbc64-c8qnl\" (UID: \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\") " pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:02.996922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:02.996875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh72h\" (UniqueName: \"kubernetes.io/projected/ee3117fb-6435-419d-91ea-3d0b9fc4baec-kube-api-access-dh72h\") pod \"maas-controller-7c6f6dbc64-c8qnl\" (UID: \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\") " pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:03.097638 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.097612    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee3117fb-6435-419d-91ea-3d0b9fc4baec-webhook-cert\") pod \"maas-controller-7c6f6dbc64-c8qnl\" (UID: \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\") " pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:03.097800 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.097653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh72h\" (UniqueName: \"kubernetes.io/projected/ee3117fb-6435-419d-91ea-3d0b9fc4baec-kube-api-access-dh72h\") pod \"maas-controller-7c6f6dbc64-c8qnl\" (UID: \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\") " pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:03.100148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.100128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee3117fb-6435-419d-91ea-3d0b9fc4baec-webhook-cert\") pod \"maas-controller-7c6f6dbc64-c8qnl\" (UID: \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\") " pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:03.107713 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.107690    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh72h\" (UniqueName: \"kubernetes.io/projected/ee3117fb-6435-419d-91ea-3d0b9fc4baec-kube-api-access-dh72h\") pod \"maas-controller-7c6f6dbc64-c8qnl\" (UID: \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\") " pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:03.203007 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.202980    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:03.345061 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:14:03.345032    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3117fb_6435_419d_91ea_3d0b9fc4baec.slice/crio-ecfa6a230637539d82347612a4615a8975ead959cfed6561d1778584b76ff4f1 WatchSource:0}: Error finding container ecfa6a230637539d82347612a4615a8975ead959cfed6561d1778584b76ff4f1: Status 404 returned error can't find the container with id ecfa6a230637539d82347612a4615a8975ead959cfed6561d1778584b76ff4f1
Jul 27 19:14:03.345690 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.345667    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-c8qnl"]
Jul 27 19:14:03.400268 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.400222    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert\") pod \"maas-controller-847bd7794d-qzt5x\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") " pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:03.402662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.402645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert\") pod \"maas-controller-847bd7794d-qzt5x\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") " pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:03.623912 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.623789    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:03.727032 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.726998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl" event={"ID":"ee3117fb-6435-419d-91ea-3d0b9fc4baec","Type":"ContainerStarted","Data":"ecfa6a230637539d82347612a4615a8975ead959cfed6561d1778584b76ff4f1"}
Jul 27 19:14:03.762009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:03.761983    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-847bd7794d-qzt5x"]
Jul 27 19:14:03.764098 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:14:03.764073    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2edd37e_4834_4100_8dca_09bd0d3c4b8c.slice/crio-3254e676decdef263f6e4dc85dc701217cb6cccd6b5f29364a012ac0dbb7aed7 WatchSource:0}: Error finding container 3254e676decdef263f6e4dc85dc701217cb6cccd6b5f29364a012ac0dbb7aed7: Status 404 returned error can't find the container with id 3254e676decdef263f6e4dc85dc701217cb6cccd6b5f29364a012ac0dbb7aed7
Jul 27 19:14:04.737625 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:04.737584    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-847bd7794d-qzt5x" event={"ID":"b2edd37e-4834-4100-8dca-09bd0d3c4b8c","Type":"ContainerStarted","Data":"3254e676decdef263f6e4dc85dc701217cb6cccd6b5f29364a012ac0dbb7aed7"}
Jul 27 19:14:06.750205 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:06.750164    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl" event={"ID":"ee3117fb-6435-419d-91ea-3d0b9fc4baec","Type":"ContainerStarted","Data":"530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e"}
Jul 27 19:14:06.750641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:06.750300    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:06.751824 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:06.751789    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-847bd7794d-qzt5x" event={"ID":"b2edd37e-4834-4100-8dca-09bd0d3c4b8c","Type":"ContainerStarted","Data":"4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e"}
Jul 27 19:14:06.751927 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:06.751849    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:06.771180 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:06.771139    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl" podStartSLOduration=2.178306123 podStartE2EDuration="4.771123962s" totalImagesPullingTime="2.592817839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:06.770069187 +0000 UTC m=+533.477208679" watchObservedRunningTime="2026-07-27 19:14:06.771123962 +0000 UTC m=+533.478263453"
Jul 27 19:14:06.786539 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:06.786500    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-847bd7794d-qzt5x" podStartSLOduration=2.622509912 podStartE2EDuration="4.786485829s" totalImagesPullingTime="2.163975917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:06.785961573 +0000 UTC m=+533.493101065" watchObservedRunningTime="2026-07-27 19:14:06.786485829 +0000 UTC m=+533.493625319"
Jul 27 19:14:17.762258 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:17.762229    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:14:17.762639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:17.762381    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:17.829235 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:17.829200    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-847bd7794d-qzt5x"]
Jul 27 19:14:17.829466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:17.829439    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-847bd7794d-qzt5x" podUID="b2edd37e-4834-4100-8dca-09bd0d3c4b8c" containerName="manager" containerID="cri-o://4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e" gracePeriod=30
Jul 27 19:14:18.081845 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.081803    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:18.134514 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.134492    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert\") pod \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") "
Jul 27 19:14:18.134658 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.134544    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw4d6\" (UniqueName: \"kubernetes.io/projected/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-kube-api-access-dw4d6\") pod \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\" (UID: \"b2edd37e-4834-4100-8dca-09bd0d3c4b8c\") "
Jul 27 19:14:18.136890 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.136861    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-kube-api-access-dw4d6" (OuterVolumeSpecName: "kube-api-access-dw4d6") pod "b2edd37e-4834-4100-8dca-09bd0d3c4b8c" (UID: "b2edd37e-4834-4100-8dca-09bd0d3c4b8c"). InnerVolumeSpecName "kube-api-access-dw4d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:14:18.136999 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.136899    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b2edd37e-4834-4100-8dca-09bd0d3c4b8c" (UID: "b2edd37e-4834-4100-8dca-09bd0d3c4b8c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:14:18.235510 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.235480    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-webhook-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:14:18.235510 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.235506    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw4d6\" (UniqueName: \"kubernetes.io/projected/b2edd37e-4834-4100-8dca-09bd0d3c4b8c-kube-api-access-dw4d6\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:14:18.819885 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.819851    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2edd37e-4834-4100-8dca-09bd0d3c4b8c" containerID="4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e" exitCode=0
Jul 27 19:14:18.820283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.819895    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-847bd7794d-qzt5x"
Jul 27 19:14:18.820283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.819937    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-847bd7794d-qzt5x" event={"ID":"b2edd37e-4834-4100-8dca-09bd0d3c4b8c","Type":"ContainerDied","Data":"4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e"}
Jul 27 19:14:18.820283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.819980    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-847bd7794d-qzt5x" event={"ID":"b2edd37e-4834-4100-8dca-09bd0d3c4b8c","Type":"ContainerDied","Data":"3254e676decdef263f6e4dc85dc701217cb6cccd6b5f29364a012ac0dbb7aed7"}
Jul 27 19:14:18.820283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.820000    2557 scope.go:117] "RemoveContainer" containerID="4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e"
Jul 27 19:14:18.829238 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.829224    2557 scope.go:117] "RemoveContainer" containerID="4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e"
Jul 27 19:14:18.829508 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:14:18.829493    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e\": container with ID starting with 4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e not found: ID does not exist" containerID="4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e"
Jul 27 19:14:18.829547 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.829517    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e"} err="failed to get container status \"4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e\": rpc error: code = NotFound desc = could not find container \"4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e\": container with ID starting with 4ce8af26e3f94fa3cf1a88ef7c60323893f876439ae1a9e5acbd26e93b39353e not found: ID does not exist"
Jul 27 19:14:18.842451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.842424    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-847bd7794d-qzt5x"]
Jul 27 19:14:18.848056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:18.848037    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-847bd7794d-qzt5x"]
Jul 27 19:14:19.790400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:19.790369    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2edd37e-4834-4100-8dca-09bd0d3c4b8c" path="/var/lib/kubelet/pods/b2edd37e-4834-4100-8dca-09bd0d3c4b8c/volumes"
Jul 27 19:14:41.030135 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.030103    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"]
Jul 27 19:14:41.030523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.030492    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2edd37e-4834-4100-8dca-09bd0d3c4b8c" containerName="manager"
Jul 27 19:14:41.030523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.030503    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2edd37e-4834-4100-8dca-09bd0d3c4b8c" containerName="manager"
Jul 27 19:14:41.030596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.030587    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2edd37e-4834-4100-8dca-09bd0d3c4b8c" containerName="manager"
Jul 27 19:14:41.036381 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.036359    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:41.040154 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.040133    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 19:14:41.040385 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.040172    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kqksx\""
Jul 27 19:14:41.045243 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.045222    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"]
Jul 27 19:14:41.067139 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.067116    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pfwms"]
Jul 27 19:14:41.071395 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.071379    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:41.081040 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.081015    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pfwms"]
Jul 27 19:14:41.133397 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.133368    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f7c4ef4-3c7d-472f-b9a4-e32600630f91-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pfwms\" (UID: \"5f7c4ef4-3c7d-472f-b9a4-e32600630f91\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:41.133513 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.133403    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srndd\" (UniqueName: \"kubernetes.io/projected/45fd0158-f8ad-4457-9990-0d0dfff39d3e-kube-api-access-srndd\") pod \"payload-pre-processing-687dbb6cf6-2nz8x\" (UID: \"45fd0158-f8ad-4457-9990-0d0dfff39d3e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:41.133513 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.133498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmpr9\" (UniqueName: \"kubernetes.io/projected/5f7c4ef4-3c7d-472f-b9a4-e32600630f91-kube-api-access-xmpr9\") pod \"payload-processing-5cc6cd444b-pfwms\" (UID: \"5f7c4ef4-3c7d-472f-b9a4-e32600630f91\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:41.133600 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.133528    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45fd0158-f8ad-4457-9990-0d0dfff39d3e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2nz8x\" (UID: \"45fd0158-f8ad-4457-9990-0d0dfff39d3e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:41.161969 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.161945    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:14:41.234876 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.234845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f7c4ef4-3c7d-472f-b9a4-e32600630f91-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pfwms\" (UID: \"5f7c4ef4-3c7d-472f-b9a4-e32600630f91\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:41.235047 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.234886    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srndd\" (UniqueName: \"kubernetes.io/projected/45fd0158-f8ad-4457-9990-0d0dfff39d3e-kube-api-access-srndd\") pod \"payload-pre-processing-687dbb6cf6-2nz8x\" (UID: \"45fd0158-f8ad-4457-9990-0d0dfff39d3e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:41.235112 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.235083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmpr9\" (UniqueName: \"kubernetes.io/projected/5f7c4ef4-3c7d-472f-b9a4-e32600630f91-kube-api-access-xmpr9\") pod \"payload-processing-5cc6cd444b-pfwms\" (UID: \"5f7c4ef4-3c7d-472f-b9a4-e32600630f91\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:41.235170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.235120    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45fd0158-f8ad-4457-9990-0d0dfff39d3e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2nz8x\" (UID: \"45fd0158-f8ad-4457-9990-0d0dfff39d3e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:41.235707 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.235679    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f7c4ef4-3c7d-472f-b9a4-e32600630f91-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pfwms\" (UID: \"5f7c4ef4-3c7d-472f-b9a4-e32600630f91\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:41.235863 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.235852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45fd0158-f8ad-4457-9990-0d0dfff39d3e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2nz8x\" (UID: \"45fd0158-f8ad-4457-9990-0d0dfff39d3e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:41.242935 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.242913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srndd\" (UniqueName: \"kubernetes.io/projected/45fd0158-f8ad-4457-9990-0d0dfff39d3e-kube-api-access-srndd\") pod \"payload-pre-processing-687dbb6cf6-2nz8x\" (UID: \"45fd0158-f8ad-4457-9990-0d0dfff39d3e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:41.243230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.243210    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmpr9\" (UniqueName: \"kubernetes.io/projected/5f7c4ef4-3c7d-472f-b9a4-e32600630f91-kube-api-access-xmpr9\") pod \"payload-processing-5cc6cd444b-pfwms\" (UID: \"5f7c4ef4-3c7d-472f-b9a4-e32600630f91\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:41.348260 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.348188    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:41.381529 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.381507    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:41.531307 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.531273    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pfwms"]
Jul 27 19:14:41.533113 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:14:41.533091    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7c4ef4_3c7d_472f_b9a4_e32600630f91.slice/crio-4d4087fcbfd8879d3f654f6eb310eb9f8fa54dbc0fee9e25769cf55eb66ea199 WatchSource:0}: Error finding container 4d4087fcbfd8879d3f654f6eb310eb9f8fa54dbc0fee9e25769cf55eb66ea199: Status 404 returned error can't find the container with id 4d4087fcbfd8879d3f654f6eb310eb9f8fa54dbc0fee9e25769cf55eb66ea199
Jul 27 19:14:41.705080 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.705050    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"]
Jul 27 19:14:41.706481 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:14:41.706457    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fd0158_f8ad_4457_9990_0d0dfff39d3e.slice/crio-35db5b8228b2b50fb255944ffa052e4891e8695703dc77f9bc762136267f9f70 WatchSource:0}: Error finding container 35db5b8228b2b50fb255944ffa052e4891e8695703dc77f9bc762136267f9f70: Status 404 returned error can't find the container with id 35db5b8228b2b50fb255944ffa052e4891e8695703dc77f9bc762136267f9f70
Jul 27 19:14:41.948962 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.948930    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x" event={"ID":"45fd0158-f8ad-4457-9990-0d0dfff39d3e","Type":"ContainerStarted","Data":"35db5b8228b2b50fb255944ffa052e4891e8695703dc77f9bc762136267f9f70"}
Jul 27 19:14:41.950094 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:41.950071    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms" event={"ID":"5f7c4ef4-3c7d-472f-b9a4-e32600630f91","Type":"ContainerStarted","Data":"4d4087fcbfd8879d3f654f6eb310eb9f8fa54dbc0fee9e25769cf55eb66ea199"}
Jul 27 19:14:43.968124 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:43.968083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x" event={"ID":"45fd0158-f8ad-4457-9990-0d0dfff39d3e","Type":"ContainerStarted","Data":"ac9fc669a71bae42f89881b45e9a4323d6ceb58cff6eb62cf371782e5a367964"}
Jul 27 19:14:43.968558 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:43.968177    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:43.969550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:43.969525    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms" event={"ID":"5f7c4ef4-3c7d-472f-b9a4-e32600630f91","Type":"ContainerStarted","Data":"406c5cecb494b06ff97e38ba9897f6bdaf08ea00cd9ffcb2a76ae5fcfc0ec1af"}
Jul 27 19:14:43.969663 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:43.969591    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:43.986628 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:43.986594    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x" podStartSLOduration=1.190943122 podStartE2EDuration="2.986581833s" totalImagesPullingTime="1.795638711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:43.984149008 +0000 UTC m=+570.691288500" watchObservedRunningTime="2026-07-27 19:14:43.986581833 +0000 UTC m=+570.693721324"
Jul 27 19:14:44.002591 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:44.002544    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms" podStartSLOduration=1.026790322 podStartE2EDuration="3.00253162s" totalImagesPullingTime="1.975741298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:44.000757842 +0000 UTC m=+570.707897359" watchObservedRunningTime="2026-07-27 19:14:44.00253162 +0000 UTC m=+570.709671110"
Jul 27 19:14:54.976523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:54.976488    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2nz8x"
Jul 27 19:14:54.976976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:54.976680    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-pfwms"
Jul 27 19:14:58.752591 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.752559    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"]
Jul 27 19:14:58.757437 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.757413    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.760712 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.760686    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:14:58.762005 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.761987    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gtjpv\""
Jul 27 19:14:58.762129 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.762010    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:14:58.762129 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.761988    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 19:14:58.767361 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.767343    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"]
Jul 27 19:14:58.898584 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.898556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.898788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.898596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.898788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.898614    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkwkm\" (UniqueName: \"kubernetes.io/projected/f99c4768-6259-4175-af25-466872ae2698-kube-api-access-gkwkm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.898788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.898636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f99c4768-6259-4175-af25-466872ae2698-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.898788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.898664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.898788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.898719    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999295 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999271    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999303    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkwkm\" (UniqueName: \"kubernetes.io/projected/f99c4768-6259-4175-af25-466872ae2698-kube-api-access-gkwkm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999447    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f99c4768-6259-4175-af25-466872ae2698-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999490    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999644 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999752 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999657    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999833 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999782    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:58.999901 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:58.999884    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:59.001713 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:59.001690    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f99c4768-6259-4175-af25-466872ae2698-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:59.002163 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:59.002144    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f99c4768-6259-4175-af25-466872ae2698-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:59.007610 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:59.007558    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkwkm\" (UniqueName: \"kubernetes.io/projected/f99c4768-6259-4175-af25-466872ae2698-kube-api-access-gkwkm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4\" (UID: \"f99c4768-6259-4175-af25-466872ae2698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:59.071129 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:59.071100    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:14:59.218266 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:59.218238    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"]
Jul 27 19:14:59.219204 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:14:59.219180    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99c4768_6259_4175_af25_466872ae2698.slice/crio-d0d320f831619d91ff380537b570422f466e7e5f12412c2af69284341d40cc56 WatchSource:0}: Error finding container d0d320f831619d91ff380537b570422f466e7e5f12412c2af69284341d40cc56: Status 404 returned error can't find the container with id d0d320f831619d91ff380537b570422f466e7e5f12412c2af69284341d40cc56
Jul 27 19:14:59.270246 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:14:59.270159    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:15:00.067879 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:00.067847    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4" event={"ID":"f99c4768-6259-4175-af25-466872ae2698","Type":"ContainerStarted","Data":"d0d320f831619d91ff380537b570422f466e7e5f12412c2af69284341d40cc56"}
Jul 27 19:15:00.137343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:00.137311    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw"]
Jul 27 19:15:00.141855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:00.141779    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw"
Jul 27 19:15:00.144865 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:00.144842    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:15:00.145027 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:00.144896    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw"]
Jul 27 19:15:00.157028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:00.156915    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw"
Jul 27 19:15:00.362825 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:00.362236    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw"]
Jul 27 19:15:01.074534 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:01.074492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw" event={"ID":"82a7d3e7-f06e-44ce-96ff-3f53e3284b32","Type":"ContainerStarted","Data":"a71addf48f059f043b09040dc4421273bb32b2d27d37b16046bda905156c5b07"}
Jul 27 19:15:01.076049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:01.076025    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4" event={"ID":"f99c4768-6259-4175-af25-466872ae2698","Type":"ContainerStarted","Data":"0b2a43d2a9eca438ff3f122485a66c99adde26bd6b0d19700ef117ae376001b8"}
Jul 27 19:15:01.094669 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:01.094621    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4" podStartSLOduration=2.040468712 podStartE2EDuration="3.09460726s" totalImagesPullingTime="1.054138548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:01.092937033 +0000 UTC m=+587.800076525" watchObservedRunningTime="2026-07-27 19:15:01.09460726 +0000 UTC m=+587.801746750"
Jul 27 19:15:04.099361 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:04.099270    2557 generic.go:356] "Generic (PLEG): container finished" podID="82a7d3e7-f06e-44ce-96ff-3f53e3284b32" containerID="2c7ebb6895cc0dd456c98e6e96062ced16c7de7801dbaaf2147a6e9113ab4797" exitCode=0
Jul 27 19:15:04.099716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:04.099353    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw" event={"ID":"82a7d3e7-f06e-44ce-96ff-3f53e3284b32","Type":"ContainerDied","Data":"2c7ebb6895cc0dd456c98e6e96062ced16c7de7801dbaaf2147a6e9113ab4797"}
Jul 27 19:15:05.258798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:05.258772    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw"
Jul 27 19:15:06.111271 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:06.111200    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw"
Jul 27 19:15:06.111411 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:06.111194    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752995-mjplw" event={"ID":"82a7d3e7-f06e-44ce-96ff-3f53e3284b32","Type":"ContainerDied","Data":"a71addf48f059f043b09040dc4421273bb32b2d27d37b16046bda905156c5b07"}
Jul 27 19:15:06.111411 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:06.111317    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a71addf48f059f043b09040dc4421273bb32b2d27d37b16046bda905156c5b07"
Jul 27 19:15:08.267571 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:08.267538    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:15:09.072048 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:09.072013    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:15:09.072255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:09.072084    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:15:09.084270 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:09.084244    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:15:09.138852 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:09.138829    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4"
Jul 27 19:15:13.728105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:13.728074    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:15:13.728576 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:13.728152    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:15:13.733537 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:13.733516    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:15:13.733665 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:13.733602    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:15:17.169160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:17.169131    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:15:27.637520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.637480    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"]
Jul 27 19:15:27.638029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.637941    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a7d3e7-f06e-44ce-96ff-3f53e3284b32" containerName="cleanup"
Jul 27 19:15:27.638029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.637953    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a7d3e7-f06e-44ce-96ff-3f53e3284b32" containerName="cleanup"
Jul 27 19:15:27.638029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.638020    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a7d3e7-f06e-44ce-96ff-3f53e3284b32" containerName="cleanup"
Jul 27 19:15:27.641952 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.641930    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.645006 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.644989    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 19:15:27.652549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.652528    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"]
Jul 27 19:15:27.727938 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.727907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.727938 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.727940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.728130 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.727957    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9hjc\" (UniqueName: \"kubernetes.io/projected/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-kube-api-access-k9hjc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.728130 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.727980    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.728130 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.728036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.728130 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.728073    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.828779 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.828750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.828982 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.828829    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.828982 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.828974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.829103 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.828999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.829202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.829175    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.829202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.829198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.829202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.829165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9hjc\" (UniqueName: \"kubernetes.io/projected/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-kube-api-access-k9hjc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.829408 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.829253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.829576 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.829558    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.831259 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.831238    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.831531 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.831512    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.838484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.838460    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9hjc\" (UniqueName: \"kubernetes.io/projected/1ae7a693-c1d8-4743-89e2-f3376f7e0ee3-kube-api-access-k9hjc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb\" (UID: \"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:27.952584 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:27.952552    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:28.098511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:28.098487    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"]
Jul 27 19:15:28.100251 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:15:28.100227    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae7a693_c1d8_4743_89e2_f3376f7e0ee3.slice/crio-69debb10c7e0885609794d17f7e76afcb359448efa956bad743e158fbccea918 WatchSource:0}: Error finding container 69debb10c7e0885609794d17f7e76afcb359448efa956bad743e158fbccea918: Status 404 returned error can't find the container with id 69debb10c7e0885609794d17f7e76afcb359448efa956bad743e158fbccea918
Jul 27 19:15:28.102087 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:28.102069    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:15:28.237683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:28.237607    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb" event={"ID":"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3","Type":"ContainerStarted","Data":"69debb10c7e0885609794d17f7e76afcb359448efa956bad743e158fbccea918"}
Jul 27 19:15:29.246128 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:29.246089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb" event={"ID":"1ae7a693-c1d8-4743-89e2-f3376f7e0ee3","Type":"ContainerStarted","Data":"2b73568e4f4f27e6074d927dc00ef8ccb9f6775675851d07a495a081c4a3f625"}
Jul 27 19:15:29.262903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:29.262873    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:15:29.265310 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:29.265270    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb" podStartSLOduration=2.055716859 podStartE2EDuration="2.265255217s" totalImagesPullingTime="209.538358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:29.262847966 +0000 UTC m=+615.969987456" watchObservedRunningTime="2026-07-27 19:15:29.265255217 +0000 UTC m=+615.972394707"
Jul 27 19:15:35.558307 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:35.558226    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:15:37.953546 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:37.953511    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:37.953946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:37.953577    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:37.965841 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:37.965819    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:38.314000 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:38.313921    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb"
Jul 27 19:15:48.465271 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:15:48.465237    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:17:18.562902 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.562863    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-845c85cc44-hcwbz"]
Jul 27 19:17:18.563448 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.563097    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-845c85cc44-hcwbz" podUID="dc56206a-e254-4ec9-a7c3-014154f97a84" containerName="authorino" containerID="cri-o://3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5" gracePeriod=30
Jul 27 19:17:18.820053 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.820000    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:17:18.910422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.910389    2557 generic.go:356] "Generic (PLEG): container finished" podID="dc56206a-e254-4ec9-a7c3-014154f97a84" containerID="3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5" exitCode=0
Jul 27 19:17:18.910422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.910426    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-845c85cc44-hcwbz" event={"ID":"dc56206a-e254-4ec9-a7c3-014154f97a84","Type":"ContainerDied","Data":"3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5"}
Jul 27 19:17:18.910656 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.910434    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845c85cc44-hcwbz"
Jul 27 19:17:18.910656 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.910452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-845c85cc44-hcwbz" event={"ID":"dc56206a-e254-4ec9-a7c3-014154f97a84","Type":"ContainerDied","Data":"8334a110f0ecd7b11003a66610c234794fe98e3a095e94f44130b68014a9b1f7"}
Jul 27 19:17:18.910656 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.910476    2557 scope.go:117] "RemoveContainer" containerID="3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5"
Jul 27 19:17:18.919911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.919900    2557 scope.go:117] "RemoveContainer" containerID="3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5"
Jul 27 19:17:18.920154 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:17:18.920137    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5\": container with ID starting with 3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5 not found: ID does not exist" containerID="3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5"
Jul 27 19:17:18.920201 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.920170    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5"} err="failed to get container status \"3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5\": rpc error: code = NotFound desc = could not find container \"3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5\": container with ID starting with 3b1e552bfe2df259908d578eef7c308442245a1f02a3b4fce908182df50f4fb5 not found: ID does not exist"
Jul 27 19:17:18.936487 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.936465    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc56206a-e254-4ec9-a7c3-014154f97a84-tls-cert\") pod \"dc56206a-e254-4ec9-a7c3-014154f97a84\" (UID: \"dc56206a-e254-4ec9-a7c3-014154f97a84\") "
Jul 27 19:17:18.936566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.936498    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krcpj\" (UniqueName: \"kubernetes.io/projected/dc56206a-e254-4ec9-a7c3-014154f97a84-kube-api-access-krcpj\") pod \"dc56206a-e254-4ec9-a7c3-014154f97a84\" (UID: \"dc56206a-e254-4ec9-a7c3-014154f97a84\") "
Jul 27 19:17:18.938556 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.938529    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc56206a-e254-4ec9-a7c3-014154f97a84-kube-api-access-krcpj" (OuterVolumeSpecName: "kube-api-access-krcpj") pod "dc56206a-e254-4ec9-a7c3-014154f97a84" (UID: "dc56206a-e254-4ec9-a7c3-014154f97a84"). InnerVolumeSpecName "kube-api-access-krcpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:17:18.947606 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:18.947584    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc56206a-e254-4ec9-a7c3-014154f97a84-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dc56206a-e254-4ec9-a7c3-014154f97a84" (UID: "dc56206a-e254-4ec9-a7c3-014154f97a84"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:17:19.037701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:19.037673    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc56206a-e254-4ec9-a7c3-014154f97a84-tls-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:17:19.037701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:19.037696    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krcpj\" (UniqueName: \"kubernetes.io/projected/dc56206a-e254-4ec9-a7c3-014154f97a84-kube-api-access-krcpj\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:17:19.238647 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:19.238618    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-845c85cc44-hcwbz"]
Jul 27 19:17:19.246668 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:19.246642    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-845c85cc44-hcwbz"]
Jul 27 19:17:19.790727 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:19.790698    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc56206a-e254-4ec9-a7c3-014154f97a84" path="/var/lib/kubelet/pods/dc56206a-e254-4ec9-a7c3-014154f97a84/volumes"
Jul 27 19:17:46.774410 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:46.774376    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:17:58.674738 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:17:58.674701    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:18:05.703261 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:05.703222    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-c8qnl"]
Jul 27 19:18:05.703775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:05.703458    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl" podUID="ee3117fb-6435-419d-91ea-3d0b9fc4baec" containerName="manager" containerID="cri-o://530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e" gracePeriod=30
Jul 27 19:18:05.958431 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:05.958374    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:18:06.085309 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.085273    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh72h\" (UniqueName: \"kubernetes.io/projected/ee3117fb-6435-419d-91ea-3d0b9fc4baec-kube-api-access-dh72h\") pod \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\" (UID: \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\") "
Jul 27 19:18:06.085476 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.085320    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee3117fb-6435-419d-91ea-3d0b9fc4baec-webhook-cert\") pod \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\" (UID: \"ee3117fb-6435-419d-91ea-3d0b9fc4baec\") "
Jul 27 19:18:06.087501 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.087469    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3117fb-6435-419d-91ea-3d0b9fc4baec-kube-api-access-dh72h" (OuterVolumeSpecName: "kube-api-access-dh72h") pod "ee3117fb-6435-419d-91ea-3d0b9fc4baec" (UID: "ee3117fb-6435-419d-91ea-3d0b9fc4baec"). InnerVolumeSpecName "kube-api-access-dh72h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:18:06.087617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.087551    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee3117fb-6435-419d-91ea-3d0b9fc4baec-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ee3117fb-6435-419d-91ea-3d0b9fc4baec" (UID: "ee3117fb-6435-419d-91ea-3d0b9fc4baec"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:18:06.186953 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.186900    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh72h\" (UniqueName: \"kubernetes.io/projected/ee3117fb-6435-419d-91ea-3d0b9fc4baec-kube-api-access-dh72h\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:18:06.186953 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.186948    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee3117fb-6435-419d-91ea-3d0b9fc4baec-webhook-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:18:06.196190 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.196162    2557 generic.go:356] "Generic (PLEG): container finished" podID="ee3117fb-6435-419d-91ea-3d0b9fc4baec" containerID="530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e" exitCode=0
Jul 27 19:18:06.196345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.196209    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl"
Jul 27 19:18:06.196345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.196252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl" event={"ID":"ee3117fb-6435-419d-91ea-3d0b9fc4baec","Type":"ContainerDied","Data":"530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e"}
Jul 27 19:18:06.196345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.196300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-c8qnl" event={"ID":"ee3117fb-6435-419d-91ea-3d0b9fc4baec","Type":"ContainerDied","Data":"ecfa6a230637539d82347612a4615a8975ead959cfed6561d1778584b76ff4f1"}
Jul 27 19:18:06.196345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.196323    2557 scope.go:117] "RemoveContainer" containerID="530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e"
Jul 27 19:18:06.206346 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.206329    2557 scope.go:117] "RemoveContainer" containerID="530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e"
Jul 27 19:18:06.206596 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:18:06.206580    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e\": container with ID starting with 530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e not found: ID does not exist" containerID="530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e"
Jul 27 19:18:06.206657 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.206608    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e"} err="failed to get container status \"530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e\": rpc error: code = NotFound desc = could not find container \"530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e\": container with ID starting with 530eaeca028ed2d0eafa1e35db89abba13ae5244a31d5d9611174044e7a0eb1e not found: ID does not exist"
Jul 27 19:18:06.218369 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.218320    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-c8qnl"]
Jul 27 19:18:06.222982 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:06.222962    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-c8qnl"]
Jul 27 19:18:07.790643 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:07.790605    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee3117fb-6435-419d-91ea-3d0b9fc4baec" path="/var/lib/kubelet/pods/ee3117fb-6435-419d-91ea-3d0b9fc4baec/volumes"
Jul 27 19:18:07.857397 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:18:07.857374    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:19:07.031993 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.031961    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-2t455"]
Jul 27 19:19:07.032424 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.032410    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3117fb-6435-419d-91ea-3d0b9fc4baec" containerName="manager"
Jul 27 19:19:07.032470 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.032428    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3117fb-6435-419d-91ea-3d0b9fc4baec" containerName="manager"
Jul 27 19:19:07.032470 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.032454    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc56206a-e254-4ec9-a7c3-014154f97a84" containerName="authorino"
Jul 27 19:19:07.032470 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.032459    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc56206a-e254-4ec9-a7c3-014154f97a84" containerName="authorino"
Jul 27 19:19:07.032562 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.032521    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc56206a-e254-4ec9-a7c3-014154f97a84" containerName="authorino"
Jul 27 19:19:07.032562 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.032531    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3117fb-6435-419d-91ea-3d0b9fc4baec" containerName="manager"
Jul 27 19:19:07.034879 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.034864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:07.037777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.037758    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 19:19:07.038887 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.038864    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4p2wz\""
Jul 27 19:19:07.039012 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.038928    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 19:19:07.044016 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.043995    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-2t455"]
Jul 27 19:19:07.148878 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.148834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16101192-58e8-4fce-a6cd-5e9261a45bf3-webhook-cert\") pod \"maas-controller-7c6f6dbc64-2t455\" (UID: \"16101192-58e8-4fce-a6cd-5e9261a45bf3\") " pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:07.149063 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.148973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5g97\" (UniqueName: \"kubernetes.io/projected/16101192-58e8-4fce-a6cd-5e9261a45bf3-kube-api-access-s5g97\") pod \"maas-controller-7c6f6dbc64-2t455\" (UID: \"16101192-58e8-4fce-a6cd-5e9261a45bf3\") " pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:07.249646 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.249607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5g97\" (UniqueName: \"kubernetes.io/projected/16101192-58e8-4fce-a6cd-5e9261a45bf3-kube-api-access-s5g97\") pod \"maas-controller-7c6f6dbc64-2t455\" (UID: \"16101192-58e8-4fce-a6cd-5e9261a45bf3\") " pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:07.249777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.249679    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16101192-58e8-4fce-a6cd-5e9261a45bf3-webhook-cert\") pod \"maas-controller-7c6f6dbc64-2t455\" (UID: \"16101192-58e8-4fce-a6cd-5e9261a45bf3\") " pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:07.252350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.252328    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16101192-58e8-4fce-a6cd-5e9261a45bf3-webhook-cert\") pod \"maas-controller-7c6f6dbc64-2t455\" (UID: \"16101192-58e8-4fce-a6cd-5e9261a45bf3\") " pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:07.257762 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.257743    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5g97\" (UniqueName: \"kubernetes.io/projected/16101192-58e8-4fce-a6cd-5e9261a45bf3-kube-api-access-s5g97\") pod \"maas-controller-7c6f6dbc64-2t455\" (UID: \"16101192-58e8-4fce-a6cd-5e9261a45bf3\") " pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:07.346062 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.345964    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:07.485724 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.485696    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-2t455"]
Jul 27 19:19:07.486954 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:19:07.486908    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16101192_58e8_4fce_a6cd_5e9261a45bf3.slice/crio-453388ed75528c178e25f895b99fdf47404f20907c98766864fc7f56dc7106ba WatchSource:0}: Error finding container 453388ed75528c178e25f895b99fdf47404f20907c98766864fc7f56dc7106ba: Status 404 returned error can't find the container with id 453388ed75528c178e25f895b99fdf47404f20907c98766864fc7f56dc7106ba
Jul 27 19:19:07.560283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:07.560255    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-2t455" event={"ID":"16101192-58e8-4fce-a6cd-5e9261a45bf3","Type":"ContainerStarted","Data":"453388ed75528c178e25f895b99fdf47404f20907c98766864fc7f56dc7106ba"}
Jul 27 19:19:08.567315 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:08.567278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-2t455" event={"ID":"16101192-58e8-4fce-a6cd-5e9261a45bf3","Type":"ContainerStarted","Data":"30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4"}
Jul 27 19:19:08.567698 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:08.567411    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:08.587828 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:08.587761    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c6f6dbc64-2t455" podStartSLOduration=1.149907595 podStartE2EDuration="1.587742275s" totalImagesPullingTime="437.83468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:19:08.587236999 +0000 UTC m=+835.294376491" watchObservedRunningTime="2026-07-27 19:19:08.587742275 +0000 UTC m=+835.294881761"
Jul 27 19:19:19.575057 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:19.575025    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:24.260026 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.259988    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-2t455"]
Jul 27 19:19:24.260635 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.260228    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c6f6dbc64-2t455" podUID="16101192-58e8-4fce-a6cd-5e9261a45bf3" containerName="manager" containerID="cri-o://30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4" gracePeriod=30
Jul 27 19:19:24.527150 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.527127    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:24.590698 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.590671    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16101192-58e8-4fce-a6cd-5e9261a45bf3-webhook-cert\") pod \"16101192-58e8-4fce-a6cd-5e9261a45bf3\" (UID: \"16101192-58e8-4fce-a6cd-5e9261a45bf3\") "
Jul 27 19:19:24.590899 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.590705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5g97\" (UniqueName: \"kubernetes.io/projected/16101192-58e8-4fce-a6cd-5e9261a45bf3-kube-api-access-s5g97\") pod \"16101192-58e8-4fce-a6cd-5e9261a45bf3\" (UID: \"16101192-58e8-4fce-a6cd-5e9261a45bf3\") "
Jul 27 19:19:24.592976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.592946    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16101192-58e8-4fce-a6cd-5e9261a45bf3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "16101192-58e8-4fce-a6cd-5e9261a45bf3" (UID: "16101192-58e8-4fce-a6cd-5e9261a45bf3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:19:24.593160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.593136    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16101192-58e8-4fce-a6cd-5e9261a45bf3-kube-api-access-s5g97" (OuterVolumeSpecName: "kube-api-access-s5g97") pod "16101192-58e8-4fce-a6cd-5e9261a45bf3" (UID: "16101192-58e8-4fce-a6cd-5e9261a45bf3"). InnerVolumeSpecName "kube-api-access-s5g97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:19:24.658601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.658570    2557 generic.go:356] "Generic (PLEG): container finished" podID="16101192-58e8-4fce-a6cd-5e9261a45bf3" containerID="30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4" exitCode=0
Jul 27 19:19:24.658785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.658617    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-2t455"
Jul 27 19:19:24.658785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.658659    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-2t455" event={"ID":"16101192-58e8-4fce-a6cd-5e9261a45bf3","Type":"ContainerDied","Data":"30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4"}
Jul 27 19:19:24.658785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.658711    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-2t455" event={"ID":"16101192-58e8-4fce-a6cd-5e9261a45bf3","Type":"ContainerDied","Data":"453388ed75528c178e25f895b99fdf47404f20907c98766864fc7f56dc7106ba"}
Jul 27 19:19:24.658785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.658735    2557 scope.go:117] "RemoveContainer" containerID="30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4"
Jul 27 19:19:24.668495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.668479    2557 scope.go:117] "RemoveContainer" containerID="30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4"
Jul 27 19:19:24.668734 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:19:24.668712    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4\": container with ID starting with 30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4 not found: ID does not exist" containerID="30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4"
Jul 27 19:19:24.668794 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.668741    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4"} err="failed to get container status \"30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4\": rpc error: code = NotFound desc = could not find container \"30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4\": container with ID starting with 30412419a8f86203335d51e2141bb4dbc9f29108bb9fd86e39c53e32a51c3ad4 not found: ID does not exist"
Jul 27 19:19:24.683216 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.683192    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-2t455"]
Jul 27 19:19:24.687850 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.687832    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-2t455"]
Jul 27 19:19:24.691836 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.691791    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5g97\" (UniqueName: \"kubernetes.io/projected/16101192-58e8-4fce-a6cd-5e9261a45bf3-kube-api-access-s5g97\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:19:24.691900 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:24.691842    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16101192-58e8-4fce-a6cd-5e9261a45bf3-webhook-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:19:25.568359 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.568321    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-6zhqs"]
Jul 27 19:19:25.568792 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.568776    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16101192-58e8-4fce-a6cd-5e9261a45bf3" containerName="manager"
Jul 27 19:19:25.568867 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.568796    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="16101192-58e8-4fce-a6cd-5e9261a45bf3" containerName="manager"
Jul 27 19:19:25.568903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.568896    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="16101192-58e8-4fce-a6cd-5e9261a45bf3" containerName="manager"
Jul 27 19:19:25.573709 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.573694    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:25.578050 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.578020    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 19:19:25.578050 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.578020    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4p2wz\""
Jul 27 19:19:25.578050 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.578023    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 19:19:25.582010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.581767    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-6zhqs"]
Jul 27 19:19:25.600522 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.600489    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkszg\" (UniqueName: \"kubernetes.io/projected/a578d919-1308-49c3-b00d-5d81813a0d20-kube-api-access-pkszg\") pod \"maas-controller-7c6f6dbc64-6zhqs\" (UID: \"a578d919-1308-49c3-b00d-5d81813a0d20\") " pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:25.600701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.600602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a578d919-1308-49c3-b00d-5d81813a0d20-webhook-cert\") pod \"maas-controller-7c6f6dbc64-6zhqs\" (UID: \"a578d919-1308-49c3-b00d-5d81813a0d20\") " pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:25.702000 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.701973    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkszg\" (UniqueName: \"kubernetes.io/projected/a578d919-1308-49c3-b00d-5d81813a0d20-kube-api-access-pkszg\") pod \"maas-controller-7c6f6dbc64-6zhqs\" (UID: \"a578d919-1308-49c3-b00d-5d81813a0d20\") " pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:25.702165 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.702055    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a578d919-1308-49c3-b00d-5d81813a0d20-webhook-cert\") pod \"maas-controller-7c6f6dbc64-6zhqs\" (UID: \"a578d919-1308-49c3-b00d-5d81813a0d20\") " pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:25.704719 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.704696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a578d919-1308-49c3-b00d-5d81813a0d20-webhook-cert\") pod \"maas-controller-7c6f6dbc64-6zhqs\" (UID: \"a578d919-1308-49c3-b00d-5d81813a0d20\") " pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:25.710670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.710647    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkszg\" (UniqueName: \"kubernetes.io/projected/a578d919-1308-49c3-b00d-5d81813a0d20-kube-api-access-pkszg\") pod \"maas-controller-7c6f6dbc64-6zhqs\" (UID: \"a578d919-1308-49c3-b00d-5d81813a0d20\") " pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:25.790640 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.790607    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16101192-58e8-4fce-a6cd-5e9261a45bf3" path="/var/lib/kubelet/pods/16101192-58e8-4fce-a6cd-5e9261a45bf3/volumes"
Jul 27 19:19:25.885595 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:25.885517    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:26.034758 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:26.034730    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c6f6dbc64-6zhqs"]
Jul 27 19:19:26.035511 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:19:26.035482    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda578d919_1308_49c3_b00d_5d81813a0d20.slice/crio-8f4cb5146f8d439334dabcb9371aeb130ff4bdeb26fe5484c1aed77d8bba3b7b WatchSource:0}: Error finding container 8f4cb5146f8d439334dabcb9371aeb130ff4bdeb26fe5484c1aed77d8bba3b7b: Status 404 returned error can't find the container with id 8f4cb5146f8d439334dabcb9371aeb130ff4bdeb26fe5484c1aed77d8bba3b7b
Jul 27 19:19:26.673791 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:26.673713    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs" event={"ID":"a578d919-1308-49c3-b00d-5d81813a0d20","Type":"ContainerStarted","Data":"eb28b7c9ab3fb7165228613236e399f907a2547ec07d77dca538b296ab026969"}
Jul 27 19:19:26.673791 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:26.673760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs" event={"ID":"a578d919-1308-49c3-b00d-5d81813a0d20","Type":"ContainerStarted","Data":"8f4cb5146f8d439334dabcb9371aeb130ff4bdeb26fe5484c1aed77d8bba3b7b"}
Jul 27 19:19:26.674205 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:26.673838    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:26.697741 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:26.697695    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs" podStartSLOduration=1.37060456 podStartE2EDuration="1.697680232s" totalImagesPullingTime="327.075672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:19:26.695576495 +0000 UTC m=+853.402716026" watchObservedRunningTime="2026-07-27 19:19:26.697680232 +0000 UTC m=+853.404819724"
Jul 27 19:19:37.682055 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:37.682026    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c6f6dbc64-6zhqs"
Jul 27 19:19:47.972714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:19:47.972682    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:20:01.767207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:01.767179    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:20:13.765463 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:13.765426    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:20:13.767748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:13.767713    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:20:13.770555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:13.770538    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:20:13.772756 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:13.772735    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:20:35.664700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:35.664661    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:20:42.766995 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:42.766954    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:20:53.473211 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:53.473176    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:20:59.373552 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:20:59.373516    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:21:09.270640 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:21:09.270602    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:21:18.876177 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:21:18.876134    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:21:30.677349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:21:30.677316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:21:40.460330 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:21:40.460252    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:22:03.467310 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:22:03.467275    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:22:14.887081 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:22:14.887029    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:22:39.162211 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:22:39.162167    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:22:49.780825 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:22:49.780778    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:23:05.373237 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:23:05.373146    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:23:15.372657 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:23:15.372621    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:23:31.873323 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:23:31.873285    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:24:47.399077 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:24:47.398988    2557 controller.go:195] "Failed to update lease" err="Put \"https://a82669798d5934033bcdc3cd78de0236-cf195a13caca6ff9.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-171.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 27 19:24:57.399796 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:24:57.399757    2557 controller.go:195] "Failed to update lease" err="Put \"https://a82669798d5934033bcdc3cd78de0236-cf195a13caca6ff9.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-171.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 27 19:25:07.400764 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:25:07.400717    2557 controller.go:195] "Failed to update lease" err="Put \"https://a82669798d5934033bcdc3cd78de0236-cf195a13caca6ff9.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-171.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:25:12.324824 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324759    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-parameters\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.324824 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324759    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.324824 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324780    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324849    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4p2wz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324851    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324862    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-p9bkn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324886    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-dockercfg-m8xt6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324886    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2lmcz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324921    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324932    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324937    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324944    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324961    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.324975    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325001    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325017    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325030    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325046    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325047    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325054    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.325360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325057    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325091    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-xbbqc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325093    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325114    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325115    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325125    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325140    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b6vjb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325144    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2mlls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325161    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325163    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vbp7j\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325165    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325182    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325195    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325198    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325199    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325220    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z2dx6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325226    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6kxtg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325238    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325242    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325265    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325271    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325278    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325284    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325302    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325314    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325321    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325334    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325356    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325379    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325398    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sqrg8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325405    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b7nfp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325418    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325430    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325459    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ws6vn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325469    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-gtjpv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325475    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.326856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325493    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2xl5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325496    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325531    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7pgv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325537    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325537    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zgrhj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325543    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kqksx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325561    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325559    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325576    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325650    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9k8bt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325586    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325621    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325667    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325629    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g68sl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325680    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325636    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8j5l9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325583    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325665    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.327478 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325625    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325684    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325699    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325714    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325724    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325735    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325750    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bfqsl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325761    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325760    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325773    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vd7hk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325778    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325791    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325779    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-46hlb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325839    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325853    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325874    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325878    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325895    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325889    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325883    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325923    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-n8dcc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325917    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325900    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325938    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325937    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x49b2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325949    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325937    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dzws5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325930    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325953    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325971    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325966    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wwdnp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325985    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325988    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325995    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6gkbd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326001    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325985    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.328626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.325972    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326012    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326004    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mft6x\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326007    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326019    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326017    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326042    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326049    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326054    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326055    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pv96r\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326039    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326066    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326078    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326073    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"default-dockercfg-j6mn5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326091    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326097    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p6fq9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326104    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326107    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326119    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326125    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"service-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326132    2557 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326136    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pxl4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326126    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326148    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7dvk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326121    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326152    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326160    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326164    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326160    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326175    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326182    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326191    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326196    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kgxf9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326173    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326167    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326203    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.329748 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326209    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326209    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2bjcl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326228    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326230    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326242    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326208    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326246    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326255    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fz2xt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:25:12.326241    2557 controller.go:195] "Failed to update lease" err="Put \"https://a82669798d5934033bcdc3cd78de0236-cf195a13caca6ff9.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-171.ec2.internal?timeout=10s\": http2: client connection lost"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326269    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326278    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h9bsf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326283    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326298    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326306    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xt2gt\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326307    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326305    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-djppn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326329    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326336    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.330322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326261    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2m7nv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326358    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326366    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g4z4v\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326385    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326383    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326395    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326400    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326402    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9sksrvmqbs4dd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326402    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326431    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zz7x4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326432    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326443    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326436    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:12.331143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:12.326432    2557 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 19:25:13.134108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.134079    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zz7x4\""
Jul 27 19:25:13.142038 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.142009    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:25:13.143043 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.143026    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.145580 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.145563    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 19:25:13.147019 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.147001    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 19:25:13.151217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.151199    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 19:25:13.151440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.151425    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:25:13.157215 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.157200    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:25:13.163520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.163504    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 19:25:13.164177 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.164163    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.165241 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.165223    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vbp7j\""
Jul 27 19:25:13.167022 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.167008    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mft6x\""
Jul 27 19:25:13.168656 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.168642    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zgrhj\""
Jul 27 19:25:13.174029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.174016    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xt2gt\""
Jul 27 19:25:13.175172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.175157    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.182255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.182237    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.182349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.182307    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 19:25:13.184349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.184335    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2lmcz\""
Jul 27 19:25:13.202017 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.201983    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 19:25:13.202144 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.202034    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.205188 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.205171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 19:25:13.207947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.207931    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.212345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.212327    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:25:13.217932 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.217918    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 19:25:13.223584 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.223565    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.227302 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.227287    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h9bsf\""
Jul 27 19:25:13.231642 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.231629    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 19:25:13.233241 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.233224    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.239872 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.239856    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 19:25:13.239964 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.239864    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-p9bkn\""
Jul 27 19:25:13.240838 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.240803    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:13.249274 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.249261    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.261185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.261169    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 19:25:13.261802 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.261790    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 19:25:13.284186 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.284166    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.287693 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.287679    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:25:13.293111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.293095    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 19:25:13.293209 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.293196    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:25:13.293313 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.293296    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.297531 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.297517    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.306885 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.306869    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 19:25:13.308676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.308661    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.311409 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.311394    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 19:25:13.323043 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.323025    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x49b2\""
Jul 27 19:25:13.327419 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.327405    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.328401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.328388    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 19:25:13.329973 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.329959    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4p2wz\""
Jul 27 19:25:13.334102 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.334085    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 19:25:13.335686 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.335673    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.341329 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.341314    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dzws5\""
Jul 27 19:25:13.342361 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.342345    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 19:25:13.344117 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.344102    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.344209 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.344193    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m8xt6\""
Jul 27 19:25:13.346940 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.346926    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:25:13.353395 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.353381    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 19:25:13.356992 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.356977    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:25:13.358082 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.358069    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ws6vn\""
Jul 27 19:25:13.359628 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.359613    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.365082 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.365068    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vd7hk\""
Jul 27 19:25:13.370833 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.370798    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pxl4\""
Jul 27 19:25:13.370893 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.370799    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.371106 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.371091    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:25:13.373982 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.373969    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 19:25:13.377216 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.377200    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:25:13.377216 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.377212    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.380383 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.380370    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:25:13.399179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.399117    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b7nfp\""
Jul 27 19:25:13.399268 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.399185    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 19:25:13.400015 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.400002    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:25:13.405233 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.405220    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:25:13.413113 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.413094    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 19:25:13.420550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.420533    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 19:25:13.423546 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.423533    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7pgv\""
Jul 27 19:25:13.425122 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.425109    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bfqsl\""
Jul 27 19:25:13.429512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.429500    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.433998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.433986    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.435252 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.435238    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.436666 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.436654    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.438244 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.438231    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pv96r\""
Jul 27 19:25:13.438393 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.438380    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:25:13.439753 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.439741    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.450820 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.450786    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-djppn\""
Jul 27 19:25:13.451592 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.451579    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7dvk\""
Jul 27 19:25:13.460439 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.460422    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.466086 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.466071    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.470934 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.470910    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wwdnp\""
Jul 27 19:25:13.482947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.482924    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.484585 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.484572    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b6vjb\""
Jul 27 19:25:13.506217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.506195    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.506283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.506255    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:25:13.517335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.517314    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kgxf9\""
Jul 27 19:25:13.534944 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.534914    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.537631 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.537616    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:25:13.545822 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.545797    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 19:25:13.547721 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.547708    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g68sl\""
Jul 27 19:25:13.550238 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.550225    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:13.555480 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.555467    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:13.561041 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.561023    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 19:25:13.564777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.564764    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 19:25:13.566047 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.566034    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 19:25:13.566362 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.566339    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.567702 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.567686    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-j6mn5\""
Jul 27 19:25:13.568919 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.568908    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:25:13.575379 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.575365    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.577036 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.577018    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.584169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.584155    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 19:25:13.590555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.590540    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:25:13.601117 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.601101    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8j5l9\""
Jul 27 19:25:13.607720 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.607706    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 19:25:13.621399 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.615824    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:13.621765 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.621747    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2m7nv\""
Jul 27 19:25:13.626662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.626644    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g4z4v\""
Jul 27 19:25:13.631101 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.631081    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.633915 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.633900    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z2dx6\""
Jul 27 19:25:13.638024 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.638007    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 19:25:13.639065 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.639052    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:25:13.640570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.640549    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 19:25:13.642314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.642299    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2bjcl\""
Jul 27 19:25:13.654192 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.654140    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 19:25:13.654962 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.654950    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 19:25:13.664772 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.664755    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.676533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.676516    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2xl5\""
Jul 27 19:25:13.679847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.679830    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 19:25:13.682475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.682458    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fz2xt\""
Jul 27 19:25:13.711490 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.711466    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 19:25:13.711861 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.711848    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:25:13.712228 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.712216    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 19:25:13.718714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.718701    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.722750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.722737    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 19:25:13.735424 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.735407    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.754739 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.754722    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.783361 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.783337    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2mlls\""
Jul 27 19:25:13.794641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.794620    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:13.808421 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.808398    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:25:13.811456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.811436    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:25:13.814072 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.814052    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:25:13.815166 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.815149    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 19:25:13.816775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.816757    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:25:13.835591 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.835572    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 19:25:13.854905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.854884    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.874729 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.874706    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 19:25:13.894849 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.894829    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 19:25:13.914088 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.914036    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:25:13.934533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.934510    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:25:13.954937 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.954910    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6gkbd\""
Jul 27 19:25:13.975074 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.975055    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:25:13.994563 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:13.994547    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p6fq9\""
Jul 27 19:25:14.014370 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.014351    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 19:25:14.034301 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.034281    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:25:14.054166 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.054148    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 19:25:14.074404 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.074384    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6kxtg\""
Jul 27 19:25:14.094282 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.094255    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xbbqc\""
Jul 27 19:25:14.114840 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.114801    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:25:14.134926 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.134899    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 19:25:14.155325 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.155305    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kqksx\""
Jul 27 19:25:14.174036 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.173979    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:14.195148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.195133    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 19:25:14.214622 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.214601    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9sksrvmqbs4dd\""
Jul 27 19:25:14.234604 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.234581    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:25:14.254575 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.254555    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 19:25:14.274319 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.274296    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-46hlb\""
Jul 27 19:25:14.293988 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.293968    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 19:25:14.314605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.314579    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:14.334699 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.334677    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 19:25:14.354535 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.354512    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 19:25:14.374839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.374801    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:25:14.394570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.394548    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:25:14.414617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.414594    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 19:25:14.435038 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.435022    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sqrg8\""
Jul 27 19:25:14.454339 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.454324    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 19:25:14.474860 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.474844    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:25:14.493957 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.493936    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:25:14.514903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.514878    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gtjpv\""
Jul 27 19:25:14.534631 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.534610    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9k8bt\""
Jul 27 19:25:14.554462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.554437    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 19:25:14.575022 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.575004    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:25:14.594325 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.594305    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 19:25:14.614479 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.614460    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:25:14.634218 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.634197    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 19:25:14.654210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.654186    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n8dcc\""
Jul 27 19:25:14.675226 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:14.675205    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:31.671312 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:31.671282    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:25:42.963311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:42.963276    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:25:52.970934 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:25:52.970890    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:26:04.659770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:26:04.659689    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:26:15.765433 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:26:15.765395    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:26:25.059901 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:26:25.059863    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:26:35.371431 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:26:35.371392    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:26:45.859075 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:26:45.859040    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:26:56.764794 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:26:56.764758    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:27:04.461911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:27:04.461881    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:27:13.472703 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:27:13.472667    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:27:22.565860 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:27:22.565799    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:27:41.063458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:27:41.063386    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:27:50.966129 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:27:50.966100    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:28:04.680440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:28:04.680405    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:28:12.665212 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:28:12.665182    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:28:59.663456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:28:59.663422    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:29:13.059667 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:29:13.059637    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:29:21.959252 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:29:21.959222    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:29:33.170488 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:29:33.170457    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:29:42.856378 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:29:42.856339    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:29:51.375473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:29:51.375440    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:29:59.051468 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:29:59.051437    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:30:00.144021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:00.143990    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp"]
Jul 27 19:30:00.147652 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:00.147635    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp"
Jul 27 19:30:00.150686 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:00.150667    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:30:00.156256 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:00.156145    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp"]
Jul 27 19:30:00.159720 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:00.159702    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp"
Jul 27 19:30:00.297317 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:00.297281    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp"]
Jul 27 19:30:00.297758 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:30:00.297735    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f415ef6_d279_4149_9708_c77ed3e1fc7c.slice/crio-49cffb6853f14a7f974ab378643534102a875c9be4755cea4f22850b16ae0d8b WatchSource:0}: Error finding container 49cffb6853f14a7f974ab378643534102a875c9be4755cea4f22850b16ae0d8b: Status 404 returned error can't find the container with id 49cffb6853f14a7f974ab378643534102a875c9be4755cea4f22850b16ae0d8b
Jul 27 19:30:00.355782 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:00.355755    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp" event={"ID":"3f415ef6-d279-4149-9708-c77ed3e1fc7c","Type":"ContainerStarted","Data":"49cffb6853f14a7f974ab378643534102a875c9be4755cea4f22850b16ae0d8b"}
Jul 27 19:30:01.364217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:01.364175    2557 generic.go:356] "Generic (PLEG): container finished" podID="3f415ef6-d279-4149-9708-c77ed3e1fc7c" containerID="4bc63f270473aefbbcaf0ec3d6b2554990a96170f4a5e57c749fe382146c1386" exitCode=0
Jul 27 19:30:01.364576 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:01.364266    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp" event={"ID":"3f415ef6-d279-4149-9708-c77ed3e1fc7c","Type":"ContainerDied","Data":"4bc63f270473aefbbcaf0ec3d6b2554990a96170f4a5e57c749fe382146c1386"}
Jul 27 19:30:02.508603 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:02.508574    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp"
Jul 27 19:30:03.378184 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:03.378154    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp"
Jul 27 19:30:03.378385 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:03.378184    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753010-xwrcp" event={"ID":"3f415ef6-d279-4149-9708-c77ed3e1fc7c","Type":"ContainerDied","Data":"49cffb6853f14a7f974ab378643534102a875c9be4755cea4f22850b16ae0d8b"}
Jul 27 19:30:03.378385 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:03.378230    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49cffb6853f14a7f974ab378643534102a875c9be4755cea4f22850b16ae0d8b"
Jul 27 19:30:09.956645 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:09.956609    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:30:13.849107 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:13.849084    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:30:13.853032 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:13.853011    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:30:13.854305 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:13.854288    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:30:13.857973 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:13.857953    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:30:19.459931 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:19.459892    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:30:33.463732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:33.463698    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:30:42.161784 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:42.161755    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:30:51.867735 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:30:51.867708    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:31:03.661613 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:31:03.661575    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:31:15.154392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:31:15.154358    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:31:23.861848 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:31:23.861801    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:31:35.861896 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:31:35.861860    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:31:47.562866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:31:47.562831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:31:58.153034 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:31:58.153002    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:32:10.160314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:10.160234    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:32:22.978081 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:22.978050    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:32:31.843220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.843186    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"]
Jul 27 19:32:31.843643 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.843628    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f415ef6-d279-4149-9708-c77ed3e1fc7c" containerName="cleanup"
Jul 27 19:32:31.843686 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.843645    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f415ef6-d279-4149-9708-c77ed3e1fc7c" containerName="cleanup"
Jul 27 19:32:31.843727 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.843719    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f415ef6-d279-4149-9708-c77ed3e1fc7c" containerName="cleanup"
Jul 27 19:32:31.846394 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.846376    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:31.849772 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.849753    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0b1393fc-serving-cert\""
Jul 27 19:32:31.849905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.849754    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t9v8k\""
Jul 27 19:32:31.858447 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.858412    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"]
Jul 27 19:32:31.987703 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.987667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfwks\" (UniqueName: \"kubernetes.io/projected/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-kube-api-access-bfwks\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:31.987884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.987718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-maas-api-tls\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:31.987884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:31.987826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-openshift-service-ca\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:32.089270 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.089233    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfwks\" (UniqueName: \"kubernetes.io/projected/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-kube-api-access-bfwks\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:32.089462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.089305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-maas-api-tls\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:32.089462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.089359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-openshift-service-ca\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:32.090134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.090107    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-openshift-service-ca\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:32.092258 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.092228    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-maas-api-tls\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:32.100147 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.100078    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfwks\" (UniqueName: \"kubernetes.io/projected/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-kube-api-access-bfwks\") pod \"maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:32.157967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.157937    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:32.314588 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.314558    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"]
Jul 27 19:32:32.314693 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:32:32.314628    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabcb7688_5f17_4fbf_8a4c_8d2d4ffd251a.slice/crio-19fe27bcfdb6f823cd48bd4d81a1b9688bc828f22b1737119fa6edad20787f20 WatchSource:0}: Error finding container 19fe27bcfdb6f823cd48bd4d81a1b9688bc828f22b1737119fa6edad20787f20: Status 404 returned error can't find the container with id 19fe27bcfdb6f823cd48bd4d81a1b9688bc828f22b1737119fa6edad20787f20
Jul 27 19:32:32.316062 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.316042    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:32:32.597788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.597754    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"]
Jul 27 19:32:32.602549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.602531    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:32.605361 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.605341    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0b1393fc\""
Jul 27 19:32:32.605818 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.605790    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0b1393fc-dockercfg-lqz2k\""
Jul 27 19:32:32.614544 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.614525    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"]
Jul 27 19:32:32.647560 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.647523    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"]
Jul 27 19:32:32.651252 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.651232    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:32.662732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.662701    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"]
Jul 27 19:32:32.695768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.695738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j56fr\" (UniqueName: \"kubernetes.io/projected/04987d30-676f-42e1-bd04-c1497cc7f1af-kube-api-access-j56fr\") pod \"payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z\" (UID: \"04987d30-676f-42e1-bd04-c1497cc7f1af\") " pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:32.695946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.695830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04987d30-676f-42e1-bd04-c1497cc7f1af-plugins-config-volume\") pod \"payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z\" (UID: \"04987d30-676f-42e1-bd04-c1497cc7f1af\") " pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:32.797230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.797186    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffcl8\" (UniqueName: \"kubernetes.io/projected/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-kube-api-access-ffcl8\") pod \"payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp\" (UID: \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:32.797405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.797247    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j56fr\" (UniqueName: \"kubernetes.io/projected/04987d30-676f-42e1-bd04-c1497cc7f1af-kube-api-access-j56fr\") pod \"payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z\" (UID: \"04987d30-676f-42e1-bd04-c1497cc7f1af\") " pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:32.797405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.797342    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04987d30-676f-42e1-bd04-c1497cc7f1af-plugins-config-volume\") pod \"payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z\" (UID: \"04987d30-676f-42e1-bd04-c1497cc7f1af\") " pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:32.797405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.797387    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp\" (UID: \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:32.798043 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.798027    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04987d30-676f-42e1-bd04-c1497cc7f1af-plugins-config-volume\") pod \"payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z\" (UID: \"04987d30-676f-42e1-bd04-c1497cc7f1af\") " pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:32.805978 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.805959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j56fr\" (UniqueName: \"kubernetes.io/projected/04987d30-676f-42e1-bd04-c1497cc7f1af-kube-api-access-j56fr\") pod \"payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z\" (UID: \"04987d30-676f-42e1-bd04-c1497cc7f1af\") " pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:32.898891 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.898780    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffcl8\" (UniqueName: \"kubernetes.io/projected/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-kube-api-access-ffcl8\") pod \"payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp\" (UID: \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:32.899331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.898940    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp\" (UID: \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:32.899692 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.899670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp\" (UID: \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:32.907912 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.907887    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffcl8\" (UniqueName: \"kubernetes.io/projected/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-kube-api-access-ffcl8\") pod \"payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp\" (UID: \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:32.914730 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.914712    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:32.963387 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:32.963219    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:33.097409 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.097372    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"]
Jul 27 19:32:33.098223 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:32:33.098185    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04987d30_676f_42e1_bd04_c1497cc7f1af.slice/crio-817c5b08a54f70666f133b671de42ffc6a2b342e71193fb842a96dd3585fb85f WatchSource:0}: Error finding container 817c5b08a54f70666f133b671de42ffc6a2b342e71193fb842a96dd3585fb85f: Status 404 returned error can't find the container with id 817c5b08a54f70666f133b671de42ffc6a2b342e71193fb842a96dd3585fb85f
Jul 27 19:32:33.148667 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.148631    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"]
Jul 27 19:32:33.149082 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:32:33.149025    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e708a9_29ee_4fae_80e0_5e77f95f2ac2.slice/crio-c1300e5ee0e48d36b78d73464fbcbf62f3b0130a545ecff48e76b43b2ac5ea21 WatchSource:0}: Error finding container c1300e5ee0e48d36b78d73464fbcbf62f3b0130a545ecff48e76b43b2ac5ea21: Status 404 returned error can't find the container with id c1300e5ee0e48d36b78d73464fbcbf62f3b0130a545ecff48e76b43b2ac5ea21
Jul 27 19:32:33.270984 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.270942    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp" event={"ID":"93e708a9-29ee-4fae-80e0-5e77f95f2ac2","Type":"ContainerStarted","Data":"0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556"}
Jul 27 19:32:33.271151 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.271006    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp" event={"ID":"93e708a9-29ee-4fae-80e0-5e77f95f2ac2","Type":"ContainerStarted","Data":"c1300e5ee0e48d36b78d73464fbcbf62f3b0130a545ecff48e76b43b2ac5ea21"}
Jul 27 19:32:33.271151 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.271057    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:33.272427 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.272402    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh" event={"ID":"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a","Type":"ContainerStarted","Data":"19fe27bcfdb6f823cd48bd4d81a1b9688bc828f22b1737119fa6edad20787f20"}
Jul 27 19:32:33.274146 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.274120    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z" event={"ID":"04987d30-676f-42e1-bd04-c1497cc7f1af","Type":"ContainerStarted","Data":"b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d"}
Jul 27 19:32:33.274250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.274169    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z" event={"ID":"04987d30-676f-42e1-bd04-c1497cc7f1af","Type":"ContainerStarted","Data":"817c5b08a54f70666f133b671de42ffc6a2b342e71193fb842a96dd3585fb85f"}
Jul 27 19:32:33.274316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.274259    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:33.289445 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.289359    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp" podStartSLOduration=1.289341558 podStartE2EDuration="1.289341558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:33.287917309 +0000 UTC m=+1639.995056801" watchObservedRunningTime="2026-07-27 19:32:33.289341558 +0000 UTC m=+1639.996481049"
Jul 27 19:32:33.308283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:33.308227    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z" podStartSLOduration=1.3082107139999999 podStartE2EDuration="1.308210714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:33.306042267 +0000 UTC m=+1640.013181758" watchObservedRunningTime="2026-07-27 19:32:33.308210714 +0000 UTC m=+1640.015350204"
Jul 27 19:32:34.281196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:34.281156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh" event={"ID":"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a","Type":"ContainerStarted","Data":"4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c"}
Jul 27 19:32:34.281678 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:34.281521    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:34.300188 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:34.300142    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh" podStartSLOduration=1.75602034 podStartE2EDuration="3.300128983s" totalImagesPullingTime="1.544108643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:34.297613336 +0000 UTC m=+1641.004752828" watchObservedRunningTime="2026-07-27 19:32:34.300128983 +0000 UTC m=+1641.007268474"
Jul 27 19:32:38.570781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:38.570745    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:32:40.293400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:40.293371    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:32:44.283967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:44.283935    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:32:44.284431 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:44.284009    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:32:57.495316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.495283    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"]
Jul 27 19:32:57.499390 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.499372    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"
Jul 27 19:32:57.502100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.502078    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:32:57.506996 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.506960    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"]
Jul 27 19:32:57.637010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.636981    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbb809c-129b-4a07-954f-b6dd065df648-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx\" (UID: \"ecbb809c-129b-4a07-954f-b6dd065df648\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"
Jul 27 19:32:57.737998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.737961    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbb809c-129b-4a07-954f-b6dd065df648-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx\" (UID: \"ecbb809c-129b-4a07-954f-b6dd065df648\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"
Jul 27 19:32:57.738599 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.738578    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbb809c-129b-4a07-954f-b6dd065df648-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx\" (UID: \"ecbb809c-129b-4a07-954f-b6dd065df648\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"
Jul 27 19:32:57.813341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.813265    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"
Jul 27 19:32:57.959663 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:57.959636    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"]
Jul 27 19:32:57.960158 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:32:57.960136    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbb809c_129b_4a07_954f_b6dd065df648.slice/crio-c982384ef612b05ba02ad8dd01a6a6cbd008c5fa8b4075adb1fe1c3d0fadd0bc WatchSource:0}: Error finding container c982384ef612b05ba02ad8dd01a6a6cbd008c5fa8b4075adb1fe1c3d0fadd0bc: Status 404 returned error can't find the container with id c982384ef612b05ba02ad8dd01a6a6cbd008c5fa8b4075adb1fe1c3d0fadd0bc
Jul 27 19:32:58.434476 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:58.434440    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx" event={"ID":"ecbb809c-129b-4a07-954f-b6dd065df648","Type":"ContainerStarted","Data":"813d2f5328ddde3dae882130fc538175fc96f08d9bc8db1f28f9c4dc6d63ab16"}
Jul 27 19:32:58.434667 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:58.434504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx" event={"ID":"ecbb809c-129b-4a07-954f-b6dd065df648","Type":"ContainerStarted","Data":"c982384ef612b05ba02ad8dd01a6a6cbd008c5fa8b4075adb1fe1c3d0fadd0bc"}
Jul 27 19:32:58.453632 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:58.453577    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx" podStartSLOduration=1.453560291 podStartE2EDuration="1.453560291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:58.450707443 +0000 UTC m=+1665.157846936" watchObservedRunningTime="2026-07-27 19:32:58.453560291 +0000 UTC m=+1665.160699794"
Jul 27 19:32:59.443426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:59.443392    2557 generic.go:356] "Generic (PLEG): container finished" podID="ecbb809c-129b-4a07-954f-b6dd065df648" containerID="813d2f5328ddde3dae882130fc538175fc96f08d9bc8db1f28f9c4dc6d63ab16" exitCode=0
Jul 27 19:32:59.443837 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:32:59.443486    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx" event={"ID":"ecbb809c-129b-4a07-954f-b6dd065df648","Type":"ContainerDied","Data":"813d2f5328ddde3dae882130fc538175fc96f08d9bc8db1f28f9c4dc6d63ab16"}
Jul 27 19:33:00.586929 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:00.586903    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"
Jul 27 19:33:00.667111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:00.667078    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbb809c-129b-4a07-954f-b6dd065df648-maas-api-service-ca\") pod \"ecbb809c-129b-4a07-954f-b6dd065df648\" (UID: \"ecbb809c-129b-4a07-954f-b6dd065df648\") "
Jul 27 19:33:00.667446 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:00.667422    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecbb809c-129b-4a07-954f-b6dd065df648-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ecbb809c-129b-4a07-954f-b6dd065df648" (UID: "ecbb809c-129b-4a07-954f-b6dd065df648"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:00.767969 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:00.767878    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecbb809c-129b-4a07-954f-b6dd065df648-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:01.456473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:01.456441    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"
Jul 27 19:33:01.456653 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:01.456441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx" event={"ID":"ecbb809c-129b-4a07-954f-b6dd065df648","Type":"ContainerDied","Data":"c982384ef612b05ba02ad8dd01a6a6cbd008c5fa8b4075adb1fe1c3d0fadd0bc"}
Jul 27 19:33:01.456653 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:01.456568    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c982384ef612b05ba02ad8dd01a6a6cbd008c5fa8b4075adb1fe1c3d0fadd0bc"
Jul 27 19:33:07.907329 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:07.907292    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"]
Jul 27 19:33:07.907775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:07.907584    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh" podUID="abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" containerName="maas-api" containerID="cri-o://4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c" gracePeriod=30
Jul 27 19:33:07.962983 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:07.962940    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"]
Jul 27 19:33:07.963262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:07.963236    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z" podUID="04987d30-676f-42e1-bd04-c1497cc7f1af" containerName="payload-processing" containerID="cri-o://b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d" gracePeriod=30
Jul 27 19:33:07.969678 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:07.969653    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"]
Jul 27 19:33:07.970606 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:07.970566    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp" podUID="93e708a9-29ee-4fae-80e0-5e77f95f2ac2" containerName="payload-pre-processing" containerID="cri-o://0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556" gracePeriod=30
Jul 27 19:33:08.107639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.107596    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"]
Jul 27 19:33:08.113717 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.113685    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1393fc-qrbfx"]
Jul 27 19:33:08.296740 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.296714    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:33:08.302364 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.302342    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:33:08.307843 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.307825    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:33:08.445239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445201    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-plugins-config-volume\") pod \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\" (UID: \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\") "
Jul 27 19:33:08.445413 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445287    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-maas-api-tls\") pod \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") "
Jul 27 19:33:08.445413 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445356    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfwks\" (UniqueName: \"kubernetes.io/projected/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-kube-api-access-bfwks\") pod \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") "
Jul 27 19:33:08.445413 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445394    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffcl8\" (UniqueName: \"kubernetes.io/projected/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-kube-api-access-ffcl8\") pod \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\" (UID: \"93e708a9-29ee-4fae-80e0-5e77f95f2ac2\") "
Jul 27 19:33:08.445543 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445439    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j56fr\" (UniqueName: \"kubernetes.io/projected/04987d30-676f-42e1-bd04-c1497cc7f1af-kube-api-access-j56fr\") pod \"04987d30-676f-42e1-bd04-c1497cc7f1af\" (UID: \"04987d30-676f-42e1-bd04-c1497cc7f1af\") "
Jul 27 19:33:08.445543 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445473    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-openshift-service-ca\") pod \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\" (UID: \"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a\") "
Jul 27 19:33:08.445543 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445529    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04987d30-676f-42e1-bd04-c1497cc7f1af-plugins-config-volume\") pod \"04987d30-676f-42e1-bd04-c1497cc7f1af\" (UID: \"04987d30-676f-42e1-bd04-c1497cc7f1af\") "
Jul 27 19:33:08.445694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445624    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93e708a9-29ee-4fae-80e0-5e77f95f2ac2" (UID: "93e708a9-29ee-4fae-80e0-5e77f95f2ac2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:08.445929 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445904    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:08.446021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445949    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" (UID: "abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:08.446021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.445963    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04987d30-676f-42e1-bd04-c1497cc7f1af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04987d30-676f-42e1-bd04-c1497cc7f1af" (UID: "04987d30-676f-42e1-bd04-c1497cc7f1af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:08.447887 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.447820    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-kube-api-access-ffcl8" (OuterVolumeSpecName: "kube-api-access-ffcl8") pod "93e708a9-29ee-4fae-80e0-5e77f95f2ac2" (UID: "93e708a9-29ee-4fae-80e0-5e77f95f2ac2"). InnerVolumeSpecName "kube-api-access-ffcl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:08.448154 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.448132    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04987d30-676f-42e1-bd04-c1497cc7f1af-kube-api-access-j56fr" (OuterVolumeSpecName: "kube-api-access-j56fr") pod "04987d30-676f-42e1-bd04-c1497cc7f1af" (UID: "04987d30-676f-42e1-bd04-c1497cc7f1af"). InnerVolumeSpecName "kube-api-access-j56fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:08.448233 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.448209    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" (UID: "abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:33:08.448281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.448257    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-kube-api-access-bfwks" (OuterVolumeSpecName: "kube-api-access-bfwks") pod "abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" (UID: "abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a"). InnerVolumeSpecName "kube-api-access-bfwks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:08.499989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.499955    2557 generic.go:356] "Generic (PLEG): container finished" podID="93e708a9-29ee-4fae-80e0-5e77f95f2ac2" containerID="0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556" exitCode=0
Jul 27 19:33:08.500152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.500004    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"
Jul 27 19:33:08.500152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.500040    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp" event={"ID":"93e708a9-29ee-4fae-80e0-5e77f95f2ac2","Type":"ContainerDied","Data":"0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556"}
Jul 27 19:33:08.500152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.500127    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp" event={"ID":"93e708a9-29ee-4fae-80e0-5e77f95f2ac2","Type":"ContainerDied","Data":"c1300e5ee0e48d36b78d73464fbcbf62f3b0130a545ecff48e76b43b2ac5ea21"}
Jul 27 19:33:08.500347 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.500154    2557 scope.go:117] "RemoveContainer" containerID="0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556"
Jul 27 19:33:08.501432 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.501411    2557 generic.go:356] "Generic (PLEG): container finished" podID="abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" containerID="4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c" exitCode=0
Jul 27 19:33:08.501529 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.501453    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"
Jul 27 19:33:08.501529 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.501487    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh" event={"ID":"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a","Type":"ContainerDied","Data":"4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c"}
Jul 27 19:33:08.501628 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.501536    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh" event={"ID":"abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a","Type":"ContainerDied","Data":"19fe27bcfdb6f823cd48bd4d81a1b9688bc828f22b1737119fa6edad20787f20"}
Jul 27 19:33:08.503137 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.503118    2557 generic.go:356] "Generic (PLEG): container finished" podID="04987d30-676f-42e1-bd04-c1497cc7f1af" containerID="b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d" exitCode=0
Jul 27 19:33:08.503235 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.503147    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z" event={"ID":"04987d30-676f-42e1-bd04-c1497cc7f1af","Type":"ContainerDied","Data":"b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d"}
Jul 27 19:33:08.503235 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.503159    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"
Jul 27 19:33:08.503235 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.503195    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z" event={"ID":"04987d30-676f-42e1-bd04-c1497cc7f1af","Type":"ContainerDied","Data":"817c5b08a54f70666f133b671de42ffc6a2b342e71193fb842a96dd3585fb85f"}
Jul 27 19:33:08.511168 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.511149    2557 scope.go:117] "RemoveContainer" containerID="0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556"
Jul 27 19:33:08.511453 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:33:08.511433    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556\": container with ID starting with 0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556 not found: ID does not exist" containerID="0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556"
Jul 27 19:33:08.511545 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.511461    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556"} err="failed to get container status \"0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556\": rpc error: code = NotFound desc = could not find container \"0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556\": container with ID starting with 0491743bc3172a01d1ff47d4cc48324a634fa9f78a0328e57a2cff6f61a73556 not found: ID does not exist"
Jul 27 19:33:08.511545 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.511479    2557 scope.go:117] "RemoveContainer" containerID="4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c"
Jul 27 19:33:08.524184 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.524164    2557 scope.go:117] "RemoveContainer" containerID="4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c"
Jul 27 19:33:08.525322 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:33:08.525300    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c\": container with ID starting with 4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c not found: ID does not exist" containerID="4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c"
Jul 27 19:33:08.525400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.525329    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c"} err="failed to get container status \"4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c\": rpc error: code = NotFound desc = could not find container \"4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c\": container with ID starting with 4c0c91e74c75458fbb48ef423e6729525e5f4601443f9505f7cb0b313ac5ef2c not found: ID does not exist"
Jul 27 19:33:08.525400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.525346    2557 scope.go:117] "RemoveContainer" containerID="b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d"
Jul 27 19:33:08.528763 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.528745    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"]
Jul 27 19:33:08.532051 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.532032    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0b1393fc-6fd6cd9d96-8fxqp"]
Jul 27 19:33:08.534220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.534205    2557 scope.go:117] "RemoveContainer" containerID="b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d"
Jul 27 19:33:08.534476 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:33:08.534459    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d\": container with ID starting with b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d not found: ID does not exist" containerID="b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d"
Jul 27 19:33:08.534520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.534483    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d"} err="failed to get container status \"b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d\": rpc error: code = NotFound desc = could not find container \"b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d\": container with ID starting with b1979f7107e9b1345582944a7a422b00e3ceff91e5ef91ab7ab00ac4ed54b60d not found: ID does not exist"
Jul 27 19:33:08.538746 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.538726    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"]
Jul 27 19:33:08.545482 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.545463    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0b1393fc-5b86b77f98-f447z"]
Jul 27 19:33:08.546895 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.546870    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-openshift-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:08.546955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.546897    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04987d30-676f-42e1-bd04-c1497cc7f1af-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:08.546955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.546909    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-maas-api-tls\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:08.546955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.546918    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfwks\" (UniqueName: \"kubernetes.io/projected/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a-kube-api-access-bfwks\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:08.546955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.546926    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffcl8\" (UniqueName: \"kubernetes.io/projected/93e708a9-29ee-4fae-80e0-5e77f95f2ac2-kube-api-access-ffcl8\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:08.546955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.546933    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j56fr\" (UniqueName: \"kubernetes.io/projected/04987d30-676f-42e1-bd04-c1497cc7f1af-kube-api-access-j56fr\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:08.556671 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.556650    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"]
Jul 27 19:33:08.561021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:08.561001    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0b1393fc-56cf8b5bb7-wjwnh"]
Jul 27 19:33:09.301762 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.301731    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"]
Jul 27 19:33:09.302230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302170    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" containerName="maas-api"
Jul 27 19:33:09.302230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302181    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" containerName="maas-api"
Jul 27 19:33:09.302230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302192    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e708a9-29ee-4fae-80e0-5e77f95f2ac2" containerName="payload-pre-processing"
Jul 27 19:33:09.302230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302199    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e708a9-29ee-4fae-80e0-5e77f95f2ac2" containerName="payload-pre-processing"
Jul 27 19:33:09.302230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302210    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbb809c-129b-4a07-954f-b6dd065df648" containerName="revoke-keys"
Jul 27 19:33:09.302230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302216    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbb809c-129b-4a07-954f-b6dd065df648" containerName="revoke-keys"
Jul 27 19:33:09.302230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302226    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04987d30-676f-42e1-bd04-c1497cc7f1af" containerName="payload-processing"
Jul 27 19:33:09.302230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302232    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="04987d30-676f-42e1-bd04-c1497cc7f1af" containerName="payload-processing"
Jul 27 19:33:09.302648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302299    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93e708a9-29ee-4fae-80e0-5e77f95f2ac2" containerName="payload-pre-processing"
Jul 27 19:33:09.302648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302307    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbb809c-129b-4a07-954f-b6dd065df648" containerName="revoke-keys"
Jul 27 19:33:09.302648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302313    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="04987d30-676f-42e1-bd04-c1497cc7f1af" containerName="payload-processing"
Jul 27 19:33:09.302648 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.302320    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" containerName="maas-api"
Jul 27 19:33:09.307246 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.307223    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.310086 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.310067    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-00691797-gw-openshift-default-dockercfg-htt9z\""
Jul 27 19:33:09.319837 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.319790    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"]
Jul 27 19:33:09.454473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx6rg\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-kube-api-access-xx6rg\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.454473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454477    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-envoy\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.454691 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454499    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-credential-socket\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.454691 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-certs\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.454691 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-data\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.454691 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e47140e-cef4-4db2-acb9-eab9816cd861-istiod-ca-cert\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.454691 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454672    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-socket\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.454941 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-token\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.454941 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.454761    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-podinfo\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.555841 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.555730    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx6rg\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-kube-api-access-xx6rg\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.555841 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.555783    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-envoy\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.555844    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-credential-socket\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.555881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-certs\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.555907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-data\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.555956    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e47140e-cef4-4db2-acb9-eab9816cd861-istiod-ca-cert\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.556012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-socket\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.556098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-token\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.556124    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-podinfo\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.556358    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-credential-socket\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.556766 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.556742    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-certs\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.557283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.557254    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e47140e-cef4-4db2-acb9-eab9816cd861-istiod-ca-cert\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.557413 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.557385    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-socket\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.557476 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.557393    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-data\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.558690 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.558671    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-envoy\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.559412 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.559395    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-podinfo\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.564506 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.564482    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx6rg\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-kube-api-access-xx6rg\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.564642 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.564621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-token\") pod \"e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") " pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.619231 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.619203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:09.764558 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:33:09.764529    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e47140e_cef4_4db2_acb9_eab9816cd861.slice/crio-16ca8e4d345817cc08deea70c67bfaf556b78b4bf0bc1266487344f3dfa4ff8b WatchSource:0}: Error finding container 16ca8e4d345817cc08deea70c67bfaf556b78b4bf0bc1266487344f3dfa4ff8b: Status 404 returned error can't find the container with id 16ca8e4d345817cc08deea70c67bfaf556b78b4bf0bc1266487344f3dfa4ff8b
Jul 27 19:33:09.764703 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.764684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"]
Jul 27 19:33:09.791019 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.790989    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04987d30-676f-42e1-bd04-c1497cc7f1af" path="/var/lib/kubelet/pods/04987d30-676f-42e1-bd04-c1497cc7f1af/volumes"
Jul 27 19:33:09.791379 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.791366    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e708a9-29ee-4fae-80e0-5e77f95f2ac2" path="/var/lib/kubelet/pods/93e708a9-29ee-4fae-80e0-5e77f95f2ac2/volumes"
Jul 27 19:33:09.791710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.791697    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a" path="/var/lib/kubelet/pods/abcb7688-5f17-4fbf-8a4c-8d2d4ffd251a/volumes"
Jul 27 19:33:09.792013 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:09.792001    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecbb809c-129b-4a07-954f-b6dd065df648" path="/var/lib/kubelet/pods/ecbb809c-129b-4a07-954f-b6dd065df648/volumes"
Jul 27 19:33:10.520770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:10.520735    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" event={"ID":"5e47140e-cef4-4db2-acb9-eab9816cd861","Type":"ContainerStarted","Data":"16ca8e4d345817cc08deea70c67bfaf556b78b4bf0bc1266487344f3dfa4ff8b"}
Jul 27 19:33:11.955936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:11.955892    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:33:12.418162 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:12.418125    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:12.418249 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:12.418196    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:12.418293 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:12.418248    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:12.539001 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:12.538960    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" event={"ID":"5e47140e-cef4-4db2-acb9-eab9816cd861","Type":"ContainerStarted","Data":"b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c"}
Jul 27 19:33:12.560834 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:12.560762    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" podStartSLOduration=0.909370293 podStartE2EDuration="3.560746051s" totalImagesPullingTime="2.651375758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:12.557061418 +0000 UTC m=+1679.264200935" watchObservedRunningTime="2026-07-27 19:33:12.560746051 +0000 UTC m=+1679.267885541"
Jul 27 19:33:12.619751 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:12.619715    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:13.624410 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:13.624380    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:14.559384 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.559351    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:14.560451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.560432    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:14.856175 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.856097    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"]
Jul 27 19:33:14.861032 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.861014    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:14.863560 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.863530    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-00691797\""
Jul 27 19:33:14.863852 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.863835    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-00691797-dockercfg-nd4zf\""
Jul 27 19:33:14.872558 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.872539    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"]
Jul 27 19:33:14.890681 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.890653    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"]
Jul 27 19:33:14.894248 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.894230    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:14.902450 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:14.902429    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"]
Jul 27 19:33:15.011936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.011896    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31940586-124e-4844-9d40-3eb260059f6e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7\" (UID: \"31940586-124e-4844-9d40-3eb260059f6e\") " pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:15.012109 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.011959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdj58\" (UniqueName: \"kubernetes.io/projected/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-kube-api-access-tdj58\") pod \"payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs\" (UID: \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:15.012109 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.012066    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hw9m\" (UniqueName: \"kubernetes.io/projected/31940586-124e-4844-9d40-3eb260059f6e-kube-api-access-8hw9m\") pod \"payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7\" (UID: \"31940586-124e-4844-9d40-3eb260059f6e\") " pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:15.012109 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.012088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs\" (UID: \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:15.113094 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.113006    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hw9m\" (UniqueName: \"kubernetes.io/projected/31940586-124e-4844-9d40-3eb260059f6e-kube-api-access-8hw9m\") pod \"payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7\" (UID: \"31940586-124e-4844-9d40-3eb260059f6e\") " pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:15.113094 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.113056    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs\" (UID: \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:15.113281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.113099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31940586-124e-4844-9d40-3eb260059f6e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7\" (UID: \"31940586-124e-4844-9d40-3eb260059f6e\") " pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:15.113281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.113248    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdj58\" (UniqueName: \"kubernetes.io/projected/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-kube-api-access-tdj58\") pod \"payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs\" (UID: \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:15.113848 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.113831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31940586-124e-4844-9d40-3eb260059f6e-plugins-config-volume\") pod \"payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7\" (UID: \"31940586-124e-4844-9d40-3eb260059f6e\") " pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:15.113985 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.113968    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs\" (UID: \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:15.121239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.121207    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hw9m\" (UniqueName: \"kubernetes.io/projected/31940586-124e-4844-9d40-3eb260059f6e-kube-api-access-8hw9m\") pod \"payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7\" (UID: \"31940586-124e-4844-9d40-3eb260059f6e\") " pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:15.121239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.121232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdj58\" (UniqueName: \"kubernetes.io/projected/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-kube-api-access-tdj58\") pod \"payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs\" (UID: \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:15.173279 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.173252    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:15.208594 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.208561    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:15.339630 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:33:15.339595    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95eaf67_f3e3_467c_9f1a_827c5a20e5ba.slice/crio-37c9c5e92465754764075a6714fed885ff7b7b2139ef461f7341a0d54d9dac8b WatchSource:0}: Error finding container 37c9c5e92465754764075a6714fed885ff7b7b2139ef461f7341a0d54d9dac8b: Status 404 returned error can't find the container with id 37c9c5e92465754764075a6714fed885ff7b7b2139ef461f7341a0d54d9dac8b
Jul 27 19:33:15.340128 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.340094    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"]
Jul 27 19:33:15.381866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.381841    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"]
Jul 27 19:33:15.383447 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:33:15.383421    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31940586_124e_4844_9d40_3eb260059f6e.slice/crio-759e98691f942b6d3bbc148e7ef63f348c1c673fbe746398b694b3733a165048 WatchSource:0}: Error finding container 759e98691f942b6d3bbc148e7ef63f348c1c673fbe746398b694b3733a165048: Status 404 returned error can't find the container with id 759e98691f942b6d3bbc148e7ef63f348c1c673fbe746398b694b3733a165048
Jul 27 19:33:15.567526 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.567494    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7" event={"ID":"31940586-124e-4844-9d40-3eb260059f6e","Type":"ContainerStarted","Data":"8c442421f6de8d26e39689bd19c072c79cdb4f7354b53a866cc1a921a71399ac"}
Jul 27 19:33:15.567722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.567549    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7" event={"ID":"31940586-124e-4844-9d40-3eb260059f6e","Type":"ContainerStarted","Data":"759e98691f942b6d3bbc148e7ef63f348c1c673fbe746398b694b3733a165048"}
Jul 27 19:33:15.567722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.567578    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:15.569121 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.569097    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs" event={"ID":"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba","Type":"ContainerStarted","Data":"0395238ca1aca5d4d4642e87340166cf4a234941c6277993d5731f6e6aef86a5"}
Jul 27 19:33:15.569225 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.569146    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs" event={"ID":"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba","Type":"ContainerStarted","Data":"37c9c5e92465754764075a6714fed885ff7b7b2139ef461f7341a0d54d9dac8b"}
Jul 27 19:33:15.585859 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.585803    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7" podStartSLOduration=1.5857892900000001 podStartE2EDuration="1.58578929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:15.581983142 +0000 UTC m=+1682.289122633" watchObservedRunningTime="2026-07-27 19:33:15.58578929 +0000 UTC m=+1682.292928781"
Jul 27 19:33:15.598701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:15.598649    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs" podStartSLOduration=1.598630236 podStartE2EDuration="1.598630236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:15.596172118 +0000 UTC m=+1682.303311611" watchObservedRunningTime="2026-07-27 19:33:15.598630236 +0000 UTC m=+1682.305769729"
Jul 27 19:33:16.575553 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:16.575520    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:21.969884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:21.968331    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:33:26.577414 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:26.577387    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:26.649845 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:26.649800    2557 generic.go:356] "Generic (PLEG): container finished" podID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerID="b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c" exitCode=0
Jul 27 19:33:26.650035 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:26.649878    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" event={"ID":"5e47140e-cef4-4db2-acb9-eab9816cd861","Type":"ContainerDied","Data":"b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c"}
Jul 27 19:33:26.650364 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:26.650347    2557 scope.go:117] "RemoveContainer" containerID="b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c"
Jul 27 19:33:26.651465 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:26.651435    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:26.651555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:26.651505    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:26.651555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:26.651537    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:27.584497 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:27.584469    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:27.659269 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:27.659235    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" event={"ID":"5e47140e-cef4-4db2-acb9-eab9816cd861","Type":"ContainerStarted","Data":"fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56"}
Jul 27 19:33:28.619439 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:28.619396    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:28.620539 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:28.620510    2557 patch_prober.go:28] interesting pod/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 19:33:28.620672 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:28.620562    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 19:33:29.559714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:29.559684    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:29.619670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:29.619638    2557 patch_prober.go:28] interesting pod/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 19:33:29.620110 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:29.619692    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 19:33:30.619884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:30.619844    2557 patch_prober.go:28] interesting pod/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 19:33:30.620359 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:30.619906    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 19:33:31.623852 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:31.623821    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:31.624846 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:31.624826    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:33:44.256371 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.256337    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"]
Jul 27 19:33:44.259562 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.259540    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"
Jul 27 19:33:44.262615 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.262583    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:33:44.270291 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.269996    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"]
Jul 27 19:33:44.390237 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.390206    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abb8f2f-8664-47a6-a3c7-7f98128382d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-00691797-vz2ck\" (UID: \"6abb8f2f-8664-47a6-a3c7-7f98128382d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"
Jul 27 19:33:44.491118 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.491085    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abb8f2f-8664-47a6-a3c7-7f98128382d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-00691797-vz2ck\" (UID: \"6abb8f2f-8664-47a6-a3c7-7f98128382d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"
Jul 27 19:33:44.491742 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.491721    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abb8f2f-8664-47a6-a3c7-7f98128382d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-00691797-vz2ck\" (UID: \"6abb8f2f-8664-47a6-a3c7-7f98128382d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"
Jul 27 19:33:44.576113 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.576039    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"
Jul 27 19:33:44.725776 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.725739    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"]
Jul 27 19:33:44.725925 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:33:44.725747    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abb8f2f_8664_47a6_a3c7_7f98128382d9.slice/crio-9ba477fa6ad336852f17978d650af4f601f13503f70416f05f510f330fefcc47 WatchSource:0}: Error finding container 9ba477fa6ad336852f17978d650af4f601f13503f70416f05f510f330fefcc47: Status 404 returned error can't find the container with id 9ba477fa6ad336852f17978d650af4f601f13503f70416f05f510f330fefcc47
Jul 27 19:33:44.773770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:44.773745    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck" event={"ID":"6abb8f2f-8664-47a6-a3c7-7f98128382d9","Type":"ContainerStarted","Data":"9ba477fa6ad336852f17978d650af4f601f13503f70416f05f510f330fefcc47"}
Jul 27 19:33:45.781052 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:45.781015    2557 generic.go:356] "Generic (PLEG): container finished" podID="6abb8f2f-8664-47a6-a3c7-7f98128382d9" containerID="86383723e1078df9ab2cdf114f97a8925e9f333d17528d1462de38ad0a5506b4" exitCode=0
Jul 27 19:33:45.781426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:45.781067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck" event={"ID":"6abb8f2f-8664-47a6-a3c7-7f98128382d9","Type":"ContainerDied","Data":"86383723e1078df9ab2cdf114f97a8925e9f333d17528d1462de38ad0a5506b4"}
Jul 27 19:33:46.923695 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:46.923672    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"
Jul 27 19:33:47.019044 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:47.019011    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abb8f2f-8664-47a6-a3c7-7f98128382d9-maas-api-service-ca\") pod \"6abb8f2f-8664-47a6-a3c7-7f98128382d9\" (UID: \"6abb8f2f-8664-47a6-a3c7-7f98128382d9\") "
Jul 27 19:33:47.019352 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:47.019330    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6abb8f2f-8664-47a6-a3c7-7f98128382d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6abb8f2f-8664-47a6-a3c7-7f98128382d9" (UID: "6abb8f2f-8664-47a6-a3c7-7f98128382d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:47.120685 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:47.120602    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abb8f2f-8664-47a6-a3c7-7f98128382d9-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:47.792995 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:47.792969    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"
Jul 27 19:33:47.793183 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:47.793027    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck" event={"ID":"6abb8f2f-8664-47a6-a3c7-7f98128382d9","Type":"ContainerDied","Data":"9ba477fa6ad336852f17978d650af4f601f13503f70416f05f510f330fefcc47"}
Jul 27 19:33:47.793183 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:47.793086    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ba477fa6ad336852f17978d650af4f601f13503f70416f05f510f330fefcc47"
Jul 27 19:33:54.702823 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.702771    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"]
Jul 27 19:33:54.703322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.703043    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7" podUID="31940586-124e-4844-9d40-3eb260059f6e" containerName="payload-processing" containerID="cri-o://8c442421f6de8d26e39689bd19c072c79cdb4f7354b53a866cc1a921a71399ac" gracePeriod=30
Jul 27 19:33:54.709969 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.709940    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"]
Jul 27 19:33:54.710210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.710167    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs" podUID="a95eaf67-f3e3-467c-9f1a-827c5a20e5ba" containerName="payload-pre-processing" containerID="cri-o://0395238ca1aca5d4d4642e87340166cf4a234941c6277993d5731f6e6aef86a5" gracePeriod=30
Jul 27 19:33:54.836001 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.835977    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"]
Jul 27 19:33:54.837226 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.837194    2557 generic.go:356] "Generic (PLEG): container finished" podID="a95eaf67-f3e3-467c-9f1a-827c5a20e5ba" containerID="0395238ca1aca5d4d4642e87340166cf4a234941c6277993d5731f6e6aef86a5" exitCode=0
Jul 27 19:33:54.837348 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.837268    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs" event={"ID":"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba","Type":"ContainerDied","Data":"0395238ca1aca5d4d4642e87340166cf4a234941c6277993d5731f6e6aef86a5"}
Jul 27 19:33:54.839323 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.839290    2557 generic.go:356] "Generic (PLEG): container finished" podID="31940586-124e-4844-9d40-3eb260059f6e" containerID="8c442421f6de8d26e39689bd19c072c79cdb4f7354b53a866cc1a921a71399ac" exitCode=0
Jul 27 19:33:54.839429 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.839330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7" event={"ID":"31940586-124e-4844-9d40-3eb260059f6e","Type":"ContainerDied","Data":"8c442421f6de8d26e39689bd19c072c79cdb4f7354b53a866cc1a921a71399ac"}
Jul 27 19:33:54.840272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.840250    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-00691797-vz2ck"]
Jul 27 19:33:54.998043 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.998017    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"]
Jul 27 19:33:54.998239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:54.998215    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy" containerID="cri-o://fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56" gracePeriod=30
Jul 27 19:33:55.011358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.011332    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:55.014279 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.014260    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:55.104455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.104414    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-plugins-config-volume\") pod \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\" (UID: \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\") "
Jul 27 19:33:55.104455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.104457    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31940586-124e-4844-9d40-3eb260059f6e-plugins-config-volume\") pod \"31940586-124e-4844-9d40-3eb260059f6e\" (UID: \"31940586-124e-4844-9d40-3eb260059f6e\") "
Jul 27 19:33:55.104705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.104489    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdj58\" (UniqueName: \"kubernetes.io/projected/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-kube-api-access-tdj58\") pod \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\" (UID: \"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba\") "
Jul 27 19:33:55.104705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.104510    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hw9m\" (UniqueName: \"kubernetes.io/projected/31940586-124e-4844-9d40-3eb260059f6e-kube-api-access-8hw9m\") pod \"31940586-124e-4844-9d40-3eb260059f6e\" (UID: \"31940586-124e-4844-9d40-3eb260059f6e\") "
Jul 27 19:33:55.104884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.104861    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a95eaf67-f3e3-467c-9f1a-827c5a20e5ba" (UID: "a95eaf67-f3e3-467c-9f1a-827c5a20e5ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:55.104962 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.104903    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31940586-124e-4844-9d40-3eb260059f6e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "31940586-124e-4844-9d40-3eb260059f6e" (UID: "31940586-124e-4844-9d40-3eb260059f6e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:55.107123 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.107097    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-kube-api-access-tdj58" (OuterVolumeSpecName: "kube-api-access-tdj58") pod "a95eaf67-f3e3-467c-9f1a-827c5a20e5ba" (UID: "a95eaf67-f3e3-467c-9f1a-827c5a20e5ba"). InnerVolumeSpecName "kube-api-access-tdj58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:55.107365 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.107344    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31940586-124e-4844-9d40-3eb260059f6e-kube-api-access-8hw9m" (OuterVolumeSpecName: "kube-api-access-8hw9m") pod "31940586-124e-4844-9d40-3eb260059f6e" (UID: "31940586-124e-4844-9d40-3eb260059f6e"). InnerVolumeSpecName "kube-api-access-8hw9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:55.206099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.206070    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:55.206099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.206098    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31940586-124e-4844-9d40-3eb260059f6e-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:55.206099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.206107    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdj58\" (UniqueName: \"kubernetes.io/projected/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba-kube-api-access-tdj58\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:55.206314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.206115    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hw9m\" (UniqueName: \"kubernetes.io/projected/31940586-124e-4844-9d40-3eb260059f6e-kube-api-access-8hw9m\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:33:55.798406 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.798372    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6abb8f2f-8664-47a6-a3c7-7f98128382d9" path="/var/lib/kubelet/pods/6abb8f2f-8664-47a6-a3c7-7f98128382d9/volumes"
Jul 27 19:33:55.846363 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.846341    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"
Jul 27 19:33:55.846532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.846366    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7" event={"ID":"31940586-124e-4844-9d40-3eb260059f6e","Type":"ContainerDied","Data":"759e98691f942b6d3bbc148e7ef63f348c1c673fbe746398b694b3733a165048"}
Jul 27 19:33:55.846532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.846423    2557 scope.go:117] "RemoveContainer" containerID="8c442421f6de8d26e39689bd19c072c79cdb4f7354b53a866cc1a921a71399ac"
Jul 27 19:33:55.847991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.847938    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs" event={"ID":"a95eaf67-f3e3-467c-9f1a-827c5a20e5ba","Type":"ContainerDied","Data":"37c9c5e92465754764075a6714fed885ff7b7b2139ef461f7341a0d54d9dac8b"}
Jul 27 19:33:55.848092 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.847971    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"
Jul 27 19:33:55.858020 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.857998    2557 scope.go:117] "RemoveContainer" containerID="0395238ca1aca5d4d4642e87340166cf4a234941c6277993d5731f6e6aef86a5"
Jul 27 19:33:55.881009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.880984    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"]
Jul 27 19:33:55.885541 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.885517    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-00691797-6d9846bc6f-tp6s7"]
Jul 27 19:33:55.893630 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.893596    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"]
Jul 27 19:33:55.898542 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:55.898520    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-00691797-746586d5dd-jnzrs"]
Jul 27 19:33:57.791239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:57.791201    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31940586-124e-4844-9d40-3eb260059f6e" path="/var/lib/kubelet/pods/31940586-124e-4844-9d40-3eb260059f6e/volumes"
Jul 27 19:33:57.791741 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:57.791719    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95eaf67-f3e3-467c-9f1a-827c5a20e5ba" path="/var/lib/kubelet/pods/a95eaf67-f3e3-467c-9f1a-827c5a20e5ba/volumes"
Jul 27 19:33:58.675828 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.675779    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:33:58.846143 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846112    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"]
Jul 27 19:33:58.846542 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846529    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31940586-124e-4844-9d40-3eb260059f6e" containerName="payload-processing"
Jul 27 19:33:58.846542 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846543    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="31940586-124e-4844-9d40-3eb260059f6e" containerName="payload-processing"
Jul 27 19:33:58.846614 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846557    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95eaf67-f3e3-467c-9f1a-827c5a20e5ba" containerName="payload-pre-processing"
Jul 27 19:33:58.846614 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846565    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95eaf67-f3e3-467c-9f1a-827c5a20e5ba" containerName="payload-pre-processing"
Jul 27 19:33:58.846614 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846585    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abb8f2f-8664-47a6-a3c7-7f98128382d9" containerName="revoke-keys"
Jul 27 19:33:58.846614 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846590    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abb8f2f-8664-47a6-a3c7-7f98128382d9" containerName="revoke-keys"
Jul 27 19:33:58.846775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846653    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="31940586-124e-4844-9d40-3eb260059f6e" containerName="payload-processing"
Jul 27 19:33:58.846775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846661    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95eaf67-f3e3-467c-9f1a-827c5a20e5ba" containerName="payload-pre-processing"
Jul 27 19:33:58.846775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.846667    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6abb8f2f-8664-47a6-a3c7-7f98128382d9" containerName="revoke-keys"
Jul 27 19:33:58.849511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.849492    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:58.852587 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.852566    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-bb026c71\""
Jul 27 19:33:58.852587 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.852578    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-bb026c71-dockercfg-lv7x4\""
Jul 27 19:33:58.867080 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.867055    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"]
Jul 27 19:33:58.905775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.905743    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"]
Jul 27 19:33:58.908308 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.908293    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:58.923208 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:58.923186    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"]
Jul 27 19:33:59.042418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.042383    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b9812-dd39-4cab-9614-8166d35e16bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf\" (UID: \"590b9812-dd39-4cab-9614-8166d35e16bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:59.042593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.042465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7mmc\" (UniqueName: \"kubernetes.io/projected/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-kube-api-access-p7mmc\") pod \"payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7\" (UID: \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\") " pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:59.042593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.042516    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-plugins-config-volume\") pod \"payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7\" (UID: \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\") " pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:59.042593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.042539    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rz7g\" (UniqueName: \"kubernetes.io/projected/590b9812-dd39-4cab-9614-8166d35e16bd-kube-api-access-8rz7g\") pod \"payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf\" (UID: \"590b9812-dd39-4cab-9614-8166d35e16bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:59.143856 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.143827    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7mmc\" (UniqueName: \"kubernetes.io/projected/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-kube-api-access-p7mmc\") pod \"payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7\" (UID: \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\") " pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:59.144044 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.143875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-plugins-config-volume\") pod \"payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7\" (UID: \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\") " pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:59.144044 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.143894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rz7g\" (UniqueName: \"kubernetes.io/projected/590b9812-dd39-4cab-9614-8166d35e16bd-kube-api-access-8rz7g\") pod \"payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf\" (UID: \"590b9812-dd39-4cab-9614-8166d35e16bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:59.144044 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.143974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b9812-dd39-4cab-9614-8166d35e16bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf\" (UID: \"590b9812-dd39-4cab-9614-8166d35e16bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:59.144683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.144657    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-plugins-config-volume\") pod \"payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7\" (UID: \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\") " pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:59.144683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.144676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b9812-dd39-4cab-9614-8166d35e16bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf\" (UID: \"590b9812-dd39-4cab-9614-8166d35e16bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:59.152496 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.152473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7mmc\" (UniqueName: \"kubernetes.io/projected/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-kube-api-access-p7mmc\") pod \"payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7\" (UID: \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\") " pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:59.152617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.152481    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rz7g\" (UniqueName: \"kubernetes.io/projected/590b9812-dd39-4cab-9614-8166d35e16bd-kube-api-access-8rz7g\") pod \"payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf\" (UID: \"590b9812-dd39-4cab-9614-8166d35e16bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:59.160345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.160324    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:59.218103 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.218076    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:59.318777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.318747    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"]
Jul 27 19:33:59.319113 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:33:59.319087    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c3c81a_cff8_4562_9dc5_80817cb4f4ea.slice/crio-a4ebde8588c9e938c143c06cdc3c70f3400039af79490c8d816d29ddabff248e WatchSource:0}: Error finding container a4ebde8588c9e938c143c06cdc3c70f3400039af79490c8d816d29ddabff248e: Status 404 returned error can't find the container with id a4ebde8588c9e938c143c06cdc3c70f3400039af79490c8d816d29ddabff248e
Jul 27 19:33:59.390846 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.390782    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"]
Jul 27 19:33:59.877824 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.877777    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf" event={"ID":"590b9812-dd39-4cab-9614-8166d35e16bd","Type":"ContainerStarted","Data":"e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94"}
Jul 27 19:33:59.878276 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.877852    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf" event={"ID":"590b9812-dd39-4cab-9614-8166d35e16bd","Type":"ContainerStarted","Data":"80c5606e557bca84ffd1b88515ad52895b42f640b7da22c993eea81b32d2a2d0"}
Jul 27 19:33:59.878276 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.878006    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:33:59.879506 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.879482    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7" event={"ID":"05c3c81a-cff8-4562-9dc5-80817cb4f4ea","Type":"ContainerStarted","Data":"93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1"}
Jul 27 19:33:59.879559 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.879526    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7" event={"ID":"05c3c81a-cff8-4562-9dc5-80817cb4f4ea","Type":"ContainerStarted","Data":"a4ebde8588c9e938c143c06cdc3c70f3400039af79490c8d816d29ddabff248e"}
Jul 27 19:33:59.879594 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.879578    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:33:59.898641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.898592    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf" podStartSLOduration=1.898576804 podStartE2EDuration="1.898576804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:59.893928121 +0000 UTC m=+1726.601067614" watchObservedRunningTime="2026-07-27 19:33:59.898576804 +0000 UTC m=+1726.605716294"
Jul 27 19:33:59.911521 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:33:59.911477    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7" podStartSLOduration=1.911467342 podStartE2EDuration="1.911467342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:59.909564577 +0000 UTC m=+1726.616704068" watchObservedRunningTime="2026-07-27 19:33:59.911467342 +0000 UTC m=+1726.618606834"
Jul 27 19:34:00.251914 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.251892    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:34:00.355528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355491    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-credential-socket\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.355528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355531    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-socket\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.355755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355556    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e47140e-cef4-4db2-acb9-eab9816cd861-istiod-ca-cert\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.355755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355578    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-token\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.355755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355603    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-certs\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.355755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355674    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx6rg\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-kube-api-access-xx6rg\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.355755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-podinfo\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.356047 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355760    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:00.356047 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355768    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-envoy\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.356047 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355840    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:00.356047 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.355876    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-data\") pod \"5e47140e-cef4-4db2-acb9-eab9816cd861\" (UID: \"5e47140e-cef4-4db2-acb9-eab9816cd861\") "
Jul 27 19:34:00.356255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.356065    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:00.356255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.356081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e47140e-cef4-4db2-acb9-eab9816cd861-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:34:00.356512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.356213    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-credential-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.356512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.356325    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.356512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.356340    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e47140e-cef4-4db2-acb9-eab9816cd861-istiod-ca-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.356512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.356353    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-workload-certs\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.357239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.357213    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:00.358221 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.358195    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:00.358336 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.358303    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:34:00.358336 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.358306    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-kube-api-access-xx6rg" (OuterVolumeSpecName: "kube-api-access-xx6rg") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "kube-api-access-xx6rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:00.358443 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.358341    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e47140e-cef4-4db2-acb9-eab9816cd861" (UID: "5e47140e-cef4-4db2-acb9-eab9816cd861"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:00.457068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.457039    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.457068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.457065    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx6rg\" (UniqueName: \"kubernetes.io/projected/5e47140e-cef4-4db2-acb9-eab9816cd861-kube-api-access-xx6rg\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.457220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.457075    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-podinfo\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.457220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.457083    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-envoy\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.457220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.457091    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e47140e-cef4-4db2-acb9-eab9816cd861-istio-data\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:00.887201 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.887120    2557 generic.go:356] "Generic (PLEG): container finished" podID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerID="fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56" exitCode=0
Jul 27 19:34:00.887201 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.887176    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"
Jul 27 19:34:00.887705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.887210    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" event={"ID":"5e47140e-cef4-4db2-acb9-eab9816cd861","Type":"ContainerDied","Data":"fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56"}
Jul 27 19:34:00.887705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.887272    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv" event={"ID":"5e47140e-cef4-4db2-acb9-eab9816cd861","Type":"ContainerDied","Data":"16ca8e4d345817cc08deea70c67bfaf556b78b4bf0bc1266487344f3dfa4ff8b"}
Jul 27 19:34:00.887705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.887314    2557 scope.go:117] "RemoveContainer" containerID="fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56"
Jul 27 19:34:00.901381 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.901365    2557 scope.go:117] "RemoveContainer" containerID="b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c"
Jul 27 19:34:00.910773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.910756    2557 scope.go:117] "RemoveContainer" containerID="fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56"
Jul 27 19:34:00.911078 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:34:00.911061    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56\": container with ID starting with fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56 not found: ID does not exist" containerID="fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56"
Jul 27 19:34:00.911140 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.911086    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56"} err="failed to get container status \"fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56\": rpc error: code = NotFound desc = could not find container \"fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56\": container with ID starting with fdd8536dbd7d926af926f291649a0abe3f7f8cb6d462fc8170282c272103be56 not found: ID does not exist"
Jul 27 19:34:00.911140 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.911104    2557 scope.go:117] "RemoveContainer" containerID="b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c"
Jul 27 19:34:00.911357 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:34:00.911338    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c\": container with ID starting with b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c not found: ID does not exist" containerID="b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c"
Jul 27 19:34:00.911411 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.911361    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c"} err="failed to get container status \"b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c\": rpc error: code = NotFound desc = could not find container \"b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c\": container with ID starting with b0a0013c3bac5954b6d774c95cf112f2d16d15632542a4ee094794d8321ecb6c not found: ID does not exist"
Jul 27 19:34:00.913695 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.913672    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"]
Jul 27 19:34:00.917049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:00.917029    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-00691797-gw-openshift-default-75876f54fb-r7gnv"]
Jul 27 19:34:01.791519 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:01.791482    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" path="/var/lib/kubelet/pods/5e47140e-cef4-4db2-acb9-eab9816cd861/volumes"
Jul 27 19:34:08.271142 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:08.271104    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:34:10.888770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:10.888736    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:34:10.889741 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:10.889721    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:34:24.061297 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.061264    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"]
Jul 27 19:34:24.061700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.061687    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy"
Jul 27 19:34:24.061739 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.061702    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy"
Jul 27 19:34:24.061786 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.061780    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy"
Jul 27 19:34:24.061859 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.061790    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy"
Jul 27 19:34:24.064801 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.064785    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"
Jul 27 19:34:24.067338 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.067307    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:34:24.071840 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.071797    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"]
Jul 27 19:34:24.202541 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.202512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1657b741-b2bb-45bf-813d-bbb70e26547d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb\" (UID: \"1657b741-b2bb-45bf-813d-bbb70e26547d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"
Jul 27 19:34:24.303019 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.302979    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1657b741-b2bb-45bf-813d-bbb70e26547d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb\" (UID: \"1657b741-b2bb-45bf-813d-bbb70e26547d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"
Jul 27 19:34:24.303607 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.303587    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1657b741-b2bb-45bf-813d-bbb70e26547d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb\" (UID: \"1657b741-b2bb-45bf-813d-bbb70e26547d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"
Jul 27 19:34:24.377576 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.377500    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"
Jul 27 19:34:24.523967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:24.523888    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"]
Jul 27 19:34:24.523967 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:34:24.523923    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1657b741_b2bb_45bf_813d_bbb70e26547d.slice/crio-47b5eb12f3ed0c4e711e1a8a9a849e8be97dc684f3d1f2d12711e16a75b4b6a6 WatchSource:0}: Error finding container 47b5eb12f3ed0c4e711e1a8a9a849e8be97dc684f3d1f2d12711e16a75b4b6a6: Status 404 returned error can't find the container with id 47b5eb12f3ed0c4e711e1a8a9a849e8be97dc684f3d1f2d12711e16a75b4b6a6
Jul 27 19:34:25.035186 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:25.035095    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb" event={"ID":"1657b741-b2bb-45bf-813d-bbb70e26547d","Type":"ContainerStarted","Data":"105b0d0a1312e97d76f69af931087d07eb72994f3cf797b41fb90509f40d1a0d"}
Jul 27 19:34:25.035186 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:25.035157    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb" event={"ID":"1657b741-b2bb-45bf-813d-bbb70e26547d","Type":"ContainerStarted","Data":"47b5eb12f3ed0c4e711e1a8a9a849e8be97dc684f3d1f2d12711e16a75b4b6a6"}
Jul 27 19:34:25.053237 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:25.053187    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb" podStartSLOduration=1.053173563 podStartE2EDuration="1.053173563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:25.049323427 +0000 UTC m=+1751.756462919" watchObservedRunningTime="2026-07-27 19:34:25.053173563 +0000 UTC m=+1751.760313054"
Jul 27 19:34:26.043459 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:26.043428    2557 generic.go:356] "Generic (PLEG): container finished" podID="1657b741-b2bb-45bf-813d-bbb70e26547d" containerID="105b0d0a1312e97d76f69af931087d07eb72994f3cf797b41fb90509f40d1a0d" exitCode=0
Jul 27 19:34:26.043883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:26.043520    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb" event={"ID":"1657b741-b2bb-45bf-813d-bbb70e26547d","Type":"ContainerDied","Data":"105b0d0a1312e97d76f69af931087d07eb72994f3cf797b41fb90509f40d1a0d"}
Jul 27 19:34:27.183520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:27.183493    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"
Jul 27 19:34:27.231583 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:27.231549    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1657b741-b2bb-45bf-813d-bbb70e26547d-maas-api-service-ca\") pod \"1657b741-b2bb-45bf-813d-bbb70e26547d\" (UID: \"1657b741-b2bb-45bf-813d-bbb70e26547d\") "
Jul 27 19:34:27.231920 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:27.231896    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1657b741-b2bb-45bf-813d-bbb70e26547d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1657b741-b2bb-45bf-813d-bbb70e26547d" (UID: "1657b741-b2bb-45bf-813d-bbb70e26547d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:34:27.332345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:27.332256    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1657b741-b2bb-45bf-813d-bbb70e26547d-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:28.063574 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:28.057044    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"
Jul 27 19:34:28.063574 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:28.056638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb" event={"ID":"1657b741-b2bb-45bf-813d-bbb70e26547d","Type":"ContainerDied","Data":"47b5eb12f3ed0c4e711e1a8a9a849e8be97dc684f3d1f2d12711e16a75b4b6a6"}
Jul 27 19:34:28.063574 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:28.057198    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47b5eb12f3ed0c4e711e1a8a9a849e8be97dc684f3d1f2d12711e16a75b4b6a6"
Jul 27 19:34:34.523384 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.523350    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"]
Jul 27 19:34:34.523889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.523597    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7" podUID="05c3c81a-cff8-4562-9dc5-80817cb4f4ea" containerName="payload-processing" containerID="cri-o://93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1" gracePeriod=30
Jul 27 19:34:34.532002 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.531974    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"]
Jul 27 19:34:34.535274 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.533237    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf" podUID="590b9812-dd39-4cab-9614-8166d35e16bd" containerName="payload-pre-processing" containerID="cri-o://e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94" gracePeriod=30
Jul 27 19:34:34.668177 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.668148    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"]
Jul 27 19:34:34.672630 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.672603    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bb026c71-rtfpb"]
Jul 27 19:34:34.797738 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.797713    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:34:34.828163 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.828144    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:34:34.894903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.894867    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rz7g\" (UniqueName: \"kubernetes.io/projected/590b9812-dd39-4cab-9614-8166d35e16bd-kube-api-access-8rz7g\") pod \"590b9812-dd39-4cab-9614-8166d35e16bd\" (UID: \"590b9812-dd39-4cab-9614-8166d35e16bd\") "
Jul 27 19:34:34.895050 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.894931    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b9812-dd39-4cab-9614-8166d35e16bd-plugins-config-volume\") pod \"590b9812-dd39-4cab-9614-8166d35e16bd\" (UID: \"590b9812-dd39-4cab-9614-8166d35e16bd\") "
Jul 27 19:34:34.895050 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.894963    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7mmc\" (UniqueName: \"kubernetes.io/projected/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-kube-api-access-p7mmc\") pod \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\" (UID: \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\") "
Jul 27 19:34:34.895050 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.894985    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-plugins-config-volume\") pod \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\" (UID: \"05c3c81a-cff8-4562-9dc5-80817cb4f4ea\") "
Jul 27 19:34:34.895379 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.895352    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/590b9812-dd39-4cab-9614-8166d35e16bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "590b9812-dd39-4cab-9614-8166d35e16bd" (UID: "590b9812-dd39-4cab-9614-8166d35e16bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:34:34.895535 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.895364    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05c3c81a-cff8-4562-9dc5-80817cb4f4ea" (UID: "05c3c81a-cff8-4562-9dc5-80817cb4f4ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:34:34.895768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.895742    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b9812-dd39-4cab-9614-8166d35e16bd-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:34.895899 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.895783    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:34.897210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.897190    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/590b9812-dd39-4cab-9614-8166d35e16bd-kube-api-access-8rz7g" (OuterVolumeSpecName: "kube-api-access-8rz7g") pod "590b9812-dd39-4cab-9614-8166d35e16bd" (UID: "590b9812-dd39-4cab-9614-8166d35e16bd"). InnerVolumeSpecName "kube-api-access-8rz7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:34.897290 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.897226    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-kube-api-access-p7mmc" (OuterVolumeSpecName: "kube-api-access-p7mmc") pod "05c3c81a-cff8-4562-9dc5-80817cb4f4ea" (UID: "05c3c81a-cff8-4562-9dc5-80817cb4f4ea"). InnerVolumeSpecName "kube-api-access-p7mmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:34.996861 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.996801    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7mmc\" (UniqueName: \"kubernetes.io/projected/05c3c81a-cff8-4562-9dc5-80817cb4f4ea-kube-api-access-p7mmc\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:34.996861 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:34.996857    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rz7g\" (UniqueName: \"kubernetes.io/projected/590b9812-dd39-4cab-9614-8166d35e16bd-kube-api-access-8rz7g\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:34:35.099453 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.099377    2557 generic.go:356] "Generic (PLEG): container finished" podID="590b9812-dd39-4cab-9614-8166d35e16bd" containerID="e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94" exitCode=0
Jul 27 19:34:35.099453 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.099420    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"
Jul 27 19:34:35.099692 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.099458    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf" event={"ID":"590b9812-dd39-4cab-9614-8166d35e16bd","Type":"ContainerDied","Data":"e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94"}
Jul 27 19:34:35.099692 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.099561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf" event={"ID":"590b9812-dd39-4cab-9614-8166d35e16bd","Type":"ContainerDied","Data":"80c5606e557bca84ffd1b88515ad52895b42f640b7da22c993eea81b32d2a2d0"}
Jul 27 19:34:35.099692 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.099599    2557 scope.go:117] "RemoveContainer" containerID="e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94"
Jul 27 19:34:35.100905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.100886    2557 generic.go:356] "Generic (PLEG): container finished" podID="05c3c81a-cff8-4562-9dc5-80817cb4f4ea" containerID="93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1" exitCode=0
Jul 27 19:34:35.100986 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.100924    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"
Jul 27 19:34:35.101041 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.100988    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7" event={"ID":"05c3c81a-cff8-4562-9dc5-80817cb4f4ea","Type":"ContainerDied","Data":"93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1"}
Jul 27 19:34:35.101079 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.101037    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7" event={"ID":"05c3c81a-cff8-4562-9dc5-80817cb4f4ea","Type":"ContainerDied","Data":"a4ebde8588c9e938c143c06cdc3c70f3400039af79490c8d816d29ddabff248e"}
Jul 27 19:34:35.109703 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.109685    2557 scope.go:117] "RemoveContainer" containerID="e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94"
Jul 27 19:34:35.109961 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:34:35.109938    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94\": container with ID starting with e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94 not found: ID does not exist" containerID="e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94"
Jul 27 19:34:35.110058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.109966    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94"} err="failed to get container status \"e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94\": rpc error: code = NotFound desc = could not find container \"e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94\": container with ID starting with e62e7b4326bf7bf424d91efeda34b63a6896477c6b2512644f6f851417ceed94 not found: ID does not exist"
Jul 27 19:34:35.110058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.109983    2557 scope.go:117] "RemoveContainer" containerID="93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1"
Jul 27 19:34:35.121098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.121080    2557 scope.go:117] "RemoveContainer" containerID="93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1"
Jul 27 19:34:35.121483 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:34:35.121458    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1\": container with ID starting with 93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1 not found: ID does not exist" containerID="93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1"
Jul 27 19:34:35.121528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.121495    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1"} err="failed to get container status \"93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1\": rpc error: code = NotFound desc = could not find container \"93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1\": container with ID starting with 93027377a22f6afb941a2d39577f1f9bed5074e0dd3b2ec8f66e08b3b6f73cd1 not found: ID does not exist"
Jul 27 19:34:35.134758 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.134732    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"]
Jul 27 19:34:35.142133 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.142113    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bb026c71-6d45f86d9d-bvvj7"]
Jul 27 19:34:35.162133 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.162108    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"]
Jul 27 19:34:35.170092 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.170073    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-bb026c71-67697dc976-qxzwf"]
Jul 27 19:34:35.791130 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.791101    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05c3c81a-cff8-4562-9dc5-80817cb4f4ea" path="/var/lib/kubelet/pods/05c3c81a-cff8-4562-9dc5-80817cb4f4ea/volumes"
Jul 27 19:34:35.791487 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.791419    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1657b741-b2bb-45bf-813d-bbb70e26547d" path="/var/lib/kubelet/pods/1657b741-b2bb-45bf-813d-bbb70e26547d/volumes"
Jul 27 19:34:35.791722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:35.791709    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="590b9812-dd39-4cab-9614-8166d35e16bd" path="/var/lib/kubelet/pods/590b9812-dd39-4cab-9614-8166d35e16bd/volumes"
Jul 27 19:34:36.802670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.802636    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"]
Jul 27 19:34:36.803226 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803206    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1657b741-b2bb-45bf-813d-bbb70e26547d" containerName="revoke-keys"
Jul 27 19:34:36.803316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803230    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1657b741-b2bb-45bf-813d-bbb70e26547d" containerName="revoke-keys"
Jul 27 19:34:36.803316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803248    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c3c81a-cff8-4562-9dc5-80817cb4f4ea" containerName="payload-processing"
Jul 27 19:34:36.803316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803258    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c3c81a-cff8-4562-9dc5-80817cb4f4ea" containerName="payload-processing"
Jul 27 19:34:36.803316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803276    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="590b9812-dd39-4cab-9614-8166d35e16bd" containerName="payload-pre-processing"
Jul 27 19:34:36.803316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803285    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="590b9812-dd39-4cab-9614-8166d35e16bd" containerName="payload-pre-processing"
Jul 27 19:34:36.803316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803304    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy"
Jul 27 19:34:36.803316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803314    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e47140e-cef4-4db2-acb9-eab9816cd861" containerName="istio-proxy"
Jul 27 19:34:36.803582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803443    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="590b9812-dd39-4cab-9614-8166d35e16bd" containerName="payload-pre-processing"
Jul 27 19:34:36.803582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803459    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1657b741-b2bb-45bf-813d-bbb70e26547d" containerName="revoke-keys"
Jul 27 19:34:36.803582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.803470    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c3c81a-cff8-4562-9dc5-80817cb4f4ea" containerName="payload-processing"
Jul 27 19:34:36.806619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.806598    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.808899 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.808879    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5dae47b4-openshift-default-dockercfg-8nprl\""
Jul 27 19:34:36.822915 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.822890    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"]
Jul 27 19:34:36.916793 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.916763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-socket\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.916970 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.916827    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-certs\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.916970 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.916891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-podinfo\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.916970 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.916924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcb667-21b1-44da-9e37-ed0eb66a3397-istiod-ca-cert\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.916970 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.916944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-data\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.916970 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.916967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-credential-socket\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.917240 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.917117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-token\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.917240 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.917168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-envoy\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:36.917240 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:36.917199    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvgr4\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-kube-api-access-kvgr4\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.017961 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.017926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-certs\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018122 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.017971    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-podinfo\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018122 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018002    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcb667-21b1-44da-9e37-ed0eb66a3397-istiod-ca-cert\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018122 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-data\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018157    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-credential-socket\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018279    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-token\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018322    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-envoy\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018355    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvgr4\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-kube-api-access-kvgr4\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018375    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-certs\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018540 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018389    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-data\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018540 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018401    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-socket\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018687 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018661    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-socket\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018850 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018701    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-credential-socket\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.018850 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.018774    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcb667-21b1-44da-9e37-ed0eb66a3397-istiod-ca-cert\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.020432 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.020411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-envoy\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.020743 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.020724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-podinfo\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.034076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.034056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-token\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.034210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.034192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvgr4\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-kube-api-access-kvgr4\") pod \"e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") " pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.116551 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.116469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:37.272732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.266213    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"]
Jul 27 19:34:37.272732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.268184    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:37.272732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.268335    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:37.272732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:37.268418    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:38.123705 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:38.123667    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" event={"ID":"51fcb667-21b1-44da-9e37-ed0eb66a3397","Type":"ContainerStarted","Data":"827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5"}
Jul 27 19:34:38.124117 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:38.123729    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" event={"ID":"51fcb667-21b1-44da-9e37-ed0eb66a3397","Type":"ContainerStarted","Data":"ba9ff1c8334cfeb7f25a7c18ba56f9eb4e2e44977ac7adf530c6adb0b47ad433"}
Jul 27 19:34:38.146846 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:38.146787    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" podStartSLOduration=2.146774512 podStartE2EDuration="2.146774512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:38.143447473 +0000 UTC m=+1764.850586990" watchObservedRunningTime="2026-07-27 19:34:38.146774512 +0000 UTC m=+1764.853914002"
Jul 27 19:34:38.264354 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:38.264322    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:34:39.117271 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:39.117239    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:39.122044 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:39.122019    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:39.129873 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:39.129839    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:39.130676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:39.130660    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:40.376047 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.376018    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"]
Jul 27 19:34:40.378629 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.378613    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:40.380921 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.380892    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-5dae47b4-dockercfg-xm6h2\""
Jul 27 19:34:40.381046 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.380925    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-5dae47b4\""
Jul 27 19:34:40.392964 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.392939    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"]
Jul 27 19:34:40.418759 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.418729    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"]
Jul 27 19:34:40.422059 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.422038    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:40.435225 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.435198    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"]
Jul 27 19:34:40.450408 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.450375    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mndqw\" (UniqueName: \"kubernetes.io/projected/f15a9871-99b6-4b56-bb99-3e097b51dcb9-kube-api-access-mndqw\") pod \"payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg\" (UID: \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\") " pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:40.450525 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.450431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rww2n\" (UniqueName: \"kubernetes.io/projected/a3035585-51c2-4c24-b83b-7479809156f8-kube-api-access-rww2n\") pod \"payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm\" (UID: \"a3035585-51c2-4c24-b83b-7479809156f8\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:40.450525 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.450457    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15a9871-99b6-4b56-bb99-3e097b51dcb9-plugins-config-volume\") pod \"payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg\" (UID: \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\") " pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:40.450525 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.450479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3035585-51c2-4c24-b83b-7479809156f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm\" (UID: \"a3035585-51c2-4c24-b83b-7479809156f8\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:40.551091 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.551064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mndqw\" (UniqueName: \"kubernetes.io/projected/f15a9871-99b6-4b56-bb99-3e097b51dcb9-kube-api-access-mndqw\") pod \"payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg\" (UID: \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\") " pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:40.551284 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.551107    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rww2n\" (UniqueName: \"kubernetes.io/projected/a3035585-51c2-4c24-b83b-7479809156f8-kube-api-access-rww2n\") pod \"payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm\" (UID: \"a3035585-51c2-4c24-b83b-7479809156f8\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:40.551284 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.551133    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15a9871-99b6-4b56-bb99-3e097b51dcb9-plugins-config-volume\") pod \"payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg\" (UID: \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\") " pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:40.551284 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.551155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3035585-51c2-4c24-b83b-7479809156f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm\" (UID: \"a3035585-51c2-4c24-b83b-7479809156f8\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:40.551871 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.551853    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15a9871-99b6-4b56-bb99-3e097b51dcb9-plugins-config-volume\") pod \"payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg\" (UID: \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\") " pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:40.551926 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.551889    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3035585-51c2-4c24-b83b-7479809156f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm\" (UID: \"a3035585-51c2-4c24-b83b-7479809156f8\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:40.562389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.562362    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rww2n\" (UniqueName: \"kubernetes.io/projected/a3035585-51c2-4c24-b83b-7479809156f8-kube-api-access-rww2n\") pod \"payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm\" (UID: \"a3035585-51c2-4c24-b83b-7479809156f8\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:40.562597 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.562577    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mndqw\" (UniqueName: \"kubernetes.io/projected/f15a9871-99b6-4b56-bb99-3e097b51dcb9-kube-api-access-mndqw\") pod \"payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg\" (UID: \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\") " pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:40.690114 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.690081    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:40.736410 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.736381    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:40.850485 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.850454    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"]
Jul 27 19:34:40.851651 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:34:40.851627    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3035585_51c2_4c24_b83b_7479809156f8.slice/crio-7610a0d0c487a984e1f9d8f1b2eff999758610712211f835a1d64d7a67bf4733 WatchSource:0}: Error finding container 7610a0d0c487a984e1f9d8f1b2eff999758610712211f835a1d64d7a67bf4733: Status 404 returned error can't find the container with id 7610a0d0c487a984e1f9d8f1b2eff999758610712211f835a1d64d7a67bf4733
Jul 27 19:34:40.898797 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:40.898771    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"]
Jul 27 19:34:40.899361 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:34:40.899334    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15a9871_99b6_4b56_bb99_3e097b51dcb9.slice/crio-ec081f261ba350955177cfa244b4797ccf96af816ac83ec4d5435c9fc5e792cc WatchSource:0}: Error finding container ec081f261ba350955177cfa244b4797ccf96af816ac83ec4d5435c9fc5e792cc: Status 404 returned error can't find the container with id ec081f261ba350955177cfa244b4797ccf96af816ac83ec4d5435c9fc5e792cc
Jul 27 19:34:41.144751 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:41.144713    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm" event={"ID":"a3035585-51c2-4c24-b83b-7479809156f8","Type":"ContainerStarted","Data":"4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717"}
Jul 27 19:34:41.144970 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:41.144768    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:41.144970 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:41.144784    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm" event={"ID":"a3035585-51c2-4c24-b83b-7479809156f8","Type":"ContainerStarted","Data":"7610a0d0c487a984e1f9d8f1b2eff999758610712211f835a1d64d7a67bf4733"}
Jul 27 19:34:41.146418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:41.146396    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg" event={"ID":"f15a9871-99b6-4b56-bb99-3e097b51dcb9","Type":"ContainerStarted","Data":"6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006"}
Jul 27 19:34:41.146536 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:41.146433    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg" event={"ID":"f15a9871-99b6-4b56-bb99-3e097b51dcb9","Type":"ContainerStarted","Data":"ec081f261ba350955177cfa244b4797ccf96af816ac83ec4d5435c9fc5e792cc"}
Jul 27 19:34:41.181321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:41.181274    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm" podStartSLOduration=1.181259646 podStartE2EDuration="1.181259646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:41.180204771 +0000 UTC m=+1767.887344286" watchObservedRunningTime="2026-07-27 19:34:41.181259646 +0000 UTC m=+1767.888399137"
Jul 27 19:34:41.234986 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:41.234885    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg" podStartSLOduration=1.234869521 podStartE2EDuration="1.234869521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:41.233762963 +0000 UTC m=+1767.940902454" watchObservedRunningTime="2026-07-27 19:34:41.234869521 +0000 UTC m=+1767.942009012"
Jul 27 19:34:42.152396 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:42.152352    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:48.661113 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:48.661077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:34:52.155002 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:52.154974    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:34:53.161414 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:53.161382    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:34:53.232065 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:53.232031    2557 generic.go:356] "Generic (PLEG): container finished" podID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerID="827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5" exitCode=0
Jul 27 19:34:53.232226 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:53.232100    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" event={"ID":"51fcb667-21b1-44da-9e37-ed0eb66a3397","Type":"ContainerDied","Data":"827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5"}
Jul 27 19:34:53.232530 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:53.232505    2557 scope.go:117] "RemoveContainer" containerID="827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5"
Jul 27 19:34:53.233502 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:53.233476    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:53.233562 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:53.233537    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:53.233597 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:53.233567    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:54.130783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:54.130754    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:54.240208 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:54.240173    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" event={"ID":"51fcb667-21b1-44da-9e37-ed0eb66a3397","Type":"ContainerStarted","Data":"7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e"}
Jul 27 19:34:55.117611 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:55.117569    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:55.118990 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:55.118961    2557 patch_prober.go:28] interesting pod/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:34:55.119119 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:55.119007    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 19:34:56.117201 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:56.117163    2557 patch_prober.go:28] interesting pod/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:34:56.117588 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:56.117222    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 19:34:57.117502 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:57.117463    2557 patch_prober.go:28] interesting pod/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:34:57.117952 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:57.117531    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 19:34:58.117881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:58.117844    2557 patch_prober.go:28] interesting pod/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:34:58.118273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:58.117899    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 19:34:59.121256 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:59.121228    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:59.121630 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:59.121601    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:34:59.122262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:34:59.122242    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:35:04.427701 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.427617    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"]
Jul 27 19:35:04.430372 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.430356    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"
Jul 27 19:35:04.432558 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.432542    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:35:04.439573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.439546    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"]
Jul 27 19:35:04.607470 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.607431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f2333a-fb87-4e35-bdee-78cbeb3763aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9\" (UID: \"33f2333a-fb87-4e35-bdee-78cbeb3763aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"
Jul 27 19:35:04.708301 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.708261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f2333a-fb87-4e35-bdee-78cbeb3763aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9\" (UID: \"33f2333a-fb87-4e35-bdee-78cbeb3763aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"
Jul 27 19:35:04.708906 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.708886    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f2333a-fb87-4e35-bdee-78cbeb3763aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9\" (UID: \"33f2333a-fb87-4e35-bdee-78cbeb3763aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"
Jul 27 19:35:04.742710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.742668    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"
Jul 27 19:35:04.890192 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:35:04.890159    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f2333a_fb87_4e35_bdee_78cbeb3763aa.slice/crio-9a4221fe5fcadf640df7337d368582c3837c6240c8144804b0258055416e7966 WatchSource:0}: Error finding container 9a4221fe5fcadf640df7337d368582c3837c6240c8144804b0258055416e7966: Status 404 returned error can't find the container with id 9a4221fe5fcadf640df7337d368582c3837c6240c8144804b0258055416e7966
Jul 27 19:35:04.890344 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:04.890264    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"]
Jul 27 19:35:05.314225 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:05.314192    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9" event={"ID":"33f2333a-fb87-4e35-bdee-78cbeb3763aa","Type":"ContainerStarted","Data":"bbc9cc9c2c58f8455432914c219c191c448cd411fae3f11a65ccc90601fa85e5"}
Jul 27 19:35:05.314420 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:05.314255    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9" event={"ID":"33f2333a-fb87-4e35-bdee-78cbeb3763aa","Type":"ContainerStarted","Data":"9a4221fe5fcadf640df7337d368582c3837c6240c8144804b0258055416e7966"}
Jul 27 19:35:05.334271 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:05.334209    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9" podStartSLOduration=1.33418796 podStartE2EDuration="1.33418796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:05.329275254 +0000 UTC m=+1792.036414746" watchObservedRunningTime="2026-07-27 19:35:05.33418796 +0000 UTC m=+1792.041327454"
Jul 27 19:35:06.322334 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:06.322297    2557 generic.go:356] "Generic (PLEG): container finished" podID="33f2333a-fb87-4e35-bdee-78cbeb3763aa" containerID="bbc9cc9c2c58f8455432914c219c191c448cd411fae3f11a65ccc90601fa85e5" exitCode=0
Jul 27 19:35:06.322876 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:06.322345    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9" event={"ID":"33f2333a-fb87-4e35-bdee-78cbeb3763aa","Type":"ContainerDied","Data":"bbc9cc9c2c58f8455432914c219c191c448cd411fae3f11a65ccc90601fa85e5"}
Jul 27 19:35:07.467759 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:07.467736    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"
Jul 27 19:35:07.637549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:07.637461    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f2333a-fb87-4e35-bdee-78cbeb3763aa-maas-api-service-ca\") pod \"33f2333a-fb87-4e35-bdee-78cbeb3763aa\" (UID: \"33f2333a-fb87-4e35-bdee-78cbeb3763aa\") "
Jul 27 19:35:07.637793 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:07.637772    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33f2333a-fb87-4e35-bdee-78cbeb3763aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33f2333a-fb87-4e35-bdee-78cbeb3763aa" (UID: "33f2333a-fb87-4e35-bdee-78cbeb3763aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:35:07.738504 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:07.738477    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f2333a-fb87-4e35-bdee-78cbeb3763aa-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:08.335889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:08.335861    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"
Jul 27 19:35:08.335889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:08.335875    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9" event={"ID":"33f2333a-fb87-4e35-bdee-78cbeb3763aa","Type":"ContainerDied","Data":"9a4221fe5fcadf640df7337d368582c3837c6240c8144804b0258055416e7966"}
Jul 27 19:35:08.336109 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:08.335932    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a4221fe5fcadf640df7337d368582c3837c6240c8144804b0258055416e7966"
Jul 27 19:35:13.892146 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:13.892114    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:35:13.896602 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:13.896582    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:35:13.897350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:13.897330    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:35:13.901900 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:13.901884    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:35:14.993841 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:14.993790    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"]
Jul 27 19:35:14.994278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:14.994112    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg" podUID="f15a9871-99b6-4b56-bb99-3e097b51dcb9" containerName="payload-processing" containerID="cri-o://6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006" gracePeriod=30
Jul 27 19:35:15.000788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.000758    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"]
Jul 27 19:35:15.001068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.001024    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm" podUID="a3035585-51c2-4c24-b83b-7479809156f8" containerName="payload-pre-processing" containerID="cri-o://4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717" gracePeriod=30
Jul 27 19:35:15.164216 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.164180    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"]
Jul 27 19:35:15.168285 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.168255    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5dae47b4-wtrh9"]
Jul 27 19:35:15.277964 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.277937    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:35:15.315845 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.315724    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"]
Jul 27 19:35:15.316095 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.316004    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy" containerID="cri-o://7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e" gracePeriod=30
Jul 27 19:35:15.318368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.318334    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:35:15.387785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.387750    2557 generic.go:356] "Generic (PLEG): container finished" podID="a3035585-51c2-4c24-b83b-7479809156f8" containerID="4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717" exitCode=0
Jul 27 19:35:15.388010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.387795    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"
Jul 27 19:35:15.388010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.387845    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm" event={"ID":"a3035585-51c2-4c24-b83b-7479809156f8","Type":"ContainerDied","Data":"4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717"}
Jul 27 19:35:15.388010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.387903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm" event={"ID":"a3035585-51c2-4c24-b83b-7479809156f8","Type":"ContainerDied","Data":"7610a0d0c487a984e1f9d8f1b2eff999758610712211f835a1d64d7a67bf4733"}
Jul 27 19:35:15.388010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.387932    2557 scope.go:117] "RemoveContainer" containerID="4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717"
Jul 27 19:35:15.389422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.389401    2557 generic.go:356] "Generic (PLEG): container finished" podID="f15a9871-99b6-4b56-bb99-3e097b51dcb9" containerID="6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006" exitCode=0
Jul 27 19:35:15.389538 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.389446    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"
Jul 27 19:35:15.389634 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.389610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg" event={"ID":"f15a9871-99b6-4b56-bb99-3e097b51dcb9","Type":"ContainerDied","Data":"6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006"}
Jul 27 19:35:15.389711 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.389665    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg" event={"ID":"f15a9871-99b6-4b56-bb99-3e097b51dcb9","Type":"ContainerDied","Data":"ec081f261ba350955177cfa244b4797ccf96af816ac83ec4d5435c9fc5e792cc"}
Jul 27 19:35:15.397597 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.397578    2557 scope.go:117] "RemoveContainer" containerID="4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717"
Jul 27 19:35:15.397870 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:35:15.397849    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717\": container with ID starting with 4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717 not found: ID does not exist" containerID="4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717"
Jul 27 19:35:15.397939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.397880    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717"} err="failed to get container status \"4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717\": rpc error: code = NotFound desc = could not find container \"4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717\": container with ID starting with 4f85492e6ab8f9ad941e649d4d2a84d08be464cdb803409487527d9cdc9b1717 not found: ID does not exist"
Jul 27 19:35:15.397939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.397896    2557 scope.go:117] "RemoveContainer" containerID="6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006"
Jul 27 19:35:15.404455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.404435    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mndqw\" (UniqueName: \"kubernetes.io/projected/f15a9871-99b6-4b56-bb99-3e097b51dcb9-kube-api-access-mndqw\") pod \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\" (UID: \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\") "
Jul 27 19:35:15.404623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.404464    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3035585-51c2-4c24-b83b-7479809156f8-plugins-config-volume\") pod \"a3035585-51c2-4c24-b83b-7479809156f8\" (UID: \"a3035585-51c2-4c24-b83b-7479809156f8\") "
Jul 27 19:35:15.404623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.404517    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15a9871-99b6-4b56-bb99-3e097b51dcb9-plugins-config-volume\") pod \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\" (UID: \"f15a9871-99b6-4b56-bb99-3e097b51dcb9\") "
Jul 27 19:35:15.404623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.404556    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rww2n\" (UniqueName: \"kubernetes.io/projected/a3035585-51c2-4c24-b83b-7479809156f8-kube-api-access-rww2n\") pod \"a3035585-51c2-4c24-b83b-7479809156f8\" (UID: \"a3035585-51c2-4c24-b83b-7479809156f8\") "
Jul 27 19:35:15.405023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.404921    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f15a9871-99b6-4b56-bb99-3e097b51dcb9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f15a9871-99b6-4b56-bb99-3e097b51dcb9" (UID: "f15a9871-99b6-4b56-bb99-3e097b51dcb9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:35:15.405070 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.405018    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3035585-51c2-4c24-b83b-7479809156f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3035585-51c2-4c24-b83b-7479809156f8" (UID: "a3035585-51c2-4c24-b83b-7479809156f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:35:15.406552 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.406532    2557 scope.go:117] "RemoveContainer" containerID="6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006"
Jul 27 19:35:15.406847 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:35:15.406797    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006\": container with ID starting with 6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006 not found: ID does not exist" containerID="6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006"
Jul 27 19:35:15.406922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.406855    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006"} err="failed to get container status \"6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006\": rpc error: code = NotFound desc = could not find container \"6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006\": container with ID starting with 6f1ab42fb7bf5903f07c2ac5c5a23496fb6aa270f05955d204110fe153d2b006 not found: ID does not exist"
Jul 27 19:35:15.407296 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.407277    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f15a9871-99b6-4b56-bb99-3e097b51dcb9-kube-api-access-mndqw" (OuterVolumeSpecName: "kube-api-access-mndqw") pod "f15a9871-99b6-4b56-bb99-3e097b51dcb9" (UID: "f15a9871-99b6-4b56-bb99-3e097b51dcb9"). InnerVolumeSpecName "kube-api-access-mndqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:15.407360 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.407307    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3035585-51c2-4c24-b83b-7479809156f8-kube-api-access-rww2n" (OuterVolumeSpecName: "kube-api-access-rww2n") pod "a3035585-51c2-4c24-b83b-7479809156f8" (UID: "a3035585-51c2-4c24-b83b-7479809156f8"). InnerVolumeSpecName "kube-api-access-rww2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:15.505363 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.505279    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15a9871-99b6-4b56-bb99-3e097b51dcb9-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:15.505363 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.505307    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rww2n\" (UniqueName: \"kubernetes.io/projected/a3035585-51c2-4c24-b83b-7479809156f8-kube-api-access-rww2n\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:15.505363 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.505317    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mndqw\" (UniqueName: \"kubernetes.io/projected/f15a9871-99b6-4b56-bb99-3e097b51dcb9-kube-api-access-mndqw\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:15.505363 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.505325    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3035585-51c2-4c24-b83b-7479809156f8-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:15.719273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.719243    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"]
Jul 27 19:35:15.725436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.725410    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5dae47b4-64c966bcbd-f86pm"]
Jul 27 19:35:15.737007 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.736986    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"]
Jul 27 19:35:15.741579 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.741556    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5dae47b4-566f8c6cf8-fjrvg"]
Jul 27 19:35:15.791493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.791424    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f2333a-fb87-4e35-bdee-78cbeb3763aa" path="/var/lib/kubelet/pods/33f2333a-fb87-4e35-bdee-78cbeb3763aa/volumes"
Jul 27 19:35:15.791798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.791786    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3035585-51c2-4c24-b83b-7479809156f8" path="/var/lib/kubelet/pods/a3035585-51c2-4c24-b83b-7479809156f8/volumes"
Jul 27 19:35:15.792122 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:15.792110    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f15a9871-99b6-4b56-bb99-3e097b51dcb9" path="/var/lib/kubelet/pods/f15a9871-99b6-4b56-bb99-3e097b51dcb9/volumes"
Jul 27 19:35:18.866714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:18.866681    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:35:20.579219 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.579162    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:35:20.646885 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.646858    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-socket\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647034 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.646911    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-token\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647034 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.646950    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-podinfo\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647034 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.646968    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-credential-socket\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647034 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647002    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-data\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647034 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647019    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvgr4\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-kube-api-access-kvgr4\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647073    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcb667-21b1-44da-9e37-ed0eb66a3397-istiod-ca-cert\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647096    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-certs\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647127    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-envoy\") pod \"51fcb667-21b1-44da-9e37-ed0eb66a3397\" (UID: \"51fcb667-21b1-44da-9e37-ed0eb66a3397\") "
Jul 27 19:35:20.647273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647144    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:35:20.647485 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647282    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:35:20.647485 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647448    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:35:20.647593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647487    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51fcb667-21b1-44da-9e37-ed0eb66a3397-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:35:20.647593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647500    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:20.647593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.647526    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-credential-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:20.648107 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.648079    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-data" (OuterVolumeSpecName: "istio-data") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:35:20.649275 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.649248    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:35:20.649481 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.649460    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:35:20.649534 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.649513    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-kube-api-access-kvgr4" (OuterVolumeSpecName: "kube-api-access-kvgr4") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "kube-api-access-kvgr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:20.649573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.649553    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-token" (OuterVolumeSpecName: "istio-token") pod "51fcb667-21b1-44da-9e37-ed0eb66a3397" (UID: "51fcb667-21b1-44da-9e37-ed0eb66a3397"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:20.748730 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.748706    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-podinfo\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:20.748730 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.748728    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-data\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:20.748889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.748738    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvgr4\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-kube-api-access-kvgr4\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:20.748889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.748747    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcb667-21b1-44da-9e37-ed0eb66a3397-istiod-ca-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:20.748889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.748756    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-workload-certs\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:20.748889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.748764    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-envoy\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:20.748889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:20.748771    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcb667-21b1-44da-9e37-ed0eb66a3397-istio-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:35:21.430549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.430519    2557 generic.go:356] "Generic (PLEG): container finished" podID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerID="7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e" exitCode=0
Jul 27 19:35:21.430677 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.430572    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"
Jul 27 19:35:21.430677 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.430595    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" event={"ID":"51fcb667-21b1-44da-9e37-ed0eb66a3397","Type":"ContainerDied","Data":"7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e"}
Jul 27 19:35:21.430677 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.430647    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp" event={"ID":"51fcb667-21b1-44da-9e37-ed0eb66a3397","Type":"ContainerDied","Data":"ba9ff1c8334cfeb7f25a7c18ba56f9eb4e2e44977ac7adf530c6adb0b47ad433"}
Jul 27 19:35:21.430677 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.430670    2557 scope.go:117] "RemoveContainer" containerID="7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e"
Jul 27 19:35:21.440409 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.440273    2557 scope.go:117] "RemoveContainer" containerID="827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5"
Jul 27 19:35:21.449447 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.449430    2557 scope.go:117] "RemoveContainer" containerID="7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e"
Jul 27 19:35:21.449802 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:35:21.449779    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e\": container with ID starting with 7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e not found: ID does not exist" containerID="7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e"
Jul 27 19:35:21.449906 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.449828    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e"} err="failed to get container status \"7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e\": rpc error: code = NotFound desc = could not find container \"7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e\": container with ID starting with 7987d3dd0c6f0e8ce7990ddb8557485766bd86e41c6221aa4813ad285b541a3e not found: ID does not exist"
Jul 27 19:35:21.449906 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.449852    2557 scope.go:117] "RemoveContainer" containerID="827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5"
Jul 27 19:35:21.450240 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:35:21.450219    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5\": container with ID starting with 827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5 not found: ID does not exist" containerID="827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5"
Jul 27 19:35:21.450323 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.450243    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5"} err="failed to get container status \"827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5\": rpc error: code = NotFound desc = could not find container \"827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5\": container with ID starting with 827068f181c80597f68270d626e1553fd82f1ca188696567ed20306cb7ab9ce5 not found: ID does not exist"
Jul 27 19:35:21.453063 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.453043    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"]
Jul 27 19:35:21.457630 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.457611    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5dae47b4-openshift-default-76d7cb7948-n4fzp"]
Jul 27 19:35:21.791838 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:35:21.791791    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" path="/var/lib/kubelet/pods/51fcb667-21b1-44da-9e37-ed0eb66a3397/volumes"
Jul 27 19:36:40.971344 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:40.971265    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:36:50.763493 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:50.763448    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:36:57.690841 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.690795    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"]
Jul 27 19:36:57.691241 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691228    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f2333a-fb87-4e35-bdee-78cbeb3763aa" containerName="revoke-keys"
Jul 27 19:36:57.691288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691243    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f2333a-fb87-4e35-bdee-78cbeb3763aa" containerName="revoke-keys"
Jul 27 19:36:57.691288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691257    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3035585-51c2-4c24-b83b-7479809156f8" containerName="payload-pre-processing"
Jul 27 19:36:57.691288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691262    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3035585-51c2-4c24-b83b-7479809156f8" containerName="payload-pre-processing"
Jul 27 19:36:57.691288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691282    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy"
Jul 27 19:36:57.691288 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691288    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691295    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15a9871-99b6-4b56-bb99-3e097b51dcb9" containerName="payload-processing"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691300    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15a9871-99b6-4b56-bb99-3e097b51dcb9" containerName="payload-processing"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691309    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691313    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691372    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691378    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f15a9871-99b6-4b56-bb99-3e097b51dcb9" containerName="payload-processing"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691385    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3035585-51c2-4c24-b83b-7479809156f8" containerName="payload-pre-processing"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691391    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="51fcb667-21b1-44da-9e37-ed0eb66a3397" containerName="istio-proxy"
Jul 27 19:36:57.691457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.691398    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f2333a-fb87-4e35-bdee-78cbeb3763aa" containerName="revoke-keys"
Jul 27 19:36:57.694800 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.694785    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:57.697079 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.697058    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c581614e\""
Jul 27 19:36:57.705442 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.705421    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"]
Jul 27 19:36:57.722926 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.722897    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"]
Jul 27 19:36:57.726559 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.726542    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:57.729014 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.728996    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c581614e-dockercfg-n9ctz\""
Jul 27 19:36:57.734545 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.734516    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"]
Jul 27 19:36:57.742993 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.742973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57a5392d-00a8-4fe2-8c40-e296f0a749b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl\" (UID: \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:57.743094 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.743054    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stggb\" (UniqueName: \"kubernetes.io/projected/57a5392d-00a8-4fe2-8c40-e296f0a749b7-kube-api-access-stggb\") pod \"payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl\" (UID: \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:57.844258 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.844221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-plugins-config-volume\") pod \"payload-processing-e2e-mt-c581614e-9d6979546-n7vx4\" (UID: \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\") " pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:57.844421 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.844289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57a5392d-00a8-4fe2-8c40-e296f0a749b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl\" (UID: \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:57.844465 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.844425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb2dg\" (UniqueName: \"kubernetes.io/projected/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-kube-api-access-gb2dg\") pod \"payload-processing-e2e-mt-c581614e-9d6979546-n7vx4\" (UID: \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\") " pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:57.844540 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.844520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stggb\" (UniqueName: \"kubernetes.io/projected/57a5392d-00a8-4fe2-8c40-e296f0a749b7-kube-api-access-stggb\") pod \"payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl\" (UID: \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:57.845303 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.845278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57a5392d-00a8-4fe2-8c40-e296f0a749b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl\" (UID: \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:57.854675 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.854655    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stggb\" (UniqueName: \"kubernetes.io/projected/57a5392d-00a8-4fe2-8c40-e296f0a749b7-kube-api-access-stggb\") pod \"payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl\" (UID: \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:57.945778 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.945703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-plugins-config-volume\") pod \"payload-processing-e2e-mt-c581614e-9d6979546-n7vx4\" (UID: \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\") " pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:57.945939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.945792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb2dg\" (UniqueName: \"kubernetes.io/projected/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-kube-api-access-gb2dg\") pod \"payload-processing-e2e-mt-c581614e-9d6979546-n7vx4\" (UID: \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\") " pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:57.946427 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.946408    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-plugins-config-volume\") pod \"payload-processing-e2e-mt-c581614e-9d6979546-n7vx4\" (UID: \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\") " pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:57.954509 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:57.954486    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb2dg\" (UniqueName: \"kubernetes.io/projected/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-kube-api-access-gb2dg\") pod \"payload-processing-e2e-mt-c581614e-9d6979546-n7vx4\" (UID: \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\") " pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:58.006577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:58.006551    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:58.038461 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:58.038325    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:58.371786 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:58.371759    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"]
Jul 27 19:36:58.372370 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:36:58.372348    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a5392d_00a8_4fe2_8c40_e296f0a749b7.slice/crio-590ff7566055c628b28bdd280d73365b78fccb2b78e39b63991a13bd5e64e5ee WatchSource:0}: Error finding container 590ff7566055c628b28bdd280d73365b78fccb2b78e39b63991a13bd5e64e5ee: Status 404 returned error can't find the container with id 590ff7566055c628b28bdd280d73365b78fccb2b78e39b63991a13bd5e64e5ee
Jul 27 19:36:58.403696 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:58.403672    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"]
Jul 27 19:36:58.406025 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:36:58.405996    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e0fa2f_bbc2_44ef_a311_5ebf3da238c4.slice/crio-e0904c11fd165c8fb7b01511a7b5fb8f007ebba5f70905bfa2e5b8c440717139 WatchSource:0}: Error finding container e0904c11fd165c8fb7b01511a7b5fb8f007ebba5f70905bfa2e5b8c440717139: Status 404 returned error can't find the container with id e0904c11fd165c8fb7b01511a7b5fb8f007ebba5f70905bfa2e5b8c440717139
Jul 27 19:36:59.024752 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:59.024718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl" event={"ID":"57a5392d-00a8-4fe2-8c40-e296f0a749b7","Type":"ContainerStarted","Data":"f0b4d26fddb8752b9444db2218f4623170b84225e696a43ca26ae3edf30e7480"}
Jul 27 19:36:59.025258 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:59.024789    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:36:59.025258 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:59.024851    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl" event={"ID":"57a5392d-00a8-4fe2-8c40-e296f0a749b7","Type":"ContainerStarted","Data":"590ff7566055c628b28bdd280d73365b78fccb2b78e39b63991a13bd5e64e5ee"}
Jul 27 19:36:59.026407 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:59.026383    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4" event={"ID":"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4","Type":"ContainerStarted","Data":"80dbcd1c0d3bf00679eb111b8e299e140276f5a403cebce1c2db287d57decbfd"}
Jul 27 19:36:59.026516 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:59.026424    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4" event={"ID":"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4","Type":"ContainerStarted","Data":"e0904c11fd165c8fb7b01511a7b5fb8f007ebba5f70905bfa2e5b8c440717139"}
Jul 27 19:36:59.026516 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:59.026445    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:36:59.043551 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:59.043508    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl" podStartSLOduration=2.043495099 podStartE2EDuration="2.043495099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:59.041164504 +0000 UTC m=+1905.748303996" watchObservedRunningTime="2026-07-27 19:36:59.043495099 +0000 UTC m=+1905.750634590"
Jul 27 19:36:59.058695 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:36:59.058652    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4" podStartSLOduration=2.058639521 podStartE2EDuration="2.058639521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:59.055992584 +0000 UTC m=+1905.763132076" watchObservedRunningTime="2026-07-27 19:36:59.058639521 +0000 UTC m=+1905.765779011"
Jul 27 19:37:03.361552 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:03.361516    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:37:08.481152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.481116    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"]
Jul 27 19:37:08.486826 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.486712    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"
Jul 27 19:37:08.489501 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.489470    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:37:08.495349 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.495312    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"]
Jul 27 19:37:08.546228 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.546184    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92c5de2-7130-4526-8371-2266e27cd304-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c581614e-8jnnt\" (UID: \"f92c5de2-7130-4526-8371-2266e27cd304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"
Jul 27 19:37:08.646677 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.646643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92c5de2-7130-4526-8371-2266e27cd304-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c581614e-8jnnt\" (UID: \"f92c5de2-7130-4526-8371-2266e27cd304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"
Jul 27 19:37:08.647358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.647338    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92c5de2-7130-4526-8371-2266e27cd304-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c581614e-8jnnt\" (UID: \"f92c5de2-7130-4526-8371-2266e27cd304\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"
Jul 27 19:37:08.802556 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.802478    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"
Jul 27 19:37:08.948497 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:08.948434    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"]
Jul 27 19:37:08.949060 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:37:08.949031    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92c5de2_7130_4526_8371_2266e27cd304.slice/crio-54fc61bb5762121dca622634f78964c7ef6a23f75990fcb69e035b0be3fc35c3 WatchSource:0}: Error finding container 54fc61bb5762121dca622634f78964c7ef6a23f75990fcb69e035b0be3fc35c3: Status 404 returned error can't find the container with id 54fc61bb5762121dca622634f78964c7ef6a23f75990fcb69e035b0be3fc35c3
Jul 27 19:37:09.088586 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:09.088503    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt" event={"ID":"f92c5de2-7130-4526-8371-2266e27cd304","Type":"ContainerStarted","Data":"54fc61bb5762121dca622634f78964c7ef6a23f75990fcb69e035b0be3fc35c3"}
Jul 27 19:37:10.034740 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:10.034660    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:37:10.034740 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:10.034735    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:37:10.098182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:10.098148    2557 generic.go:356] "Generic (PLEG): container finished" podID="f92c5de2-7130-4526-8371-2266e27cd304" containerID="d732eafe91c6f4b8343f3cd6eac3b8558a0012da52c9d4406976c976bab8556a" exitCode=0
Jul 27 19:37:10.098353 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:10.098229    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt" event={"ID":"f92c5de2-7130-4526-8371-2266e27cd304","Type":"ContainerDied","Data":"d732eafe91c6f4b8343f3cd6eac3b8558a0012da52c9d4406976c976bab8556a"}
Jul 27 19:37:11.236999 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:11.236974    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"
Jul 27 19:37:11.372179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:11.372097    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92c5de2-7130-4526-8371-2266e27cd304-maas-api-service-ca\") pod \"f92c5de2-7130-4526-8371-2266e27cd304\" (UID: \"f92c5de2-7130-4526-8371-2266e27cd304\") "
Jul 27 19:37:11.372440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:11.372417    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92c5de2-7130-4526-8371-2266e27cd304-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f92c5de2-7130-4526-8371-2266e27cd304" (UID: "f92c5de2-7130-4526-8371-2266e27cd304"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:37:11.473480 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:11.473451    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92c5de2-7130-4526-8371-2266e27cd304-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:37:12.115099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:12.115022    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"
Jul 27 19:37:12.115099 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:12.115076    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt" event={"ID":"f92c5de2-7130-4526-8371-2266e27cd304","Type":"ContainerDied","Data":"54fc61bb5762121dca622634f78964c7ef6a23f75990fcb69e035b0be3fc35c3"}
Jul 27 19:37:12.115282 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:12.115123    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54fc61bb5762121dca622634f78964c7ef6a23f75990fcb69e035b0be3fc35c3"
Jul 27 19:37:18.927524 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:18.927489    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"]
Jul 27 19:37:18.928016 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:18.927760    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4" podUID="48e0fa2f-bbc2-44ef-a311-5ebf3da238c4" containerName="payload-processing" containerID="cri-o://80dbcd1c0d3bf00679eb111b8e299e140276f5a403cebce1c2db287d57decbfd" gracePeriod=30
Jul 27 19:37:18.937635 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:18.937610    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"]
Jul 27 19:37:18.937889 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:18.937840    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl" podUID="57a5392d-00a8-4fe2-8c40-e296f0a749b7" containerName="payload-pre-processing" containerID="cri-o://f0b4d26fddb8752b9444db2218f4623170b84225e696a43ca26ae3edf30e7480" gracePeriod=30
Jul 27 19:37:19.063174 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.063141    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"]
Jul 27 19:37:19.066549 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.066522    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c581614e-8jnnt"]
Jul 27 19:37:19.161545 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.161515    2557 generic.go:356] "Generic (PLEG): container finished" podID="57a5392d-00a8-4fe2-8c40-e296f0a749b7" containerID="f0b4d26fddb8752b9444db2218f4623170b84225e696a43ca26ae3edf30e7480" exitCode=0
Jul 27 19:37:19.161747 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.161603    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl" event={"ID":"57a5392d-00a8-4fe2-8c40-e296f0a749b7","Type":"ContainerDied","Data":"f0b4d26fddb8752b9444db2218f4623170b84225e696a43ca26ae3edf30e7480"}
Jul 27 19:37:19.163524 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.163503    2557 generic.go:356] "Generic (PLEG): container finished" podID="48e0fa2f-bbc2-44ef-a311-5ebf3da238c4" containerID="80dbcd1c0d3bf00679eb111b8e299e140276f5a403cebce1c2db287d57decbfd" exitCode=0
Jul 27 19:37:19.163663 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.163619    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4" event={"ID":"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4","Type":"ContainerDied","Data":"80dbcd1c0d3bf00679eb111b8e299e140276f5a403cebce1c2db287d57decbfd"}
Jul 27 19:37:19.223315 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.223292    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:37:19.226111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.226092    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:37:19.346475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.346448    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57a5392d-00a8-4fe2-8c40-e296f0a749b7-plugins-config-volume\") pod \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\" (UID: \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\") "
Jul 27 19:37:19.346475 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.346475    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-plugins-config-volume\") pod \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\" (UID: \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\") "
Jul 27 19:37:19.346668 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.346545    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stggb\" (UniqueName: \"kubernetes.io/projected/57a5392d-00a8-4fe2-8c40-e296f0a749b7-kube-api-access-stggb\") pod \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\" (UID: \"57a5392d-00a8-4fe2-8c40-e296f0a749b7\") "
Jul 27 19:37:19.346723 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.346691    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb2dg\" (UniqueName: \"kubernetes.io/projected/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-kube-api-access-gb2dg\") pod \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\" (UID: \"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4\") "
Jul 27 19:37:19.346955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.346924    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57a5392d-00a8-4fe2-8c40-e296f0a749b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57a5392d-00a8-4fe2-8c40-e296f0a749b7" (UID: "57a5392d-00a8-4fe2-8c40-e296f0a749b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:37:19.347030 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.346924    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48e0fa2f-bbc2-44ef-a311-5ebf3da238c4" (UID: "48e0fa2f-bbc2-44ef-a311-5ebf3da238c4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:37:19.347068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.347055    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57a5392d-00a8-4fe2-8c40-e296f0a749b7-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:37:19.348824 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.348793    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a5392d-00a8-4fe2-8c40-e296f0a749b7-kube-api-access-stggb" (OuterVolumeSpecName: "kube-api-access-stggb") pod "57a5392d-00a8-4fe2-8c40-e296f0a749b7" (UID: "57a5392d-00a8-4fe2-8c40-e296f0a749b7"). InnerVolumeSpecName "kube-api-access-stggb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:37:19.348920 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.348840    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-kube-api-access-gb2dg" (OuterVolumeSpecName: "kube-api-access-gb2dg") pod "48e0fa2f-bbc2-44ef-a311-5ebf3da238c4" (UID: "48e0fa2f-bbc2-44ef-a311-5ebf3da238c4"). InnerVolumeSpecName "kube-api-access-gb2dg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:37:19.448121 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.448046    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stggb\" (UniqueName: \"kubernetes.io/projected/57a5392d-00a8-4fe2-8c40-e296f0a749b7-kube-api-access-stggb\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:37:19.448121 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.448072    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb2dg\" (UniqueName: \"kubernetes.io/projected/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-kube-api-access-gb2dg\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:37:19.448121 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.448083    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:37:19.791667 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:19.791585    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92c5de2-7130-4526-8371-2266e27cd304" path="/var/lib/kubelet/pods/f92c5de2-7130-4526-8371-2266e27cd304/volumes"
Jul 27 19:37:20.171217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.171125    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"
Jul 27 19:37:20.171217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.171166    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl" event={"ID":"57a5392d-00a8-4fe2-8c40-e296f0a749b7","Type":"ContainerDied","Data":"590ff7566055c628b28bdd280d73365b78fccb2b78e39b63991a13bd5e64e5ee"}
Jul 27 19:37:20.171722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.171240    2557 scope.go:117] "RemoveContainer" containerID="f0b4d26fddb8752b9444db2218f4623170b84225e696a43ca26ae3edf30e7480"
Jul 27 19:37:20.172727 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.172533    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"
Jul 27 19:37:20.172727 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.172576    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4" event={"ID":"48e0fa2f-bbc2-44ef-a311-5ebf3da238c4","Type":"ContainerDied","Data":"e0904c11fd165c8fb7b01511a7b5fb8f007ebba5f70905bfa2e5b8c440717139"}
Jul 27 19:37:20.181354 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.181338    2557 scope.go:117] "RemoveContainer" containerID="80dbcd1c0d3bf00679eb111b8e299e140276f5a403cebce1c2db287d57decbfd"
Jul 27 19:37:20.189370 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.189345    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"]
Jul 27 19:37:20.193232 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.193214    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c581614e-b8f78cc64-q6gnl"]
Jul 27 19:37:20.205967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.205948    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"]
Jul 27 19:37:20.208840 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:20.208823    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c581614e-9d6979546-n7vx4"]
Jul 27 19:37:21.764376 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:21.764339    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:37:21.790605 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:21.790573    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e0fa2f-bbc2-44ef-a311-5ebf3da238c4" path="/var/lib/kubelet/pods/48e0fa2f-bbc2-44ef-a311-5ebf3da238c4/volumes"
Jul 27 19:37:21.790947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:21.790926    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57a5392d-00a8-4fe2-8c40-e296f0a749b7" path="/var/lib/kubelet/pods/57a5392d-00a8-4fe2-8c40-e296f0a749b7/volumes"
Jul 27 19:37:48.866270 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.866235    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"]
Jul 27 19:37:48.868091 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868066    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a5392d-00a8-4fe2-8c40-e296f0a749b7" containerName="payload-pre-processing"
Jul 27 19:37:48.868252 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868241    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a5392d-00a8-4fe2-8c40-e296f0a749b7" containerName="payload-pre-processing"
Jul 27 19:37:48.868341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868332    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e0fa2f-bbc2-44ef-a311-5ebf3da238c4" containerName="payload-processing"
Jul 27 19:37:48.868412 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868404    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e0fa2f-bbc2-44ef-a311-5ebf3da238c4" containerName="payload-processing"
Jul 27 19:37:48.868504 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868496    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92c5de2-7130-4526-8371-2266e27cd304" containerName="revoke-keys"
Jul 27 19:37:48.868572 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868563    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92c5de2-7130-4526-8371-2266e27cd304" containerName="revoke-keys"
Jul 27 19:37:48.868759 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868748    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e0fa2f-bbc2-44ef-a311-5ebf3da238c4" containerName="payload-processing"
Jul 27 19:37:48.868849 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868838    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="57a5392d-00a8-4fe2-8c40-e296f0a749b7" containerName="payload-pre-processing"
Jul 27 19:37:48.868917 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.868855    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92c5de2-7130-4526-8371-2266e27cd304" containerName="revoke-keys"
Jul 27 19:37:48.872450 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.872431    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:48.874735 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.874715    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t9v8k\""
Jul 27 19:37:48.874989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.874966    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-76809045-serving-cert\""
Jul 27 19:37:48.881147 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.881124    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"]
Jul 27 19:37:48.918715 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.918684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvtj\" (UniqueName: \"kubernetes.io/projected/ef706f16-734d-4673-8d14-c865ec71e795-kube-api-access-fbvtj\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:48.918903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.918746    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef706f16-734d-4673-8d14-c865ec71e795-maas-api-tls\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:48.918903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:48.918862    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef706f16-734d-4673-8d14-c865ec71e795-openshift-service-ca\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:49.020262 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.020223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvtj\" (UniqueName: \"kubernetes.io/projected/ef706f16-734d-4673-8d14-c865ec71e795-kube-api-access-fbvtj\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:49.020455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.020317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef706f16-734d-4673-8d14-c865ec71e795-maas-api-tls\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:49.020455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.020369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef706f16-734d-4673-8d14-c865ec71e795-openshift-service-ca\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:49.021298 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.021271    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef706f16-734d-4673-8d14-c865ec71e795-openshift-service-ca\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:49.023429 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.023405    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef706f16-734d-4673-8d14-c865ec71e795-maas-api-tls\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:49.031665 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.031644    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvtj\" (UniqueName: \"kubernetes.io/projected/ef706f16-734d-4673-8d14-c865ec71e795-kube-api-access-fbvtj\") pod \"maas-api-e2e-mt-76809045-645fb4b94b-mr2g4\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:49.184196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.184168    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:49.340531 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:37:49.340497    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef706f16_734d_4673_8d14_c865ec71e795.slice/crio-2374b6e14ac611fa0c0389a64b170d48510b6615ebf3d99920ad268724746055 WatchSource:0}: Error finding container 2374b6e14ac611fa0c0389a64b170d48510b6615ebf3d99920ad268724746055: Status 404 returned error can't find the container with id 2374b6e14ac611fa0c0389a64b170d48510b6615ebf3d99920ad268724746055
Jul 27 19:37:49.340531 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.340526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"]
Jul 27 19:37:49.342510 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.342493    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:37:49.354212 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.354182    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4" event={"ID":"ef706f16-734d-4673-8d14-c865ec71e795","Type":"ContainerStarted","Data":"2374b6e14ac611fa0c0389a64b170d48510b6615ebf3d99920ad268724746055"}
Jul 27 19:37:49.496538 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.496455    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"]
Jul 27 19:37:49.501338 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.501316    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:49.505359 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.505337    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-76809045\""
Jul 27 19:37:49.516615 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.516593    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"]
Jul 27 19:37:49.520077 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.520055    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"]
Jul 27 19:37:49.523661 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.523641    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:49.526855 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.526835    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-76809045-dockercfg-6fpm8\""
Jul 27 19:37:49.541161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.541138    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"]
Jul 27 19:37:49.626026 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.625992    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-plugins-config-volume\") pod \"payload-processing-e2e-mt-76809045-548f695c94-bws5g\" (UID: \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\") " pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:49.626225 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.626045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xgvx\" (UniqueName: \"kubernetes.io/projected/97cf2d9c-0bad-4ed0-807a-9c808c430668-kube-api-access-7xgvx\") pod \"payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz\" (UID: \"97cf2d9c-0bad-4ed0-807a-9c808c430668\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:49.626225 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.626143    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgz8p\" (UniqueName: \"kubernetes.io/projected/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-kube-api-access-fgz8p\") pod \"payload-processing-e2e-mt-76809045-548f695c94-bws5g\" (UID: \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\") " pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:49.626225 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.626188    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97cf2d9c-0bad-4ed0-807a-9c808c430668-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz\" (UID: \"97cf2d9c-0bad-4ed0-807a-9c808c430668\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:49.727371 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.727331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-plugins-config-volume\") pod \"payload-processing-e2e-mt-76809045-548f695c94-bws5g\" (UID: \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\") " pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:49.727371 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.727375    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xgvx\" (UniqueName: \"kubernetes.io/projected/97cf2d9c-0bad-4ed0-807a-9c808c430668-kube-api-access-7xgvx\") pod \"payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz\" (UID: \"97cf2d9c-0bad-4ed0-807a-9c808c430668\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:49.727613 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.727425    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgz8p\" (UniqueName: \"kubernetes.io/projected/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-kube-api-access-fgz8p\") pod \"payload-processing-e2e-mt-76809045-548f695c94-bws5g\" (UID: \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\") " pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:49.727613 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.727452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97cf2d9c-0bad-4ed0-807a-9c808c430668-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz\" (UID: \"97cf2d9c-0bad-4ed0-807a-9c808c430668\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:49.728065 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.728045    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-plugins-config-volume\") pod \"payload-processing-e2e-mt-76809045-548f695c94-bws5g\" (UID: \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\") " pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:49.728169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.728153    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97cf2d9c-0bad-4ed0-807a-9c808c430668-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz\" (UID: \"97cf2d9c-0bad-4ed0-807a-9c808c430668\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:49.737518 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.737494    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xgvx\" (UniqueName: \"kubernetes.io/projected/97cf2d9c-0bad-4ed0-807a-9c808c430668-kube-api-access-7xgvx\") pod \"payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz\" (UID: \"97cf2d9c-0bad-4ed0-807a-9c808c430668\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:49.737618 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.737503    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgz8p\" (UniqueName: \"kubernetes.io/projected/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-kube-api-access-fgz8p\") pod \"payload-processing-e2e-mt-76809045-548f695c94-bws5g\" (UID: \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\") " pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:49.812742 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.812716    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:49.834783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:49.834761    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:50.167413 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.167386    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"]
Jul 27 19:37:50.167725 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:37:50.167634    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97cf2d9c_0bad_4ed0_807a_9c808c430668.slice/crio-9764d50ec6e8a1a2ed5cdcbc00d803f21b6010e0a4c6e1568f4c7a4039b212d6 WatchSource:0}: Error finding container 9764d50ec6e8a1a2ed5cdcbc00d803f21b6010e0a4c6e1568f4c7a4039b212d6: Status 404 returned error can't find the container with id 9764d50ec6e8a1a2ed5cdcbc00d803f21b6010e0a4c6e1568f4c7a4039b212d6
Jul 27 19:37:50.203306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.203281    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"]
Jul 27 19:37:50.208091 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:37:50.208066    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd4365d_fde7_46c2_9a13_6f99dd3b179c.slice/crio-bb29341eea4a16cf769df4c70677743568045dcba8237b23d5ac16fa8b7a5477 WatchSource:0}: Error finding container bb29341eea4a16cf769df4c70677743568045dcba8237b23d5ac16fa8b7a5477: Status 404 returned error can't find the container with id bb29341eea4a16cf769df4c70677743568045dcba8237b23d5ac16fa8b7a5477
Jul 27 19:37:50.361271 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.361234    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz" event={"ID":"97cf2d9c-0bad-4ed0-807a-9c808c430668","Type":"ContainerStarted","Data":"148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053"}
Jul 27 19:37:50.361466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.361302    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:37:50.361466 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.361330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz" event={"ID":"97cf2d9c-0bad-4ed0-807a-9c808c430668","Type":"ContainerStarted","Data":"9764d50ec6e8a1a2ed5cdcbc00d803f21b6010e0a4c6e1568f4c7a4039b212d6"}
Jul 27 19:37:50.362967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.362944    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4" event={"ID":"ef706f16-734d-4673-8d14-c865ec71e795","Type":"ContainerStarted","Data":"a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b"}
Jul 27 19:37:50.363097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.363027    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:37:50.364554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.364517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g" event={"ID":"4bd4365d-fde7-46c2-9a13-6f99dd3b179c","Type":"ContainerStarted","Data":"a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30"}
Jul 27 19:37:50.364684 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.364562    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g" event={"ID":"4bd4365d-fde7-46c2-9a13-6f99dd3b179c","Type":"ContainerStarted","Data":"bb29341eea4a16cf769df4c70677743568045dcba8237b23d5ac16fa8b7a5477"}
Jul 27 19:37:50.364684 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.364584    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:37:50.379976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.379933    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz" podStartSLOduration=1.379920737 podStartE2EDuration="1.379920737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:37:50.377497946 +0000 UTC m=+1957.084637449" watchObservedRunningTime="2026-07-27 19:37:50.379920737 +0000 UTC m=+1957.087060228"
Jul 27 19:37:50.397426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.397372    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4" podStartSLOduration=1.968442225 podStartE2EDuration="2.397357965s" totalImagesPullingTime="428.91574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:37:50.394828871 +0000 UTC m=+1957.101968358" watchObservedRunningTime="2026-07-27 19:37:50.397357965 +0000 UTC m=+1957.104497456"
Jul 27 19:37:50.415299 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:50.415211    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g" podStartSLOduration=1.415198364 podStartE2EDuration="1.415198364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:37:50.41349699 +0000 UTC m=+1957.120636483" watchObservedRunningTime="2026-07-27 19:37:50.415198364 +0000 UTC m=+1957.122337855"
Jul 27 19:37:55.257936 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:55.257900    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:37:56.376994 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:37:56.376962    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:38:01.373480 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:01.373444    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:38:01.373979 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:01.373768    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:38:03.856524 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:03.856488    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:38:17.860195 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:17.860166    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:38:22.699582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:22.699542    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"]
Jul 27 19:38:22.704279 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:22.704254    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"
Jul 27 19:38:22.707332 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:22.707314    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:38:22.711588 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:22.711562    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"]
Jul 27 19:38:22.762593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:22.762563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-76809045-xc8p8\" (UID: \"be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"
Jul 27 19:38:22.863395 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:22.863357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-76809045-xc8p8\" (UID: \"be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"
Jul 27 19:38:22.864097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:22.864077    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-76809045-xc8p8\" (UID: \"be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"
Jul 27 19:38:23.018199 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:23.018121    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"
Jul 27 19:38:23.365787 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:23.365756    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"]
Jul 27 19:38:23.366284 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:38:23.366255    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5c3d79_b79a_4d61_b4bb_4ee11e8d54c7.slice/crio-e93292f1b56d37544485f6e6b18c9a65319c1388bfe4a84d47057cc29a7272fe WatchSource:0}: Error finding container e93292f1b56d37544485f6e6b18c9a65319c1388bfe4a84d47057cc29a7272fe: Status 404 returned error can't find the container with id e93292f1b56d37544485f6e6b18c9a65319c1388bfe4a84d47057cc29a7272fe
Jul 27 19:38:23.567346 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:23.567311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8" event={"ID":"be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7","Type":"ContainerStarted","Data":"e93292f1b56d37544485f6e6b18c9a65319c1388bfe4a84d47057cc29a7272fe"}
Jul 27 19:38:24.574437 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:24.574402    2557 generic.go:356] "Generic (PLEG): container finished" podID="be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7" containerID="263a19e42c5d10dd486d9ef52fcef01629ded2a0ff234e30773d2ff2f7dad4d4" exitCode=0
Jul 27 19:38:24.574859 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:24.574499    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8" event={"ID":"be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7","Type":"ContainerDied","Data":"263a19e42c5d10dd486d9ef52fcef01629ded2a0ff234e30773d2ff2f7dad4d4"}
Jul 27 19:38:25.727016 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:25.726991    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"
Jul 27 19:38:25.791195 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:25.791165    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7-maas-api-service-ca\") pod \"be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7\" (UID: \"be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7\") "
Jul 27 19:38:25.791541 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:25.791519    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7" (UID: "be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:38:25.892984 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:25.892899    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:38:26.588559 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:26.588529    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"
Jul 27 19:38:26.588723 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:26.588577    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8" event={"ID":"be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7","Type":"ContainerDied","Data":"e93292f1b56d37544485f6e6b18c9a65319c1388bfe4a84d47057cc29a7272fe"}
Jul 27 19:38:26.588723 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:26.588633    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e93292f1b56d37544485f6e6b18c9a65319c1388bfe4a84d47057cc29a7272fe"
Jul 27 19:38:36.858700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:36.858668    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:38:38.292685 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.292651    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"]
Jul 27 19:38:38.293543 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.293508    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4" podUID="ef706f16-734d-4673-8d14-c865ec71e795" containerName="maas-api" containerID="cri-o://a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b" gracePeriod=30
Jul 27 19:38:38.348670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.348642    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"]
Jul 27 19:38:38.348909 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.348886    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g" podUID="4bd4365d-fde7-46c2-9a13-6f99dd3b179c" containerName="payload-processing" containerID="cri-o://a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30" gracePeriod=30
Jul 27 19:38:38.353659 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.353336    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"]
Jul 27 19:38:38.353659 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.353532    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz" podUID="97cf2d9c-0bad-4ed0-807a-9c808c430668" containerName="payload-pre-processing" containerID="cri-o://148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053" gracePeriod=30
Jul 27 19:38:38.495931 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.495875    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"]
Jul 27 19:38:38.501720 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.501661    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-76809045-xc8p8"]
Jul 27 19:38:38.632125 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.632100    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:38:38.663976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.663952    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:38:38.667420 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.667399    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:38:38.671147 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.671122    2557 generic.go:356] "Generic (PLEG): container finished" podID="97cf2d9c-0bad-4ed0-807a-9c808c430668" containerID="148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053" exitCode=0
Jul 27 19:38:38.671243 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.671153    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"
Jul 27 19:38:38.671243 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.671206    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz" event={"ID":"97cf2d9c-0bad-4ed0-807a-9c808c430668","Type":"ContainerDied","Data":"148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053"}
Jul 27 19:38:38.671376 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.671262    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz" event={"ID":"97cf2d9c-0bad-4ed0-807a-9c808c430668","Type":"ContainerDied","Data":"9764d50ec6e8a1a2ed5cdcbc00d803f21b6010e0a4c6e1568f4c7a4039b212d6"}
Jul 27 19:38:38.671376 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.671296    2557 scope.go:117] "RemoveContainer" containerID="148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053"
Jul 27 19:38:38.672589 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.672570    2557 generic.go:356] "Generic (PLEG): container finished" podID="ef706f16-734d-4673-8d14-c865ec71e795" containerID="a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b" exitCode=0
Jul 27 19:38:38.672694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.672608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4" event={"ID":"ef706f16-734d-4673-8d14-c865ec71e795","Type":"ContainerDied","Data":"a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b"}
Jul 27 19:38:38.672694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.672625    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"
Jul 27 19:38:38.672694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.672644    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4" event={"ID":"ef706f16-734d-4673-8d14-c865ec71e795","Type":"ContainerDied","Data":"2374b6e14ac611fa0c0389a64b170d48510b6615ebf3d99920ad268724746055"}
Jul 27 19:38:38.674073 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.674051    2557 generic.go:356] "Generic (PLEG): container finished" podID="4bd4365d-fde7-46c2-9a13-6f99dd3b179c" containerID="a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30" exitCode=0
Jul 27 19:38:38.674172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.674087    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"
Jul 27 19:38:38.674172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.674104    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g" event={"ID":"4bd4365d-fde7-46c2-9a13-6f99dd3b179c","Type":"ContainerDied","Data":"a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30"}
Jul 27 19:38:38.674172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.674142    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g" event={"ID":"4bd4365d-fde7-46c2-9a13-6f99dd3b179c","Type":"ContainerDied","Data":"bb29341eea4a16cf769df4c70677743568045dcba8237b23d5ac16fa8b7a5477"}
Jul 27 19:38:38.681453 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.681426    2557 scope.go:117] "RemoveContainer" containerID="148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053"
Jul 27 19:38:38.682074 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:38:38.681940    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053\": container with ID starting with 148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053 not found: ID does not exist" containerID="148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053"
Jul 27 19:38:38.682074 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.681975    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053"} err="failed to get container status \"148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053\": rpc error: code = NotFound desc = could not find container \"148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053\": container with ID starting with 148f6b6c4c232b4b3f05c8bfbdbd204b07c22e16864e6332bc58f0ded1535053 not found: ID does not exist"
Jul 27 19:38:38.682074 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.681997    2557 scope.go:117] "RemoveContainer" containerID="a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b"
Jul 27 19:38:38.693337 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.693323    2557 scope.go:117] "RemoveContainer" containerID="a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b"
Jul 27 19:38:38.693571 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:38:38.693554    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b\": container with ID starting with a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b not found: ID does not exist" containerID="a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b"
Jul 27 19:38:38.693646 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.693581    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b"} err="failed to get container status \"a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b\": rpc error: code = NotFound desc = could not find container \"a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b\": container with ID starting with a60be6a4965163e31cc5ce895022b69d03bf2537e3d9f0a6c66a59a15d78437b not found: ID does not exist"
Jul 27 19:38:38.693646 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.693603    2557 scope.go:117] "RemoveContainer" containerID="a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30"
Jul 27 19:38:38.702052 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.702029    2557 scope.go:117] "RemoveContainer" containerID="a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30"
Jul 27 19:38:38.702287 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:38:38.702271    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30\": container with ID starting with a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30 not found: ID does not exist" containerID="a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30"
Jul 27 19:38:38.702357 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.702293    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30"} err="failed to get container status \"a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30\": rpc error: code = NotFound desc = could not find container \"a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30\": container with ID starting with a64574999911f5944fbd40836b537e0e8b8c1af7effb5008f801421333f82d30 not found: ID does not exist"
Jul 27 19:38:38.813972 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.813900    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xgvx\" (UniqueName: \"kubernetes.io/projected/97cf2d9c-0bad-4ed0-807a-9c808c430668-kube-api-access-7xgvx\") pod \"97cf2d9c-0bad-4ed0-807a-9c808c430668\" (UID: \"97cf2d9c-0bad-4ed0-807a-9c808c430668\") "
Jul 27 19:38:38.813972 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.813934    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgz8p\" (UniqueName: \"kubernetes.io/projected/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-kube-api-access-fgz8p\") pod \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\" (UID: \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\") "
Jul 27 19:38:38.814142 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.813981    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbvtj\" (UniqueName: \"kubernetes.io/projected/ef706f16-734d-4673-8d14-c865ec71e795-kube-api-access-fbvtj\") pod \"ef706f16-734d-4673-8d14-c865ec71e795\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") "
Jul 27 19:38:38.814142 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.814016    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef706f16-734d-4673-8d14-c865ec71e795-maas-api-tls\") pod \"ef706f16-734d-4673-8d14-c865ec71e795\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") "
Jul 27 19:38:38.814142 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.814071    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-plugins-config-volume\") pod \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\" (UID: \"4bd4365d-fde7-46c2-9a13-6f99dd3b179c\") "
Jul 27 19:38:38.814142 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.814112    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97cf2d9c-0bad-4ed0-807a-9c808c430668-plugins-config-volume\") pod \"97cf2d9c-0bad-4ed0-807a-9c808c430668\" (UID: \"97cf2d9c-0bad-4ed0-807a-9c808c430668\") "
Jul 27 19:38:38.814347 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.814164    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef706f16-734d-4673-8d14-c865ec71e795-openshift-service-ca\") pod \"ef706f16-734d-4673-8d14-c865ec71e795\" (UID: \"ef706f16-734d-4673-8d14-c865ec71e795\") "
Jul 27 19:38:38.814781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.814527    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4bd4365d-fde7-46c2-9a13-6f99dd3b179c" (UID: "4bd4365d-fde7-46c2-9a13-6f99dd3b179c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:38:38.814781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.814553    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97cf2d9c-0bad-4ed0-807a-9c808c430668-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97cf2d9c-0bad-4ed0-807a-9c808c430668" (UID: "97cf2d9c-0bad-4ed0-807a-9c808c430668"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:38:38.814781 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.814766    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef706f16-734d-4673-8d14-c865ec71e795-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef706f16-734d-4673-8d14-c865ec71e795" (UID: "ef706f16-734d-4673-8d14-c865ec71e795"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:38:38.816290 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.816270    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-kube-api-access-fgz8p" (OuterVolumeSpecName: "kube-api-access-fgz8p") pod "4bd4365d-fde7-46c2-9a13-6f99dd3b179c" (UID: "4bd4365d-fde7-46c2-9a13-6f99dd3b179c"). InnerVolumeSpecName "kube-api-access-fgz8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:38:38.816290 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.816277    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97cf2d9c-0bad-4ed0-807a-9c808c430668-kube-api-access-7xgvx" (OuterVolumeSpecName: "kube-api-access-7xgvx") pod "97cf2d9c-0bad-4ed0-807a-9c808c430668" (UID: "97cf2d9c-0bad-4ed0-807a-9c808c430668"). InnerVolumeSpecName "kube-api-access-7xgvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:38:38.816715 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.816699    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef706f16-734d-4673-8d14-c865ec71e795-kube-api-access-fbvtj" (OuterVolumeSpecName: "kube-api-access-fbvtj") pod "ef706f16-734d-4673-8d14-c865ec71e795" (UID: "ef706f16-734d-4673-8d14-c865ec71e795"). InnerVolumeSpecName "kube-api-access-fbvtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:38:38.816715 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.816704    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef706f16-734d-4673-8d14-c865ec71e795-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef706f16-734d-4673-8d14-c865ec71e795" (UID: "ef706f16-734d-4673-8d14-c865ec71e795"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:38:38.915443 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.915415    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xgvx\" (UniqueName: \"kubernetes.io/projected/97cf2d9c-0bad-4ed0-807a-9c808c430668-kube-api-access-7xgvx\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:38:38.915443 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.915438    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgz8p\" (UniqueName: \"kubernetes.io/projected/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-kube-api-access-fgz8p\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:38:38.915443 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.915449    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbvtj\" (UniqueName: \"kubernetes.io/projected/ef706f16-734d-4673-8d14-c865ec71e795-kube-api-access-fbvtj\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:38:38.915624 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.915458    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef706f16-734d-4673-8d14-c865ec71e795-maas-api-tls\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:38:38.915624 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.915467    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bd4365d-fde7-46c2-9a13-6f99dd3b179c-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:38:38.915624 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.915476    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97cf2d9c-0bad-4ed0-807a-9c808c430668-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:38:38.915624 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.915484    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef706f16-734d-4673-8d14-c865ec71e795-openshift-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:38:39.000008 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:38.999984    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"]
Jul 27 19:38:39.003978 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.003954    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-76809045-f8f56ddb4-vqwdz"]
Jul 27 19:38:39.013247 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.013227    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"]
Jul 27 19:38:39.017380 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.017362    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-76809045-548f695c94-bws5g"]
Jul 27 19:38:39.026563 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.026545    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"]
Jul 27 19:38:39.032389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.032371    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-76809045-645fb4b94b-mr2g4"]
Jul 27 19:38:39.791680 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.791643    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd4365d-fde7-46c2-9a13-6f99dd3b179c" path="/var/lib/kubelet/pods/4bd4365d-fde7-46c2-9a13-6f99dd3b179c/volumes"
Jul 27 19:38:39.792069 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.792053    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97cf2d9c-0bad-4ed0-807a-9c808c430668" path="/var/lib/kubelet/pods/97cf2d9c-0bad-4ed0-807a-9c808c430668/volumes"
Jul 27 19:38:39.792348 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.792336    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7" path="/var/lib/kubelet/pods/be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7/volumes"
Jul 27 19:38:39.792673 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:39.792661    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef706f16-734d-4673-8d14-c865ec71e795" path="/var/lib/kubelet/pods/ef706f16-734d-4673-8d14-c865ec71e795/volumes"
Jul 27 19:38:45.353164 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:38:45.353127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:39:14.620881 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:39:14.620854    2557 scope.go:117] "RemoveContainer" containerID="813d2f5328ddde3dae882130fc538175fc96f08d9bc8db1f28f9c4dc6d63ab16"
Jul 27 19:39:34.468745 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:39:34.468665    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:39:46.488345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:39:46.488306    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:40:13.931925 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:13.931898    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:40:13.937310 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:13.937288    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:40:13.940391 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:13.940372    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:40:13.945458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:13.945443    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:40:14.657170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:14.657135    2557 scope.go:117] "RemoveContainer" containerID="86383723e1078df9ab2cdf114f97a8925e9f333d17528d1462de38ad0a5506b4"
Jul 27 19:40:28.941343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941311    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"]
Jul 27 19:40:28.941777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941720    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef706f16-734d-4673-8d14-c865ec71e795" containerName="maas-api"
Jul 27 19:40:28.941777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941731    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef706f16-734d-4673-8d14-c865ec71e795" containerName="maas-api"
Jul 27 19:40:28.941777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941746    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97cf2d9c-0bad-4ed0-807a-9c808c430668" containerName="payload-pre-processing"
Jul 27 19:40:28.941777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941751    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="97cf2d9c-0bad-4ed0-807a-9c808c430668" containerName="payload-pre-processing"
Jul 27 19:40:28.941777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941771    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7" containerName="revoke-keys"
Jul 27 19:40:28.941777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941777    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7" containerName="revoke-keys"
Jul 27 19:40:28.941997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941784    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd4365d-fde7-46c2-9a13-6f99dd3b179c" containerName="payload-processing"
Jul 27 19:40:28.941997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941790    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd4365d-fde7-46c2-9a13-6f99dd3b179c" containerName="payload-processing"
Jul 27 19:40:28.941997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941874    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd4365d-fde7-46c2-9a13-6f99dd3b179c" containerName="payload-processing"
Jul 27 19:40:28.941997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941884    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="97cf2d9c-0bad-4ed0-807a-9c808c430668" containerName="payload-pre-processing"
Jul 27 19:40:28.941997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941892    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="be5c3d79-b79a-4d61-b4bb-4ee11e8d54c7" containerName="revoke-keys"
Jul 27 19:40:28.941997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.941901    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef706f16-734d-4673-8d14-c865ec71e795" containerName="maas-api"
Jul 27 19:40:28.945244 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.945226    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:28.948006 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.947986    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-35bf7c-openshift-default-dockercfg-7jfrv\""
Jul 27 19:40:28.957555 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:28.957533    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"]
Jul 27 19:40:29.038574 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.038544    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-token\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.038775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.038577    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gfbz\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-kube-api-access-8gfbz\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.038775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.038634    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-credential-socket\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.038775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.038655    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-podinfo\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.039023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.038760    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-certs\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.039023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.038879    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-data\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.039023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.038931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istiod-ca-cert\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.039023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.038985    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-envoy\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.039023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.039013    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-socket\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.139491 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-certs\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.139676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139511    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-data\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.139676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istiod-ca-cert\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.139676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139594    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-envoy\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.139887 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-socket\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.139887 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-token\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.139887 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139866    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gfbz\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-kube-api-access-8gfbz\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.140058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139911    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-certs\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.140058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-credential-socket\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.140058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139961    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-data\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.140058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.139967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-podinfo\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.140263 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.140079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-socket\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.140263 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.140151    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-credential-socket\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.140541 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.140323    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istiod-ca-cert\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.142006 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.141977    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-envoy\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.142392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.142376    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-podinfo\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.148220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.148199    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-token\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.148435 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.148414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gfbz\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-kube-api-access-8gfbz\") pod \"e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") " pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.257067 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.256984    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:29.403623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.403591    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"]
Jul 27 19:40:29.403778 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:40:29.403755    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bfa05c_3fb2_4c4d_83bc_da0e941799ec.slice/crio-8df4d6f366af8c57446e5f83e1959f7fd18aa947e3a8342286c669dd808cb284 WatchSource:0}: Error finding container 8df4d6f366af8c57446e5f83e1959f7fd18aa947e3a8342286c669dd808cb284: Status 404 returned error can't find the container with id 8df4d6f366af8c57446e5f83e1959f7fd18aa947e3a8342286c669dd808cb284
Jul 27 19:40:29.405730 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.405697    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:29.405847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.405785    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:29.405923 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:29.405853    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:30.359091 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:30.359053    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" event={"ID":"84bfa05c-3fb2-4c4d-83bc-da0e941799ec","Type":"ContainerStarted","Data":"dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1"}
Jul 27 19:40:30.359486 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:30.359122    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" event={"ID":"84bfa05c-3fb2-4c4d-83bc-da0e941799ec","Type":"ContainerStarted","Data":"8df4d6f366af8c57446e5f83e1959f7fd18aa947e3a8342286c669dd808cb284"}
Jul 27 19:40:30.381872 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:30.381830    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" podStartSLOduration=2.38176819 podStartE2EDuration="2.38176819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:30.380612128 +0000 UTC m=+2117.087751619" watchObservedRunningTime="2026-07-27 19:40:30.38176819 +0000 UTC m=+2117.088907681"
Jul 27 19:40:31.258105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:31.258068    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:31.262723 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:31.262692    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:31.365242 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:31.365212    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:31.366191 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:31.366173    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:33.184735 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.184701    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"]
Jul 27 19:40:33.188454 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.188430    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:33.190868 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.190848    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-35bf7c\""
Jul 27 19:40:33.190980 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.190963    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-35bf7c-dockercfg-lt6h9\""
Jul 27 19:40:33.203046 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.203024    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"]
Jul 27 19:40:33.224670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.224640    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"]
Jul 27 19:40:33.228167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.228150    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:33.233694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.233660    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"]
Jul 27 19:40:33.275264 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.275228    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6\" (UID: \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:33.275422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.275293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkh6b\" (UniqueName: \"kubernetes.io/projected/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-kube-api-access-zkh6b\") pod \"payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6\" (UID: \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:33.376433 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.376403    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6\" (UID: \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:33.376623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.376448    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh4g9\" (UniqueName: \"kubernetes.io/projected/ed777f27-744c-4036-8f89-5a7afa568f60-kube-api-access-nh4g9\") pod \"payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q\" (UID: \"ed777f27-744c-4036-8f89-5a7afa568f60\") " pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:33.376623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.376483    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkh6b\" (UniqueName: \"kubernetes.io/projected/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-kube-api-access-zkh6b\") pod \"payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6\" (UID: \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:33.376623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.376596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed777f27-744c-4036-8f89-5a7afa568f60-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q\" (UID: \"ed777f27-744c-4036-8f89-5a7afa568f60\") " pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:33.377227 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.377210    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6\" (UID: \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:33.389063 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.389039    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkh6b\" (UniqueName: \"kubernetes.io/projected/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-kube-api-access-zkh6b\") pod \"payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6\" (UID: \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:33.477469 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.477392    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh4g9\" (UniqueName: \"kubernetes.io/projected/ed777f27-744c-4036-8f89-5a7afa568f60-kube-api-access-nh4g9\") pod \"payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q\" (UID: \"ed777f27-744c-4036-8f89-5a7afa568f60\") " pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:33.477469 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.477445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed777f27-744c-4036-8f89-5a7afa568f60-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q\" (UID: \"ed777f27-744c-4036-8f89-5a7afa568f60\") " pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:33.478211 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.478186    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed777f27-744c-4036-8f89-5a7afa568f60-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q\" (UID: \"ed777f27-744c-4036-8f89-5a7afa568f60\") " pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:33.485569 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.485547    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh4g9\" (UniqueName: \"kubernetes.io/projected/ed777f27-744c-4036-8f89-5a7afa568f60-kube-api-access-nh4g9\") pod \"payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q\" (UID: \"ed777f27-744c-4036-8f89-5a7afa568f60\") " pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:33.500233 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.500210    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:33.539355 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.539324    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:33.676109 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.676083    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"]
Jul 27 19:40:33.677624 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:40:33.677599    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dcbb4e1_be0f_42b0_9cb5_6c3032b4f92d.slice/crio-2292e80e645bdf81bb70b80e6d7ae7ed76aa3d2bdbefe5dcbfcb853b777e410a WatchSource:0}: Error finding container 2292e80e645bdf81bb70b80e6d7ae7ed76aa3d2bdbefe5dcbfcb853b777e410a: Status 404 returned error can't find the container with id 2292e80e645bdf81bb70b80e6d7ae7ed76aa3d2bdbefe5dcbfcb853b777e410a
Jul 27 19:40:33.713413 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:40:33.713387    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded777f27_744c_4036_8f89_5a7afa568f60.slice/crio-4a52a53523bc07726ef68c1a515aa98ea98410891f80bedaa68acea6d32ea863 WatchSource:0}: Error finding container 4a52a53523bc07726ef68c1a515aa98ea98410891f80bedaa68acea6d32ea863: Status 404 returned error can't find the container with id 4a52a53523bc07726ef68c1a515aa98ea98410891f80bedaa68acea6d32ea863
Jul 27 19:40:33.713526 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:33.713452    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"]
Jul 27 19:40:34.388626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:34.388570    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6" event={"ID":"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d","Type":"ContainerStarted","Data":"8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1"}
Jul 27 19:40:34.389135 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:34.388677    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:34.389135 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:34.388702    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6" event={"ID":"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d","Type":"ContainerStarted","Data":"2292e80e645bdf81bb70b80e6d7ae7ed76aa3d2bdbefe5dcbfcb853b777e410a"}
Jul 27 19:40:34.390507 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:34.390469    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q" event={"ID":"ed777f27-744c-4036-8f89-5a7afa568f60","Type":"ContainerStarted","Data":"0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c"}
Jul 27 19:40:34.390636 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:34.390534    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:34.390636 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:34.390557    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q" event={"ID":"ed777f27-744c-4036-8f89-5a7afa568f60","Type":"ContainerStarted","Data":"4a52a53523bc07726ef68c1a515aa98ea98410891f80bedaa68acea6d32ea863"}
Jul 27 19:40:34.409943 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:34.409893    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6" podStartSLOduration=1.409879894 podStartE2EDuration="1.409879894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:34.406013914 +0000 UTC m=+2121.113153405" watchObservedRunningTime="2026-07-27 19:40:34.409879894 +0000 UTC m=+2121.117019385"
Jul 27 19:40:34.427255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:34.427215    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q" podStartSLOduration=1.427201246 podStartE2EDuration="1.427201246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:34.424351222 +0000 UTC m=+2121.131490714" watchObservedRunningTime="2026-07-27 19:40:34.427201246 +0000 UTC m=+2121.134340798"
Jul 27 19:40:37.468160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:37.468124    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:40:41.567730 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.567695    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"]
Jul 27 19:40:41.572517 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.572498    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:41.575418 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.575395    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d59e9c\""
Jul 27 19:40:41.594835 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.591863    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"]
Jul 27 19:40:41.622958 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.622920    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"]
Jul 27 19:40:41.627335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.627314    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:41.627903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.627499    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"]
Jul 27 19:40:41.630128 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.630106    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d59e9c-dockercfg-6r6wt\""
Jul 27 19:40:41.658304 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.658275    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv\" (UID: \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:41.658447 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.658339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2gr\" (UniqueName: \"kubernetes.io/projected/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-kube-api-access-nm2gr\") pod \"payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv\" (UID: \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:41.759768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.759731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fb6f9b8-2afd-4480-a142-6361e8b64109-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j\" (UID: \"3fb6f9b8-2afd-4480-a142-6361e8b64109\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:41.759768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.759767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ll6q\" (UniqueName: \"kubernetes.io/projected/3fb6f9b8-2afd-4480-a142-6361e8b64109-kube-api-access-4ll6q\") pod \"payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j\" (UID: \"3fb6f9b8-2afd-4480-a142-6361e8b64109\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:41.760073 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.759844    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv\" (UID: \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:41.760073 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.759957    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2gr\" (UniqueName: \"kubernetes.io/projected/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-kube-api-access-nm2gr\") pod \"payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv\" (UID: \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:41.760696 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.760675    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv\" (UID: \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:41.769112 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.769093    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2gr\" (UniqueName: \"kubernetes.io/projected/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-kube-api-access-nm2gr\") pod \"payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv\" (UID: \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:41.861580 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.861493    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fb6f9b8-2afd-4480-a142-6361e8b64109-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j\" (UID: \"3fb6f9b8-2afd-4480-a142-6361e8b64109\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:41.861580 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.861530    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ll6q\" (UniqueName: \"kubernetes.io/projected/3fb6f9b8-2afd-4480-a142-6361e8b64109-kube-api-access-4ll6q\") pod \"payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j\" (UID: \"3fb6f9b8-2afd-4480-a142-6361e8b64109\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:41.862241 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.862214    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fb6f9b8-2afd-4480-a142-6361e8b64109-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j\" (UID: \"3fb6f9b8-2afd-4480-a142-6361e8b64109\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:41.870058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.870031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ll6q\" (UniqueName: \"kubernetes.io/projected/3fb6f9b8-2afd-4480-a142-6361e8b64109-kube-api-access-4ll6q\") pod \"payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j\" (UID: \"3fb6f9b8-2afd-4480-a142-6361e8b64109\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:41.883981 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.883960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:41.940020 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:41.939934    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:42.108076 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.107411    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"]
Jul 27 19:40:42.366723 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.366695    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"]
Jul 27 19:40:42.367786 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:40:42.367761    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb6f9b8_2afd_4480_a142_6361e8b64109.slice/crio-76b730a431918f5ad073c6f3e80b4062ed20b2e4331ce0ee355745b56049fa07 WatchSource:0}: Error finding container 76b730a431918f5ad073c6f3e80b4062ed20b2e4331ce0ee355745b56049fa07: Status 404 returned error can't find the container with id 76b730a431918f5ad073c6f3e80b4062ed20b2e4331ce0ee355745b56049fa07
Jul 27 19:40:42.445883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.445840    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv" event={"ID":"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e","Type":"ContainerStarted","Data":"b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820"}
Jul 27 19:40:42.446029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.445905    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv" event={"ID":"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e","Type":"ContainerStarted","Data":"75f818a3f643d9cba678f526c32bcaf14a2fc59b54cd937a2f252320fb6a586e"}
Jul 27 19:40:42.446029 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.445947    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:42.452382 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.451459    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j" event={"ID":"3fb6f9b8-2afd-4480-a142-6361e8b64109","Type":"ContainerStarted","Data":"cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5"}
Jul 27 19:40:42.452382 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.451550    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j" event={"ID":"3fb6f9b8-2afd-4480-a142-6361e8b64109","Type":"ContainerStarted","Data":"76b730a431918f5ad073c6f3e80b4062ed20b2e4331ce0ee355745b56049fa07"}
Jul 27 19:40:42.452382 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.452156    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:40:42.463764 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.463711    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv" podStartSLOduration=1.463693905 podStartE2EDuration="1.463693905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:42.461755003 +0000 UTC m=+2129.168894495" watchObservedRunningTime="2026-07-27 19:40:42.463693905 +0000 UTC m=+2129.170833396"
Jul 27 19:40:42.478973 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:42.478923    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j" podStartSLOduration=1.4789099860000001 podStartE2EDuration="1.478909986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:42.477060139 +0000 UTC m=+2129.184199630" watchObservedRunningTime="2026-07-27 19:40:42.478909986 +0000 UTC m=+2129.186049477"
Jul 27 19:40:45.401724 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:45.401612    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:40:45.404226 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:45.401778    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:40:45.476272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:45.476237    2557 generic.go:356] "Generic (PLEG): container finished" podID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerID="dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1" exitCode=0
Jul 27 19:40:45.476389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:45.476290    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" event={"ID":"84bfa05c-3fb2-4c4d-83bc-da0e941799ec","Type":"ContainerDied","Data":"dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1"}
Jul 27 19:40:45.476760 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:45.476746    2557 scope.go:117] "RemoveContainer" containerID="dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1"
Jul 27 19:40:45.477927 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:45.477897    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:45.478052 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:45.477989    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:45.478126 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:45.478059    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:46.261373 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:46.261337    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:40:46.365928 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:46.365892    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:46.484419 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:46.484381    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" event={"ID":"84bfa05c-3fb2-4c4d-83bc-da0e941799ec","Type":"ContainerStarted","Data":"c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e"}
Jul 27 19:40:47.257744 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:47.257713    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:47.258957 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:47.258927    2557 patch_prober.go:28] interesting pod/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 27 19:40:47.259017 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:47.258984    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 27 19:40:48.258269 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:48.258234    2557 patch_prober.go:28] interesting pod/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 27 19:40:48.258666 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:48.258290    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 27 19:40:49.258174 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:49.258135    2557 patch_prober.go:28] interesting pod/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 27 19:40:49.258359 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:49.258190    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 27 19:40:50.269610 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:50.269579    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:50.270122 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:50.269926    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:50.270850 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:50.270797    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:40:53.461052 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:53.461022    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:40:53.461521 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:40:53.461098    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:41:03.865599 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:03.865559    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:41:14.682610 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:14.682579    2557 scope.go:117] "RemoveContainer" containerID="105b0d0a1312e97d76f69af931087d07eb72994f3cf797b41fb90509f40d1a0d"
Jul 27 19:41:14.691954 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:14.691931    2557 scope.go:117] "RemoveContainer" containerID="bbc9cc9c2c58f8455432914c219c191c448cd411fae3f11a65ccc90601fa85e5"
Jul 27 19:41:18.856313 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:18.856263    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:41:32.559339 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:32.559289    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:41:55.817627 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:55.817588    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"]
Jul 27 19:41:55.821491 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:55.821475    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"
Jul 27 19:41:55.824239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:55.824218    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:41:55.828859 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:55.828837    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"]
Jul 27 19:41:55.998916 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:55.998880    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66818d25-2974-4461-96bc-c83f88ea95ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786\" (UID: \"66818d25-2974-4461-96bc-c83f88ea95ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"
Jul 27 19:41:56.099749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:56.099672    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66818d25-2974-4461-96bc-c83f88ea95ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786\" (UID: \"66818d25-2974-4461-96bc-c83f88ea95ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"
Jul 27 19:41:56.100383 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:56.100363    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66818d25-2974-4461-96bc-c83f88ea95ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786\" (UID: \"66818d25-2974-4461-96bc-c83f88ea95ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"
Jul 27 19:41:56.135198 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:56.135170    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"
Jul 27 19:41:56.286599 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:56.286575    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"]
Jul 27 19:41:56.288857 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:41:56.288801    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66818d25_2974_4461_96bc_c83f88ea95ab.slice/crio-f764dd698271d5fa90d2d728fe5cd61923954cc8954fe3f392d344962eb4e5c4 WatchSource:0}: Error finding container f764dd698271d5fa90d2d728fe5cd61923954cc8954fe3f392d344962eb4e5c4: Status 404 returned error can't find the container with id f764dd698271d5fa90d2d728fe5cd61923954cc8954fe3f392d344962eb4e5c4
Jul 27 19:41:56.937527 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:56.937494    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786" event={"ID":"66818d25-2974-4461-96bc-c83f88ea95ab","Type":"ContainerStarted","Data":"33b0b60f11948d0c7cd21583de20317f0e4dc2a7981a35dae879cf59f6bbd54c"}
Jul 27 19:41:56.937904 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:56.937546    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786" event={"ID":"66818d25-2974-4461-96bc-c83f88ea95ab","Type":"ContainerStarted","Data":"f764dd698271d5fa90d2d728fe5cd61923954cc8954fe3f392d344962eb4e5c4"}
Jul 27 19:41:56.953110 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:56.953054    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786" podStartSLOduration=1.953034817 podStartE2EDuration="1.953034817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:41:56.952500641 +0000 UTC m=+2203.659640135" watchObservedRunningTime="2026-07-27 19:41:56.953034817 +0000 UTC m=+2203.660174309"
Jul 27 19:41:57.945694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:57.945663    2557 generic.go:356] "Generic (PLEG): container finished" podID="66818d25-2974-4461-96bc-c83f88ea95ab" containerID="33b0b60f11948d0c7cd21583de20317f0e4dc2a7981a35dae879cf59f6bbd54c" exitCode=0
Jul 27 19:41:57.946115 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:57.945754    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786" event={"ID":"66818d25-2974-4461-96bc-c83f88ea95ab","Type":"ContainerDied","Data":"33b0b60f11948d0c7cd21583de20317f0e4dc2a7981a35dae879cf59f6bbd54c"}
Jul 27 19:41:59.102507 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:59.102481    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"
Jul 27 19:41:59.230417 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:59.230328    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66818d25-2974-4461-96bc-c83f88ea95ab-maas-api-service-ca\") pod \"66818d25-2974-4461-96bc-c83f88ea95ab\" (UID: \"66818d25-2974-4461-96bc-c83f88ea95ab\") "
Jul 27 19:41:59.230768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:59.230743    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66818d25-2974-4461-96bc-c83f88ea95ab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "66818d25-2974-4461-96bc-c83f88ea95ab" (UID: "66818d25-2974-4461-96bc-c83f88ea95ab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:41:59.331614 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:59.331576    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66818d25-2974-4461-96bc-c83f88ea95ab-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:41:59.359830 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:59.359789    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:41:59.959557 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:59.959529    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"
Jul 27 19:41:59.959716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:59.959568    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786" event={"ID":"66818d25-2974-4461-96bc-c83f88ea95ab","Type":"ContainerDied","Data":"f764dd698271d5fa90d2d728fe5cd61923954cc8954fe3f392d344962eb4e5c4"}
Jul 27 19:41:59.959716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:41:59.959614    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f764dd698271d5fa90d2d728fe5cd61923954cc8954fe3f392d344962eb4e5c4"
Jul 27 19:42:06.345509 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.345468    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"]
Jul 27 19:42:06.345992 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.345716    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q" podUID="ed777f27-744c-4036-8f89-5a7afa568f60" containerName="payload-processing" containerID="cri-o://0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c" gracePeriod=30
Jul 27 19:42:06.359617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.359589    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"]
Jul 27 19:42:06.359850 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.359824    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6" podUID="0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d" containerName="payload-pre-processing" containerID="cri-o://8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1" gracePeriod=30
Jul 27 19:42:06.503876 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.503839    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"]
Jul 27 19:42:06.507328 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.507297    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-35bf7c-l4786"]
Jul 27 19:42:06.636007 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.635981    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:42:06.658046 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.658019    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:42:06.712289 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.712259    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh4g9\" (UniqueName: \"kubernetes.io/projected/ed777f27-744c-4036-8f89-5a7afa568f60-kube-api-access-nh4g9\") pod \"ed777f27-744c-4036-8f89-5a7afa568f60\" (UID: \"ed777f27-744c-4036-8f89-5a7afa568f60\") "
Jul 27 19:42:06.712451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.712306    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-plugins-config-volume\") pod \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\" (UID: \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\") "
Jul 27 19:42:06.712451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.712336    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkh6b\" (UniqueName: \"kubernetes.io/projected/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-kube-api-access-zkh6b\") pod \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\" (UID: \"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d\") "
Jul 27 19:42:06.712451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.712373    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed777f27-744c-4036-8f89-5a7afa568f60-plugins-config-volume\") pod \"ed777f27-744c-4036-8f89-5a7afa568f60\" (UID: \"ed777f27-744c-4036-8f89-5a7afa568f60\") "
Jul 27 19:42:06.712776 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.712757    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d" (UID: "0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:06.712882 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.712834    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed777f27-744c-4036-8f89-5a7afa568f60-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed777f27-744c-4036-8f89-5a7afa568f60" (UID: "ed777f27-744c-4036-8f89-5a7afa568f60"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:06.714614 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.714591    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed777f27-744c-4036-8f89-5a7afa568f60-kube-api-access-nh4g9" (OuterVolumeSpecName: "kube-api-access-nh4g9") pod "ed777f27-744c-4036-8f89-5a7afa568f60" (UID: "ed777f27-744c-4036-8f89-5a7afa568f60"). InnerVolumeSpecName "kube-api-access-nh4g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:06.714714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.714641    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-kube-api-access-zkh6b" (OuterVolumeSpecName: "kube-api-access-zkh6b") pod "0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d" (UID: "0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d"). InnerVolumeSpecName "kube-api-access-zkh6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:06.813963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.813843    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh4g9\" (UniqueName: \"kubernetes.io/projected/ed777f27-744c-4036-8f89-5a7afa568f60-kube-api-access-nh4g9\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:06.813963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.813877    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:06.813963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.813890    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkh6b\" (UniqueName: \"kubernetes.io/projected/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d-kube-api-access-zkh6b\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:06.813963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:06.813903    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed777f27-744c-4036-8f89-5a7afa568f60-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:07.002520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.002480    2557 generic.go:356] "Generic (PLEG): container finished" podID="ed777f27-744c-4036-8f89-5a7afa568f60" containerID="0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c" exitCode=0
Jul 27 19:42:07.002716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.002528    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"
Jul 27 19:42:07.002716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.002569    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q" event={"ID":"ed777f27-744c-4036-8f89-5a7afa568f60","Type":"ContainerDied","Data":"0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c"}
Jul 27 19:42:07.002716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.002629    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q" event={"ID":"ed777f27-744c-4036-8f89-5a7afa568f60","Type":"ContainerDied","Data":"4a52a53523bc07726ef68c1a515aa98ea98410891f80bedaa68acea6d32ea863"}
Jul 27 19:42:07.002716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.002659    2557 scope.go:117] "RemoveContainer" containerID="0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c"
Jul 27 19:42:07.003967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.003947    2557 generic.go:356] "Generic (PLEG): container finished" podID="0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d" containerID="8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1" exitCode=0
Jul 27 19:42:07.004064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.003983    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"
Jul 27 19:42:07.004064 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.004047    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6" event={"ID":"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d","Type":"ContainerDied","Data":"8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1"}
Jul 27 19:42:07.004182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.004089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6" event={"ID":"0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d","Type":"ContainerDied","Data":"2292e80e645bdf81bb70b80e6d7ae7ed76aa3d2bdbefe5dcbfcb853b777e410a"}
Jul 27 19:42:07.014031 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.013998    2557 scope.go:117] "RemoveContainer" containerID="0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c"
Jul 27 19:42:07.014287 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:42:07.014265    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c\": container with ID starting with 0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c not found: ID does not exist" containerID="0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c"
Jul 27 19:42:07.014389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.014296    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c"} err="failed to get container status \"0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c\": rpc error: code = NotFound desc = could not find container \"0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c\": container with ID starting with 0c3ad45dc6dd7aa59b56710698d2c9dbb9e77ee1e90bdf39d22dc64fd758004c not found: ID does not exist"
Jul 27 19:42:07.014389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.014330    2557 scope.go:117] "RemoveContainer" containerID="8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1"
Jul 27 19:42:07.023250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.023230    2557 scope.go:117] "RemoveContainer" containerID="8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1"
Jul 27 19:42:07.023508 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:42:07.023477    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1\": container with ID starting with 8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1 not found: ID does not exist" containerID="8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1"
Jul 27 19:42:07.023586 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.023513    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1"} err="failed to get container status \"8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1\": rpc error: code = NotFound desc = could not find container \"8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1\": container with ID starting with 8fe7f625f86e56593be27807af140167c861f57958585284770945ac9096e6f1 not found: ID does not exist"
Jul 27 19:42:07.026289 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.026266    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"]
Jul 27 19:42:07.032473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.032453    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-35bf7c-7f78bbccb6-vk86q"]
Jul 27 19:42:07.044951 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.044932    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"]
Jul 27 19:42:07.048003 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.047985    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-35bf7c-59b568cd8d-bh8v6"]
Jul 27 19:42:07.790608 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.790567    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d" path="/var/lib/kubelet/pods/0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d/volumes"
Jul 27 19:42:07.791132 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.791091    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66818d25-2974-4461-96bc-c83f88ea95ab" path="/var/lib/kubelet/pods/66818d25-2974-4461-96bc-c83f88ea95ab/volumes"
Jul 27 19:42:07.791485 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:07.791465    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed777f27-744c-4036-8f89-5a7afa568f60" path="/var/lib/kubelet/pods/ed777f27-744c-4036-8f89-5a7afa568f60/volumes"
Jul 27 19:42:12.999577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:12.999543    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"]
Jul 27 19:42:13.000588 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.000373    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy" containerID="cri-o://c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e" gracePeriod=30
Jul 27 19:42:13.356532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.356440    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"]
Jul 27 19:42:13.357003 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.356983    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed777f27-744c-4036-8f89-5a7afa568f60" containerName="payload-processing"
Jul 27 19:42:13.357108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.357004    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed777f27-744c-4036-8f89-5a7afa568f60" containerName="payload-processing"
Jul 27 19:42:13.357108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.357021    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d" containerName="payload-pre-processing"
Jul 27 19:42:13.357108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.357029    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d" containerName="payload-pre-processing"
Jul 27 19:42:13.357108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.357054    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66818d25-2974-4461-96bc-c83f88ea95ab" containerName="revoke-keys"
Jul 27 19:42:13.357108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.357063    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="66818d25-2974-4461-96bc-c83f88ea95ab" containerName="revoke-keys"
Jul 27 19:42:13.357354 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.357174    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dcbb4e1-be0f-42b0-9cb5-6c3032b4f92d" containerName="payload-pre-processing"
Jul 27 19:42:13.357354 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.357187    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="66818d25-2974-4461-96bc-c83f88ea95ab" containerName="revoke-keys"
Jul 27 19:42:13.357354 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.357199    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed777f27-744c-4036-8f89-5a7afa568f60" containerName="payload-processing"
Jul 27 19:42:13.361732 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.361712    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"
Jul 27 19:42:13.364105 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.364079    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:42:13.367853 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.367831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"]
Jul 27 19:42:13.485843 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.485791    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14bdfb5-c799-44e0-bf6b-9d93d945429f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv\" (UID: \"d14bdfb5-c799-44e0-bf6b-9d93d945429f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"
Jul 27 19:42:13.587416 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.587387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14bdfb5-c799-44e0-bf6b-9d93d945429f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv\" (UID: \"d14bdfb5-c799-44e0-bf6b-9d93d945429f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"
Jul 27 19:42:13.588083 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.588055    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14bdfb5-c799-44e0-bf6b-9d93d945429f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv\" (UID: \"d14bdfb5-c799-44e0-bf6b-9d93d945429f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"
Jul 27 19:42:13.676212 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.676136    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:42:13.684787 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.684757    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"
Jul 27 19:42:13.833470 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:13.833432    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"]
Jul 27 19:42:13.834650 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:42:13.834624    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14bdfb5_c799_44e0_bf6b_9d93d945429f.slice/crio-292bc95e19d04d3fda3da97f9271b5943b83c0640d1d75933f6d8b81046f76db WatchSource:0}: Error finding container 292bc95e19d04d3fda3da97f9271b5943b83c0640d1d75933f6d8b81046f76db: Status 404 returned error can't find the container with id 292bc95e19d04d3fda3da97f9271b5943b83c0640d1d75933f6d8b81046f76db
Jul 27 19:42:14.051601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:14.051559    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv" event={"ID":"d14bdfb5-c799-44e0-bf6b-9d93d945429f","Type":"ContainerStarted","Data":"292bc95e19d04d3fda3da97f9271b5943b83c0640d1d75933f6d8b81046f76db"}
Jul 27 19:42:15.060054 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:15.059972    2557 generic.go:356] "Generic (PLEG): container finished" podID="d14bdfb5-c799-44e0-bf6b-9d93d945429f" containerID="c789d6fa576ba4fc6513f26fcb2bf98ca9db0c599099a5f2749b5d0b2dc5e2b5" exitCode=0
Jul 27 19:42:15.060054 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:15.060023    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv" event={"ID":"d14bdfb5-c799-44e0-bf6b-9d93d945429f","Type":"ContainerDied","Data":"c789d6fa576ba4fc6513f26fcb2bf98ca9db0c599099a5f2749b5d0b2dc5e2b5"}
Jul 27 19:42:15.561928 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:15.561894    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:42:16.212553 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:16.212527    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"
Jul 27 19:42:16.311787 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:16.311754    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14bdfb5-c799-44e0-bf6b-9d93d945429f-maas-api-service-ca\") pod \"d14bdfb5-c799-44e0-bf6b-9d93d945429f\" (UID: \"d14bdfb5-c799-44e0-bf6b-9d93d945429f\") "
Jul 27 19:42:16.312106 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:16.312085    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d14bdfb5-c799-44e0-bf6b-9d93d945429f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d14bdfb5-c799-44e0-bf6b-9d93d945429f" (UID: "d14bdfb5-c799-44e0-bf6b-9d93d945429f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:16.413135 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:16.413063    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14bdfb5-c799-44e0-bf6b-9d93d945429f-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:17.074613 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:17.074583    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"
Jul 27 19:42:17.074787 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:17.074621    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv" event={"ID":"d14bdfb5-c799-44e0-bf6b-9d93d945429f","Type":"ContainerDied","Data":"292bc95e19d04d3fda3da97f9271b5943b83c0640d1d75933f6d8b81046f76db"}
Jul 27 19:42:17.074787 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:17.074663    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="292bc95e19d04d3fda3da97f9271b5943b83c0640d1d75933f6d8b81046f76db"
Jul 27 19:42:18.266088 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.266035    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:42:18.328627 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328590    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-podinfo\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.328767 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328633    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-token\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.328767 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328669    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-envoy\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.328888 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328773    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-certs\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.328888 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328836    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-credential-socket\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.328888 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328858    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istiod-ca-cert\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.328888 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328881    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-socket\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.329097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328911    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gfbz\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-kube-api-access-8gfbz\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.329097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.328965    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-data\") pod \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\" (UID: \"84bfa05c-3fb2-4c4d-83bc-da0e941799ec\") "
Jul 27 19:42:18.329097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.329046    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:18.329097 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.329060    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:18.329318 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.329249    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:18.329414 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.329393    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-certs\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:18.329639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.329420    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-credential-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:18.329639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.329433    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-workload-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:18.329639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.329541    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:18.329991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.329968    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:18.331167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.331144    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:18.331167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.331160    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-kube-api-access-8gfbz" (OuterVolumeSpecName: "kube-api-access-8gfbz") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "kube-api-access-8gfbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:18.331413 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.331392    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:18.331463 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.331435    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84bfa05c-3fb2-4c4d-83bc-da0e941799ec" (UID: "84bfa05c-3fb2-4c4d-83bc-da0e941799ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:42:18.429897 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.429862    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-podinfo\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:18.429897 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.429894    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:18.429897 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.429902    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-envoy\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:18.429897 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.429910    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istiod-ca-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:18.430108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.429918    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gfbz\" (UniqueName: \"kubernetes.io/projected/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-kube-api-access-8gfbz\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:18.430108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:18.429926    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bfa05c-3fb2-4c4d-83bc-da0e941799ec-istio-data\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:19.088803 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.088773    2557 generic.go:356] "Generic (PLEG): container finished" podID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerID="c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e" exitCode=0
Jul 27 19:42:19.088991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.088843    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"
Jul 27 19:42:19.088991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.088855    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" event={"ID":"84bfa05c-3fb2-4c4d-83bc-da0e941799ec","Type":"ContainerDied","Data":"c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e"}
Jul 27 19:42:19.088991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.088910    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll" event={"ID":"84bfa05c-3fb2-4c4d-83bc-da0e941799ec","Type":"ContainerDied","Data":"8df4d6f366af8c57446e5f83e1959f7fd18aa947e3a8342286c669dd808cb284"}
Jul 27 19:42:19.088991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.088932    2557 scope.go:117] "RemoveContainer" containerID="c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e"
Jul 27 19:42:19.099187 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.099166    2557 scope.go:117] "RemoveContainer" containerID="dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1"
Jul 27 19:42:19.108000 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.107982    2557 scope.go:117] "RemoveContainer" containerID="c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e"
Jul 27 19:42:19.108265 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:42:19.108243    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e\": container with ID starting with c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e not found: ID does not exist" containerID="c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e"
Jul 27 19:42:19.108322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.108279    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e"} err="failed to get container status \"c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e\": rpc error: code = NotFound desc = could not find container \"c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e\": container with ID starting with c512ecece3a3d0e2a4f8643d80110d68d5868cd0696c13d1b36fe9e470b7542e not found: ID does not exist"
Jul 27 19:42:19.108322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.108301    2557 scope.go:117] "RemoveContainer" containerID="dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1"
Jul 27 19:42:19.108586 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:42:19.108564    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1\": container with ID starting with dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1 not found: ID does not exist" containerID="dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1"
Jul 27 19:42:19.108694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.108594    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1"} err="failed to get container status \"dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1\": rpc error: code = NotFound desc = could not find container \"dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1\": container with ID starting with dad16e0ac1b0b2d7882fcbb2f5203ca73040d17d311ee7f4533f3cc1df7083d1 not found: ID does not exist"
Jul 27 19:42:19.113709 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.113681    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"]
Jul 27 19:42:19.116915 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.116896    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-35bf7c-openshift-default-84d949dd9d-28kll"]
Jul 27 19:42:19.791368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:19.791327    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" path="/var/lib/kubelet/pods/84bfa05c-3fb2-4c4d-83bc-da0e941799ec/volumes"
Jul 27 19:42:23.797234 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:23.797203    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"]
Jul 27 19:42:23.797667 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:23.797388    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j" podUID="3fb6f9b8-2afd-4480-a142-6361e8b64109" containerName="payload-processing" containerID="cri-o://cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5" gracePeriod=30
Jul 27 19:42:23.804374 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:23.804318    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"]
Jul 27 19:42:23.804558 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:23.804531    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv" podUID="f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e" containerName="payload-pre-processing" containerID="cri-o://b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820" gracePeriod=30
Jul 27 19:42:23.936027 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:23.935998    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"]
Jul 27 19:42:23.939221 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:23.939199    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d59e9c-q7zcv"]
Jul 27 19:42:24.059835 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.059765    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:42:24.090941 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.090914    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:42:24.123357 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.123308    2557 generic.go:356] "Generic (PLEG): container finished" podID="f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e" containerID="b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820" exitCode=0
Jul 27 19:42:24.123473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.123358    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"
Jul 27 19:42:24.123473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.123391    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv" event={"ID":"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e","Type":"ContainerDied","Data":"b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820"}
Jul 27 19:42:24.123473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.123448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv" event={"ID":"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e","Type":"ContainerDied","Data":"75f818a3f643d9cba678f526c32bcaf14a2fc59b54cd937a2f252320fb6a586e"}
Jul 27 19:42:24.123641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.123479    2557 scope.go:117] "RemoveContainer" containerID="b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820"
Jul 27 19:42:24.129031 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.128936    2557 generic.go:356] "Generic (PLEG): container finished" podID="3fb6f9b8-2afd-4480-a142-6361e8b64109" containerID="cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5" exitCode=0
Jul 27 19:42:24.129161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.129029    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j" event={"ID":"3fb6f9b8-2afd-4480-a142-6361e8b64109","Type":"ContainerDied","Data":"cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5"}
Jul 27 19:42:24.129161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.129075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j" event={"ID":"3fb6f9b8-2afd-4480-a142-6361e8b64109","Type":"ContainerDied","Data":"76b730a431918f5ad073c6f3e80b4062ed20b2e4331ce0ee355745b56049fa07"}
Jul 27 19:42:24.129161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.129120    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"
Jul 27 19:42:24.137053 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.137037    2557 scope.go:117] "RemoveContainer" containerID="b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820"
Jul 27 19:42:24.137313 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:42:24.137294    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820\": container with ID starting with b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820 not found: ID does not exist" containerID="b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820"
Jul 27 19:42:24.137387 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.137325    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820"} err="failed to get container status \"b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820\": rpc error: code = NotFound desc = could not find container \"b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820\": container with ID starting with b7dc1870efb99090b1d3f1381cfe823751e50f8ace7b08594619fbc997ef5820 not found: ID does not exist"
Jul 27 19:42:24.137387 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.137348    2557 scope.go:117] "RemoveContainer" containerID="cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5"
Jul 27 19:42:24.145556 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.145541    2557 scope.go:117] "RemoveContainer" containerID="cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5"
Jul 27 19:42:24.145792 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:42:24.145775    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5\": container with ID starting with cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5 not found: ID does not exist" containerID="cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5"
Jul 27 19:42:24.145895 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.145799    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5"} err="failed to get container status \"cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5\": rpc error: code = NotFound desc = could not find container \"cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5\": container with ID starting with cdaa6083015761f98b0072a93f0486a394f87470878a9574d40a94f5b15f6aa5 not found: ID does not exist"
Jul 27 19:42:24.182573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.182545    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm2gr\" (UniqueName: \"kubernetes.io/projected/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-kube-api-access-nm2gr\") pod \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\" (UID: \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\") "
Jul 27 19:42:24.182743 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.182642    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-plugins-config-volume\") pod \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\" (UID: \"f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e\") "
Jul 27 19:42:24.182743 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.182734    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fb6f9b8-2afd-4480-a142-6361e8b64109-plugins-config-volume\") pod \"3fb6f9b8-2afd-4480-a142-6361e8b64109\" (UID: \"3fb6f9b8-2afd-4480-a142-6361e8b64109\") "
Jul 27 19:42:24.182884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.182760    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ll6q\" (UniqueName: \"kubernetes.io/projected/3fb6f9b8-2afd-4480-a142-6361e8b64109-kube-api-access-4ll6q\") pod \"3fb6f9b8-2afd-4480-a142-6361e8b64109\" (UID: \"3fb6f9b8-2afd-4480-a142-6361e8b64109\") "
Jul 27 19:42:24.183082 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.183057    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e" (UID: "f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:24.183220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.183117    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb6f9b8-2afd-4480-a142-6361e8b64109-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3fb6f9b8-2afd-4480-a142-6361e8b64109" (UID: "3fb6f9b8-2afd-4480-a142-6361e8b64109"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:24.183220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.183156    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:24.184891 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.184870    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-kube-api-access-nm2gr" (OuterVolumeSpecName: "kube-api-access-nm2gr") pod "f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e" (UID: "f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e"). InnerVolumeSpecName "kube-api-access-nm2gr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:24.184961 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.184942    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb6f9b8-2afd-4480-a142-6361e8b64109-kube-api-access-4ll6q" (OuterVolumeSpecName: "kube-api-access-4ll6q") pod "3fb6f9b8-2afd-4480-a142-6361e8b64109" (UID: "3fb6f9b8-2afd-4480-a142-6361e8b64109"). InnerVolumeSpecName "kube-api-access-4ll6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:24.284577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.284544    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm2gr\" (UniqueName: \"kubernetes.io/projected/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e-kube-api-access-nm2gr\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:24.284577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.284570    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fb6f9b8-2afd-4480-a142-6361e8b64109-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:24.284577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.284580    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ll6q\" (UniqueName: \"kubernetes.io/projected/3fb6f9b8-2afd-4480-a142-6361e8b64109-kube-api-access-4ll6q\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:24.447967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.447929    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"]
Jul 27 19:42:24.454847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.454826    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d59e9c-78d5b6c56-pf5mv"]
Jul 27 19:42:24.464767 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.464746    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"]
Jul 27 19:42:24.468462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:24.468442    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d59e9c-6688b8f5d-6z68j"]
Jul 27 19:42:25.790931 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:25.790903    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb6f9b8-2afd-4480-a142-6361e8b64109" path="/var/lib/kubelet/pods/3fb6f9b8-2afd-4480-a142-6361e8b64109/volumes"
Jul 27 19:42:25.791321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:25.791222    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d14bdfb5-c799-44e0-bf6b-9d93d945429f" path="/var/lib/kubelet/pods/d14bdfb5-c799-44e0-bf6b-9d93d945429f/volumes"
Jul 27 19:42:25.791537 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:25.791524    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e" path="/var/lib/kubelet/pods/f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e/volumes"
Jul 27 19:42:26.875844 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:26.875801    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:42:31.305876 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.305838    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"]
Jul 27 19:42:31.306265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306252    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14bdfb5-c799-44e0-bf6b-9d93d945429f" containerName="revoke-keys"
Jul 27 19:42:31.306265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306266    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14bdfb5-c799-44e0-bf6b-9d93d945429f" containerName="revoke-keys"
Jul 27 19:42:31.306341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306281    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb6f9b8-2afd-4480-a142-6361e8b64109" containerName="payload-processing"
Jul 27 19:42:31.306341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306286    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb6f9b8-2afd-4480-a142-6361e8b64109" containerName="payload-processing"
Jul 27 19:42:31.306341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306296    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy"
Jul 27 19:42:31.306341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306301    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy"
Jul 27 19:42:31.306341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306314    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy"
Jul 27 19:42:31.306341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306319    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy"
Jul 27 19:42:31.306341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306326    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e" containerName="payload-pre-processing"
Jul 27 19:42:31.306341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306331    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e" containerName="payload-pre-processing"
Jul 27 19:42:31.306582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306399    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d14bdfb5-c799-44e0-bf6b-9d93d945429f" containerName="revoke-keys"
Jul 27 19:42:31.306582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306406    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb6f9b8-2afd-4480-a142-6361e8b64109" containerName="payload-processing"
Jul 27 19:42:31.306582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306414    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f80cbf9d-31ab-4ff1-a7b2-f952fe55f71e" containerName="payload-pre-processing"
Jul 27 19:42:31.306582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306422    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy"
Jul 27 19:42:31.306582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.306428    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="84bfa05c-3fb2-4c4d-83bc-da0e941799ec" containerName="istio-proxy"
Jul 27 19:42:31.313899 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.312785    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.315789 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.315760    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-944fa0-openshift-default-dockercfg-2f4ll\""
Jul 27 19:42:31.322984 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.322959    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"]
Jul 27 19:42:31.451196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451152    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-data\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.451369 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-token\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.451369 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgggw\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-kube-api-access-mgggw\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.451369 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istiod-ca-cert\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.451523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451407    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-envoy\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.451523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-certs\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.451523 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451472    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-credential-socket\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.451647 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451564    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-podinfo\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.451647 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.451623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-socket\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.552976 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.552942    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-envoy\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.552992    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-certs\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553016    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-credential-socket\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553054    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-podinfo\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553082    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-socket\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553114    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-data\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553177    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-token\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgggw\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-kube-api-access-mgggw\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istiod-ca-cert\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553433    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-credential-socket\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553447    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-certs\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553796 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-socket\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553889    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-data\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.553958 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.553905    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istiod-ca-cert\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.555370 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.555349    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-envoy\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.555609 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.555590    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-podinfo\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.562231 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.562178    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgggw\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-kube-api-access-mgggw\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.562513 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.562496    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-token\") pod \"e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") " pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.626839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.626790    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:31.775515 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.775481    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"]
Jul 27 19:42:31.776534 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:42:31.776509    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0ec1e5_ad88_4e57_9fdc_e8ab2f5f1ef0.slice/crio-b51f70ebea894102e9709ea00d8f31df8f5bfc95ac2f8474cf4a3de79bf5caf3 WatchSource:0}: Error finding container b51f70ebea894102e9709ea00d8f31df8f5bfc95ac2f8474cf4a3de79bf5caf3: Status 404 returned error can't find the container with id b51f70ebea894102e9709ea00d8f31df8f5bfc95ac2f8474cf4a3de79bf5caf3
Jul 27 19:42:31.778600 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.778565    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:31.778697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.778644    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:31.778697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:31.778689    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:32.182303 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:32.182272    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" event={"ID":"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0","Type":"ContainerStarted","Data":"361917777f4a439dc907990cde78c9aeb1efbe4f2a4788d45e175062e9881261"}
Jul 27 19:42:32.182477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:32.182323    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" event={"ID":"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0","Type":"ContainerStarted","Data":"b51f70ebea894102e9709ea00d8f31df8f5bfc95ac2f8474cf4a3de79bf5caf3"}
Jul 27 19:42:32.208666 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:32.208616    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" podStartSLOduration=1.208601343 podStartE2EDuration="1.208601343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:42:32.207236128 +0000 UTC m=+2238.914375619" watchObservedRunningTime="2026-07-27 19:42:32.208601343 +0000 UTC m=+2238.915740834"
Jul 27 19:42:32.627265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:32.627181    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:32.632341 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:32.632320    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:33.189824 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:33.189783    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:33.190676 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:33.190653    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:34.978957 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:34.978870    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"]
Jul 27 19:42:34.982694 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:34.982675    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:34.989952 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:34.989928    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-944fa0-dockercfg-86pv6\""
Jul 27 19:42:34.990193 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:34.990039    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-944fa0\""
Jul 27 19:42:34.998045 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:34.997944    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"]
Jul 27 19:42:35.001827 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.001794    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:35.002997 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.002972    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"]
Jul 27 19:42:35.015928 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.015904    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"]
Jul 27 19:42:35.091322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.091288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtwdt\" (UniqueName: \"kubernetes.io/projected/86d56314-03ce-4831-8c20-b78c8808aeb3-kube-api-access-vtwdt\") pod \"payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k\" (UID: \"86d56314-03ce-4831-8c20-b78c8808aeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:35.091529 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.091385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d56314-03ce-4831-8c20-b78c8808aeb3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k\" (UID: \"86d56314-03ce-4831-8c20-b78c8808aeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:35.192089 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.192042    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtwdt\" (UniqueName: \"kubernetes.io/projected/86d56314-03ce-4831-8c20-b78c8808aeb3-kube-api-access-vtwdt\") pod \"payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k\" (UID: \"86d56314-03ce-4831-8c20-b78c8808aeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:35.192279 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.192107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st75b\" (UniqueName: \"kubernetes.io/projected/86f5766b-f0b7-4dfd-98ac-799e6785670f-kube-api-access-st75b\") pod \"payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd\" (UID: \"86f5766b-f0b7-4dfd-98ac-799e6785670f\") " pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:35.192279 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.192167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f5766b-f0b7-4dfd-98ac-799e6785670f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd\" (UID: \"86f5766b-f0b7-4dfd-98ac-799e6785670f\") " pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:35.192387 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.192287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d56314-03ce-4831-8c20-b78c8808aeb3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k\" (UID: \"86d56314-03ce-4831-8c20-b78c8808aeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:35.192995 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.192977    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d56314-03ce-4831-8c20-b78c8808aeb3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k\" (UID: \"86d56314-03ce-4831-8c20-b78c8808aeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:35.202015 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.201979    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtwdt\" (UniqueName: \"kubernetes.io/projected/86d56314-03ce-4831-8c20-b78c8808aeb3-kube-api-access-vtwdt\") pod \"payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k\" (UID: \"86d56314-03ce-4831-8c20-b78c8808aeb3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:35.293688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.293596    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f5766b-f0b7-4dfd-98ac-799e6785670f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd\" (UID: \"86f5766b-f0b7-4dfd-98ac-799e6785670f\") " pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:35.293874 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.293699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st75b\" (UniqueName: \"kubernetes.io/projected/86f5766b-f0b7-4dfd-98ac-799e6785670f-kube-api-access-st75b\") pod \"payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd\" (UID: \"86f5766b-f0b7-4dfd-98ac-799e6785670f\") " pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:35.294377 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.294356    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f5766b-f0b7-4dfd-98ac-799e6785670f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd\" (UID: \"86f5766b-f0b7-4dfd-98ac-799e6785670f\") " pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:35.302039 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.302011    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:35.302342 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.302324    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st75b\" (UniqueName: \"kubernetes.io/projected/86f5766b-f0b7-4dfd-98ac-799e6785670f-kube-api-access-st75b\") pod \"payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd\" (UID: \"86f5766b-f0b7-4dfd-98ac-799e6785670f\") " pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:35.312725 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.312691    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:35.705098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.705071    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"]
Jul 27 19:42:35.705285 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:42:35.705267    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f5766b_f0b7_4dfd_98ac_799e6785670f.slice/crio-09bd1a02f96e5836ba4db345a5696e033a8997af971dd883933a48ac29d23e08 WatchSource:0}: Error finding container 09bd1a02f96e5836ba4db345a5696e033a8997af971dd883933a48ac29d23e08: Status 404 returned error can't find the container with id 09bd1a02f96e5836ba4db345a5696e033a8997af971dd883933a48ac29d23e08
Jul 27 19:42:35.736666 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:35.736643    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"]
Jul 27 19:42:35.742028 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:42:35.742004    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d56314_03ce_4831_8c20_b78c8808aeb3.slice/crio-31f59e87bec9b6ca51be94a9f49f4e5ab530b5cf1c0d85d1723fcfa47d258ac6 WatchSource:0}: Error finding container 31f59e87bec9b6ca51be94a9f49f4e5ab530b5cf1c0d85d1723fcfa47d258ac6: Status 404 returned error can't find the container with id 31f59e87bec9b6ca51be94a9f49f4e5ab530b5cf1c0d85d1723fcfa47d258ac6
Jul 27 19:42:36.215219 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:36.215178    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd" event={"ID":"86f5766b-f0b7-4dfd-98ac-799e6785670f","Type":"ContainerStarted","Data":"876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805"}
Jul 27 19:42:36.215670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:36.215251    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:36.215670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:36.215277    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd" event={"ID":"86f5766b-f0b7-4dfd-98ac-799e6785670f","Type":"ContainerStarted","Data":"09bd1a02f96e5836ba4db345a5696e033a8997af971dd883933a48ac29d23e08"}
Jul 27 19:42:36.216925 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:36.216897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k" event={"ID":"86d56314-03ce-4831-8c20-b78c8808aeb3","Type":"ContainerStarted","Data":"25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee"}
Jul 27 19:42:36.217046 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:36.216956    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k" event={"ID":"86d56314-03ce-4831-8c20-b78c8808aeb3","Type":"ContainerStarted","Data":"31f59e87bec9b6ca51be94a9f49f4e5ab530b5cf1c0d85d1723fcfa47d258ac6"}
Jul 27 19:42:36.217046 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:36.217037    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:36.235743 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:36.235694    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd" podStartSLOduration=2.235676587 podStartE2EDuration="2.235676587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:42:36.230724493 +0000 UTC m=+2242.937863988" watchObservedRunningTime="2026-07-27 19:42:36.235676587 +0000 UTC m=+2242.942816081"
Jul 27 19:42:39.155309 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:39.155253    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k" podStartSLOduration=5.155237025 podStartE2EDuration="5.155237025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:42:36.246904452 +0000 UTC m=+2242.954043944" watchObservedRunningTime="2026-07-27 19:42:39.155237025 +0000 UTC m=+2245.862376557"
Jul 27 19:42:39.156245 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:39.156222    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:42:43.100829 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.098897    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"]
Jul 27 19:42:43.107126 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.107104    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:43.110653 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.110409    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-74909c\""
Jul 27 19:42:43.110783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.110762    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-74909c-dockercfg-ksmmc\""
Jul 27 19:42:43.121680 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.120304    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"]
Jul 27 19:42:43.160165 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.160133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln28z\" (UniqueName: \"kubernetes.io/projected/2cb89170-b811-4e9a-bec7-059626ddd2d5-kube-api-access-ln28z\") pod \"payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8\" (UID: \"2cb89170-b811-4e9a-bec7-059626ddd2d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:43.160307 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.160272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cb89170-b811-4e9a-bec7-059626ddd2d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8\" (UID: \"2cb89170-b811-4e9a-bec7-059626ddd2d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:43.260838 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.260770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cb89170-b811-4e9a-bec7-059626ddd2d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8\" (UID: \"2cb89170-b811-4e9a-bec7-059626ddd2d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:43.261023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.260869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln28z\" (UniqueName: \"kubernetes.io/projected/2cb89170-b811-4e9a-bec7-059626ddd2d5-kube-api-access-ln28z\") pod \"payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8\" (UID: \"2cb89170-b811-4e9a-bec7-059626ddd2d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:43.261511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.261486    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cb89170-b811-4e9a-bec7-059626ddd2d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8\" (UID: \"2cb89170-b811-4e9a-bec7-059626ddd2d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:43.269200 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.269172    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln28z\" (UniqueName: \"kubernetes.io/projected/2cb89170-b811-4e9a-bec7-059626ddd2d5-kube-api-access-ln28z\") pod \"payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8\" (UID: \"2cb89170-b811-4e9a-bec7-059626ddd2d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:43.430180 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.430145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:43.814670 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:43.812403    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"]
Jul 27 19:42:44.291754 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:44.291709    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8" event={"ID":"2cb89170-b811-4e9a-bec7-059626ddd2d5","Type":"ContainerStarted","Data":"20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2"}
Jul 27 19:42:44.292330 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:44.292304    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8" event={"ID":"2cb89170-b811-4e9a-bec7-059626ddd2d5","Type":"ContainerStarted","Data":"7410d91af34f5dee06a9572b2f753e80df5ff578b29f4062f61eaa76c762078c"}
Jul 27 19:42:44.292449 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:44.292338    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:44.308182 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:44.308130    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8" podStartSLOduration=1.30811487 podStartE2EDuration="1.30811487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:42:44.306957593 +0000 UTC m=+2251.014097068" watchObservedRunningTime="2026-07-27 19:42:44.30811487 +0000 UTC m=+2251.015254362"
Jul 27 19:42:47.225977 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:47.225943    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:42:47.227264 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:47.226378    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:42:47.312421 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:47.312392    2557 generic.go:356] "Generic (PLEG): container finished" podID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerID="361917777f4a439dc907990cde78c9aeb1efbe4f2a4788d45e175062e9881261" exitCode=0
Jul 27 19:42:47.312571 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:47.312454    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" event={"ID":"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0","Type":"ContainerDied","Data":"361917777f4a439dc907990cde78c9aeb1efbe4f2a4788d45e175062e9881261"}
Jul 27 19:42:47.312910 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:47.312889    2557 scope.go:117] "RemoveContainer" containerID="361917777f4a439dc907990cde78c9aeb1efbe4f2a4788d45e175062e9881261"
Jul 27 19:42:47.313925 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:47.313896    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:47.314016 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:47.313977    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:47.314080 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:47.314027    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:48.190279 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:48.190243    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:48.320928 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:48.320882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" event={"ID":"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0","Type":"ContainerStarted","Data":"d6ba521c3124132cefe4944a795775b90df8e96bffa516c83cc0d8779214c33a"}
Jul 27 19:42:48.627251 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:48.627164    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:48.628471 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:48.628440    2557 patch_prober.go:28] interesting pod/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 27 19:42:48.628608 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:48.628507    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 27 19:42:49.627677 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:49.627641    2557 patch_prober.go:28] interesting pod/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 27 19:42:49.628193 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:49.627702    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 27 19:42:49.763356 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:49.763319    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:42:50.627898 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:50.627866    2557 patch_prober.go:28] interesting pod/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 27 19:42:50.628290 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:50.627917    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 27 19:42:51.627218 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:51.627187    2557 patch_prober.go:28] interesting pod/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 27 19:42:51.627401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:51.627251    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 27 19:42:52.628109 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:52.628068    2557 patch_prober.go:28] interesting pod/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 27 19:42:52.628538 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:52.628133    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 27 19:42:53.632373 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:53.632338    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:53.632757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:53.632737    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:53.633454 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:53.633433    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:42:54.938607 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:54.938564    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"]
Jul 27 19:42:54.941698 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:54.941675    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"
Jul 27 19:42:54.944125 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:54.944100    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:42:54.947557 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:54.947537    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"]
Jul 27 19:42:54.973427 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:54.973400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda76a1a-5940-47ea-8a63-4e00d8dfe8ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr\" (UID: \"eda76a1a-5940-47ea-8a63-4e00d8dfe8ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"
Jul 27 19:42:55.074857 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:55.074792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda76a1a-5940-47ea-8a63-4e00d8dfe8ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr\" (UID: \"eda76a1a-5940-47ea-8a63-4e00d8dfe8ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"
Jul 27 19:42:55.075464 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:55.075445    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda76a1a-5940-47ea-8a63-4e00d8dfe8ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr\" (UID: \"eda76a1a-5940-47ea-8a63-4e00d8dfe8ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"
Jul 27 19:42:55.254673 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:55.254590    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"
Jul 27 19:42:55.301298 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:55.301271    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:42:55.415527 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:55.415497    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"]
Jul 27 19:42:55.416106 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:42:55.416084    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda76a1a_5940_47ea_8a63_4e00d8dfe8ec.slice/crio-37900ffc69ecb8c046fccef6bbf097ae747ea0e0d8d1ad8e34a3ecb0e568e296 WatchSource:0}: Error finding container 37900ffc69ecb8c046fccef6bbf097ae747ea0e0d8d1ad8e34a3ecb0e568e296: Status 404 returned error can't find the container with id 37900ffc69ecb8c046fccef6bbf097ae747ea0e0d8d1ad8e34a3ecb0e568e296
Jul 27 19:42:56.381511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:56.381384    2557 generic.go:356] "Generic (PLEG): container finished" podID="eda76a1a-5940-47ea-8a63-4e00d8dfe8ec" containerID="c3fc0b2c7bcaa3a4b3fa800d440a1bdb95ddafadb4d8ed69a1e11a3e782fddb0" exitCode=0
Jul 27 19:42:56.381511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:56.381480    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr" event={"ID":"eda76a1a-5940-47ea-8a63-4e00d8dfe8ec","Type":"ContainerDied","Data":"c3fc0b2c7bcaa3a4b3fa800d440a1bdb95ddafadb4d8ed69a1e11a3e782fddb0"}
Jul 27 19:42:56.381963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:56.381536    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr" event={"ID":"eda76a1a-5940-47ea-8a63-4e00d8dfe8ec","Type":"ContainerStarted","Data":"37900ffc69ecb8c046fccef6bbf097ae747ea0e0d8d1ad8e34a3ecb0e568e296"}
Jul 27 19:42:57.548174 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:57.548143    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"
Jul 27 19:42:57.607141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:57.607112    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda76a1a-5940-47ea-8a63-4e00d8dfe8ec-maas-api-service-ca\") pod \"eda76a1a-5940-47ea-8a63-4e00d8dfe8ec\" (UID: \"eda76a1a-5940-47ea-8a63-4e00d8dfe8ec\") "
Jul 27 19:42:57.607528 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:57.607507    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eda76a1a-5940-47ea-8a63-4e00d8dfe8ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eda76a1a-5940-47ea-8a63-4e00d8dfe8ec" (UID: "eda76a1a-5940-47ea-8a63-4e00d8dfe8ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:57.708223 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:57.708197    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda76a1a-5940-47ea-8a63-4e00d8dfe8ec-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:42:58.395594 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:58.395568    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"
Jul 27 19:42:58.395768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:58.395602    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr" event={"ID":"eda76a1a-5940-47ea-8a63-4e00d8dfe8ec","Type":"ContainerDied","Data":"37900ffc69ecb8c046fccef6bbf097ae747ea0e0d8d1ad8e34a3ecb0e568e296"}
Jul 27 19:42:58.395768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:42:58.395642    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37900ffc69ecb8c046fccef6bbf097ae747ea0e0d8d1ad8e34a3ecb0e568e296"
Jul 27 19:43:10.647165 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:10.647132    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"]
Jul 27 19:43:10.647602 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:10.647340    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd" podUID="86f5766b-f0b7-4dfd-98ac-799e6785670f" containerName="payload-processing" containerID="cri-o://876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805" gracePeriod=30
Jul 27 19:43:10.656068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:10.655997    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"]
Jul 27 19:43:10.656281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:10.656217    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k" podUID="86d56314-03ce-4831-8c20-b78c8808aeb3" containerName="payload-pre-processing" containerID="cri-o://25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee" gracePeriod=30
Jul 27 19:43:10.785882 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:10.785857    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"]
Jul 27 19:43:10.791905 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:10.791871    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-944fa0-2zsqr"]
Jul 27 19:43:10.930460 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:10.930438    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:43:10.954991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:10.954968    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:43:11.038045 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.038006    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st75b\" (UniqueName: \"kubernetes.io/projected/86f5766b-f0b7-4dfd-98ac-799e6785670f-kube-api-access-st75b\") pod \"86f5766b-f0b7-4dfd-98ac-799e6785670f\" (UID: \"86f5766b-f0b7-4dfd-98ac-799e6785670f\") "
Jul 27 19:43:11.038250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.038112    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f5766b-f0b7-4dfd-98ac-799e6785670f-plugins-config-volume\") pod \"86f5766b-f0b7-4dfd-98ac-799e6785670f\" (UID: \"86f5766b-f0b7-4dfd-98ac-799e6785670f\") "
Jul 27 19:43:11.038250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.038192    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d56314-03ce-4831-8c20-b78c8808aeb3-plugins-config-volume\") pod \"86d56314-03ce-4831-8c20-b78c8808aeb3\" (UID: \"86d56314-03ce-4831-8c20-b78c8808aeb3\") "
Jul 27 19:43:11.038250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.038222    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtwdt\" (UniqueName: \"kubernetes.io/projected/86d56314-03ce-4831-8c20-b78c8808aeb3-kube-api-access-vtwdt\") pod \"86d56314-03ce-4831-8c20-b78c8808aeb3\" (UID: \"86d56314-03ce-4831-8c20-b78c8808aeb3\") "
Jul 27 19:43:11.038534 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.038498    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f5766b-f0b7-4dfd-98ac-799e6785670f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86f5766b-f0b7-4dfd-98ac-799e6785670f" (UID: "86f5766b-f0b7-4dfd-98ac-799e6785670f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:11.038658 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.038535    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d56314-03ce-4831-8c20-b78c8808aeb3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86d56314-03ce-4831-8c20-b78c8808aeb3" (UID: "86d56314-03ce-4831-8c20-b78c8808aeb3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:11.040451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.040428    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d56314-03ce-4831-8c20-b78c8808aeb3-kube-api-access-vtwdt" (OuterVolumeSpecName: "kube-api-access-vtwdt") pod "86d56314-03ce-4831-8c20-b78c8808aeb3" (UID: "86d56314-03ce-4831-8c20-b78c8808aeb3"). InnerVolumeSpecName "kube-api-access-vtwdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:11.040451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.040446    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f5766b-f0b7-4dfd-98ac-799e6785670f-kube-api-access-st75b" (OuterVolumeSpecName: "kube-api-access-st75b") pod "86f5766b-f0b7-4dfd-98ac-799e6785670f" (UID: "86f5766b-f0b7-4dfd-98ac-799e6785670f"). InnerVolumeSpecName "kube-api-access-st75b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:11.139196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.139151    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st75b\" (UniqueName: \"kubernetes.io/projected/86f5766b-f0b7-4dfd-98ac-799e6785670f-kube-api-access-st75b\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:11.139196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.139188    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f5766b-f0b7-4dfd-98ac-799e6785670f-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:11.139196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.139201    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86d56314-03ce-4831-8c20-b78c8808aeb3-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:11.139455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.139213    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtwdt\" (UniqueName: \"kubernetes.io/projected/86d56314-03ce-4831-8c20-b78c8808aeb3-kube-api-access-vtwdt\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:11.476662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.476622    2557 generic.go:356] "Generic (PLEG): container finished" podID="86f5766b-f0b7-4dfd-98ac-799e6785670f" containerID="876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805" exitCode=0
Jul 27 19:43:11.476662 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.476657    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd" event={"ID":"86f5766b-f0b7-4dfd-98ac-799e6785670f","Type":"ContainerDied","Data":"876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805"}
Jul 27 19:43:11.476980 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.476716    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd" event={"ID":"86f5766b-f0b7-4dfd-98ac-799e6785670f","Type":"ContainerDied","Data":"09bd1a02f96e5836ba4db345a5696e033a8997af971dd883933a48ac29d23e08"}
Jul 27 19:43:11.476980 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.476667    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"
Jul 27 19:43:11.476980 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.476746    2557 scope.go:117] "RemoveContainer" containerID="876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805"
Jul 27 19:43:11.478249 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.478229    2557 generic.go:356] "Generic (PLEG): container finished" podID="86d56314-03ce-4831-8c20-b78c8808aeb3" containerID="25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee" exitCode=0
Jul 27 19:43:11.478352 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.478273    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"
Jul 27 19:43:11.478352 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.478313    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k" event={"ID":"86d56314-03ce-4831-8c20-b78c8808aeb3","Type":"ContainerDied","Data":"25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee"}
Jul 27 19:43:11.478449 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.478362    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k" event={"ID":"86d56314-03ce-4831-8c20-b78c8808aeb3","Type":"ContainerDied","Data":"31f59e87bec9b6ca51be94a9f49f4e5ab530b5cf1c0d85d1723fcfa47d258ac6"}
Jul 27 19:43:11.486887 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.486870    2557 scope.go:117] "RemoveContainer" containerID="876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805"
Jul 27 19:43:11.487199 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:43:11.487177    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805\": container with ID starting with 876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805 not found: ID does not exist" containerID="876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805"
Jul 27 19:43:11.487291 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.487209    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805"} err="failed to get container status \"876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805\": rpc error: code = NotFound desc = could not find container \"876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805\": container with ID starting with 876d2c4c70617ac1ede9d56dd6d87fc591dd1d316793c0907cae303b3f967805 not found: ID does not exist"
Jul 27 19:43:11.487291 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.487231    2557 scope.go:117] "RemoveContainer" containerID="25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee"
Jul 27 19:43:11.497334 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.497318    2557 scope.go:117] "RemoveContainer" containerID="25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee"
Jul 27 19:43:11.497589 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:43:11.497570    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee\": container with ID starting with 25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee not found: ID does not exist" containerID="25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee"
Jul 27 19:43:11.497653 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.497595    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee"} err="failed to get container status \"25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee\": rpc error: code = NotFound desc = could not find container \"25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee\": container with ID starting with 25669b24c49ba0489ecd0d116f28394b0a8ceaa17efc7e58ee28cc2c429049ee not found: ID does not exist"
Jul 27 19:43:11.506094 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.506071    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"]
Jul 27 19:43:11.509596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.509575    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-944fa0-7574458d4d-czbpd"]
Jul 27 19:43:11.519556 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.519512    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"]
Jul 27 19:43:11.523635 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.523616    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-944fa0-69c8f47d44-f446k"]
Jul 27 19:43:11.791425 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.791334    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d56314-03ce-4831-8c20-b78c8808aeb3" path="/var/lib/kubelet/pods/86d56314-03ce-4831-8c20-b78c8808aeb3/volumes"
Jul 27 19:43:11.791913 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.791881    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86f5766b-f0b7-4dfd-98ac-799e6785670f" path="/var/lib/kubelet/pods/86f5766b-f0b7-4dfd-98ac-799e6785670f/volumes"
Jul 27 19:43:11.792265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:11.792245    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eda76a1a-5940-47ea-8a63-4e00d8dfe8ec" path="/var/lib/kubelet/pods/eda76a1a-5940-47ea-8a63-4e00d8dfe8ec/volumes"
Jul 27 19:43:14.742232 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:14.742203    2557 scope.go:117] "RemoveContainer" containerID="d732eafe91c6f4b8343f3cd6eac3b8558a0012da52c9d4406976c976bab8556a"
Jul 27 19:43:16.760567 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:16.760530    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:43:17.380270 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.380238    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"]
Jul 27 19:43:17.380559 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.380511    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy" containerID="cri-o://d6ba521c3124132cefe4944a795775b90df8e96bffa516c83cc0d8779214c33a" gracePeriod=30
Jul 27 19:43:17.755401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755367    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"]
Jul 27 19:43:17.755860 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755845    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86f5766b-f0b7-4dfd-98ac-799e6785670f" containerName="payload-processing"
Jul 27 19:43:17.755911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755862    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="86f5766b-f0b7-4dfd-98ac-799e6785670f" containerName="payload-processing"
Jul 27 19:43:17.755911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755882    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d56314-03ce-4831-8c20-b78c8808aeb3" containerName="payload-pre-processing"
Jul 27 19:43:17.755911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755887    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d56314-03ce-4831-8c20-b78c8808aeb3" containerName="payload-pre-processing"
Jul 27 19:43:17.755911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755895    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda76a1a-5940-47ea-8a63-4e00d8dfe8ec" containerName="revoke-keys"
Jul 27 19:43:17.755911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755901    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda76a1a-5940-47ea-8a63-4e00d8dfe8ec" containerName="revoke-keys"
Jul 27 19:43:17.756061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755966    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d56314-03ce-4831-8c20-b78c8808aeb3" containerName="payload-pre-processing"
Jul 27 19:43:17.756061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755974    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="86f5766b-f0b7-4dfd-98ac-799e6785670f" containerName="payload-processing"
Jul 27 19:43:17.756061 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.755982    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eda76a1a-5940-47ea-8a63-4e00d8dfe8ec" containerName="revoke-keys"
Jul 27 19:43:17.758024 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.758001    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"
Jul 27 19:43:17.760298 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.760277    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:43:17.766598 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.766573    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"]
Jul 27 19:43:17.900458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:17.900422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14eff10c-bf90-4e03-8b65-e65f0645a0f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-74909c-ghhfc\" (UID: \"14eff10c-bf90-4e03-8b65-e65f0645a0f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"
Jul 27 19:43:18.001002 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:18.000969    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14eff10c-bf90-4e03-8b65-e65f0645a0f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-74909c-ghhfc\" (UID: \"14eff10c-bf90-4e03-8b65-e65f0645a0f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"
Jul 27 19:43:18.001799 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:18.001770    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14eff10c-bf90-4e03-8b65-e65f0645a0f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-74909c-ghhfc\" (UID: \"14eff10c-bf90-4e03-8b65-e65f0645a0f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"
Jul 27 19:43:18.070827 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:18.070740    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"
Jul 27 19:43:18.209620 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:18.209589    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"]
Jul 27 19:43:18.210020 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:43:18.209996    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14eff10c_bf90_4e03_8b65_e65f0645a0f1.slice/crio-9ecfa85328452f4d1672e7aa2579593b3d8e5d667e211b718b433f107ca92202 WatchSource:0}: Error finding container 9ecfa85328452f4d1672e7aa2579593b3d8e5d667e211b718b433f107ca92202: Status 404 returned error can't find the container with id 9ecfa85328452f4d1672e7aa2579593b3d8e5d667e211b718b433f107ca92202
Jul 27 19:43:18.525386 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:18.525350    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc" event={"ID":"14eff10c-bf90-4e03-8b65-e65f0645a0f1","Type":"ContainerStarted","Data":"da2761a2b22f26d51c5b48ad262dcce455dd518c182d16ccaf81ec589884416d"}
Jul 27 19:43:18.525524 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:18.525411    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc" event={"ID":"14eff10c-bf90-4e03-8b65-e65f0645a0f1","Type":"ContainerStarted","Data":"9ecfa85328452f4d1672e7aa2579593b3d8e5d667e211b718b433f107ca92202"}
Jul 27 19:43:18.541479 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:18.541431    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc" podStartSLOduration=1.541416401 podStartE2EDuration="1.541416401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:18.540902227 +0000 UTC m=+2285.248041719" watchObservedRunningTime="2026-07-27 19:43:18.541416401 +0000 UTC m=+2285.248555929"
Jul 27 19:43:19.533368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:19.533335    2557 generic.go:356] "Generic (PLEG): container finished" podID="14eff10c-bf90-4e03-8b65-e65f0645a0f1" containerID="da2761a2b22f26d51c5b48ad262dcce455dd518c182d16ccaf81ec589884416d" exitCode=0
Jul 27 19:43:19.533799 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:19.533467    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc" event={"ID":"14eff10c-bf90-4e03-8b65-e65f0645a0f1","Type":"ContainerDied","Data":"da2761a2b22f26d51c5b48ad262dcce455dd518c182d16ccaf81ec589884416d"}
Jul 27 19:43:20.675011 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:20.674985    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"
Jul 27 19:43:20.728022 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:20.727990    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14eff10c-bf90-4e03-8b65-e65f0645a0f1-maas-api-service-ca\") pod \"14eff10c-bf90-4e03-8b65-e65f0645a0f1\" (UID: \"14eff10c-bf90-4e03-8b65-e65f0645a0f1\") "
Jul 27 19:43:20.728304 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:20.728284    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14eff10c-bf90-4e03-8b65-e65f0645a0f1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "14eff10c-bf90-4e03-8b65-e65f0645a0f1" (UID: "14eff10c-bf90-4e03-8b65-e65f0645a0f1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:20.829529 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:20.829436    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14eff10c-bf90-4e03-8b65-e65f0645a0f1-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:21.546888 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:21.546856    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"
Jul 27 19:43:21.546888 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:21.546877    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc" event={"ID":"14eff10c-bf90-4e03-8b65-e65f0645a0f1","Type":"ContainerDied","Data":"9ecfa85328452f4d1672e7aa2579593b3d8e5d667e211b718b433f107ca92202"}
Jul 27 19:43:21.547078 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:21.546924    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ecfa85328452f4d1672e7aa2579593b3d8e5d667e211b718b433f107ca92202"
Jul 27 19:43:22.555939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.555908    2557 generic.go:356] "Generic (PLEG): container finished" podID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerID="d6ba521c3124132cefe4944a795775b90df8e96bffa516c83cc0d8779214c33a" exitCode=0
Jul 27 19:43:22.556339 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.555954    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" event={"ID":"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0","Type":"ContainerDied","Data":"d6ba521c3124132cefe4944a795775b90df8e96bffa516c83cc0d8779214c33a"}
Jul 27 19:43:22.556339 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.556016    2557 scope.go:117] "RemoveContainer" containerID="361917777f4a439dc907990cde78c9aeb1efbe4f2a4788d45e175062e9881261"
Jul 27 19:43:22.635212 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.635185    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:43:22.644554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644513    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgggw\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-kube-api-access-mgggw\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644554 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644544    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istiod-ca-cert\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644575    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-envoy\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644601    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-podinfo\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644621    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-certs\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644658    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-credential-socket\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644683    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-token\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644707    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-data\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644764    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-socket\") pod \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\" (UID: \"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0\") "
Jul 27 19:43:22.644989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644971    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:22.644989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.644978    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:22.645203 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.645005    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:22.645203 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.645132    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-certs\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:22.645203 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.645186    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-credential-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:22.645203 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.645203    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istiod-ca-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:22.645582 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.645202    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:22.646094 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.646067    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:22.646880 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.646851    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:22.647013 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.646997    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:43:22.647090 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.647077    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-kube-api-access-mgggw" (OuterVolumeSpecName: "kube-api-access-mgggw") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "kube-api-access-mgggw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:22.647147 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.647091    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" (UID: "3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:22.746368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.746341    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-envoy\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:22.746368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.746364    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-podinfo\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:22.746368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.746374    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:22.746586 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.746382    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-istio-data\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:22.746586 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.746390    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-workload-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:22.746586 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:22.746399    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgggw\" (UniqueName: \"kubernetes.io/projected/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0-kube-api-access-mgggw\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:23.563281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:23.563247    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"
Jul 27 19:43:23.563726 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:23.563294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx" event={"ID":"3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0","Type":"ContainerDied","Data":"b51f70ebea894102e9709ea00d8f31df8f5bfc95ac2f8474cf4a3de79bf5caf3"}
Jul 27 19:43:23.563726 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:23.563348    2557 scope.go:117] "RemoveContainer" containerID="d6ba521c3124132cefe4944a795775b90df8e96bffa516c83cc0d8779214c33a"
Jul 27 19:43:23.588082 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:23.588055    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"]
Jul 27 19:43:23.591968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:23.591945    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-944fa0-openshift-default-5459778df6-b9dnx"]
Jul 27 19:43:23.791287 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:23.791257    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" path="/var/lib/kubelet/pods/3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0/volumes"
Jul 27 19:43:33.278294 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.278260    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"]
Jul 27 19:43:33.278923 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.278452    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8" podUID="2cb89170-b811-4e9a-bec7-059626ddd2d5" containerName="payload-pre-processing" containerID="cri-o://20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2" gracePeriod=30
Jul 27 19:43:33.406949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.406920    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"]
Jul 27 19:43:33.410051 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.410029    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-74909c-ghhfc"]
Jul 27 19:43:33.543520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.543467    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:43:33.625279 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.625245    2557 generic.go:356] "Generic (PLEG): container finished" podID="2cb89170-b811-4e9a-bec7-059626ddd2d5" containerID="20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2" exitCode=0
Jul 27 19:43:33.625436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.625291    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"
Jul 27 19:43:33.625436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.625334    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8" event={"ID":"2cb89170-b811-4e9a-bec7-059626ddd2d5","Type":"ContainerDied","Data":"20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2"}
Jul 27 19:43:33.625436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.625392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8" event={"ID":"2cb89170-b811-4e9a-bec7-059626ddd2d5","Type":"ContainerDied","Data":"7410d91af34f5dee06a9572b2f753e80df5ff578b29f4062f61eaa76c762078c"}
Jul 27 19:43:33.625436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.625417    2557 scope.go:117] "RemoveContainer" containerID="20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2"
Jul 27 19:43:33.634714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.634699    2557 scope.go:117] "RemoveContainer" containerID="20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2"
Jul 27 19:43:33.635027 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:43:33.635005    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2\": container with ID starting with 20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2 not found: ID does not exist" containerID="20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2"
Jul 27 19:43:33.635106 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.635040    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2"} err="failed to get container status \"20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2\": rpc error: code = NotFound desc = could not find container \"20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2\": container with ID starting with 20024736d0834ee02e8fe7451371d65605fb5901873e73f433ef4d0cea5731e2 not found: ID does not exist"
Jul 27 19:43:33.648619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.648603    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln28z\" (UniqueName: \"kubernetes.io/projected/2cb89170-b811-4e9a-bec7-059626ddd2d5-kube-api-access-ln28z\") pod \"2cb89170-b811-4e9a-bec7-059626ddd2d5\" (UID: \"2cb89170-b811-4e9a-bec7-059626ddd2d5\") "
Jul 27 19:43:33.648688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.648647    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cb89170-b811-4e9a-bec7-059626ddd2d5-plugins-config-volume\") pod \"2cb89170-b811-4e9a-bec7-059626ddd2d5\" (UID: \"2cb89170-b811-4e9a-bec7-059626ddd2d5\") "
Jul 27 19:43:33.649028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.649005    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb89170-b811-4e9a-bec7-059626ddd2d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2cb89170-b811-4e9a-bec7-059626ddd2d5" (UID: "2cb89170-b811-4e9a-bec7-059626ddd2d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:33.650697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.650678    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb89170-b811-4e9a-bec7-059626ddd2d5-kube-api-access-ln28z" (OuterVolumeSpecName: "kube-api-access-ln28z") pod "2cb89170-b811-4e9a-bec7-059626ddd2d5" (UID: "2cb89170-b811-4e9a-bec7-059626ddd2d5"). InnerVolumeSpecName "kube-api-access-ln28z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:33.749317 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.749277    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cb89170-b811-4e9a-bec7-059626ddd2d5-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:33.749317 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.749309    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln28z\" (UniqueName: \"kubernetes.io/projected/2cb89170-b811-4e9a-bec7-059626ddd2d5-kube-api-access-ln28z\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:43:33.791594 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.791559    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14eff10c-bf90-4e03-8b65-e65f0645a0f1" path="/var/lib/kubelet/pods/14eff10c-bf90-4e03-8b65-e65f0645a0f1/volumes"
Jul 27 19:43:33.945774 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.945744    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"]
Jul 27 19:43:33.950230 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:33.950204    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-74909c-556b798db4-vgwt8"]
Jul 27 19:43:35.790911 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:35.790876    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb89170-b811-4e9a-bec7-059626ddd2d5" path="/var/lib/kubelet/pods/2cb89170-b811-4e9a-bec7-059626ddd2d5/volumes"
Jul 27 19:43:37.867081 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:37.867048    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:43:40.893059 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893013    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"]
Jul 27 19:43:40.893485 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893472    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14eff10c-bf90-4e03-8b65-e65f0645a0f1" containerName="revoke-keys"
Jul 27 19:43:40.893533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893486    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="14eff10c-bf90-4e03-8b65-e65f0645a0f1" containerName="revoke-keys"
Jul 27 19:43:40.893533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893502    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb89170-b811-4e9a-bec7-059626ddd2d5" containerName="payload-pre-processing"
Jul 27 19:43:40.893533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893508    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb89170-b811-4e9a-bec7-059626ddd2d5" containerName="payload-pre-processing"
Jul 27 19:43:40.893533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893525    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy"
Jul 27 19:43:40.893533 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893530    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy"
Jul 27 19:43:40.893688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893599    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy"
Jul 27 19:43:40.893688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893607    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="14eff10c-bf90-4e03-8b65-e65f0645a0f1" containerName="revoke-keys"
Jul 27 19:43:40.893688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893613    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy"
Jul 27 19:43:40.893688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.893620    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cb89170-b811-4e9a-bec7-059626ddd2d5" containerName="payload-pre-processing"
Jul 27 19:43:40.898344 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.898326    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:40.900650 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.900629    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b4cd12-openshift-default-dockercfg-59g4t\""
Jul 27 19:43:40.907697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:40.907674    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"]
Jul 27 19:43:41.014626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014584    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-credential-socket\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.014626 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014618    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-data\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.014883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0f56d5-c954-4398-9511-92bd60911538-istio-podinfo\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.014883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014711    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-envoy\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.014883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0f56d5-c954-4398-9511-92bd60911538-istiod-ca-cert\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.014883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014774    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-istio-token\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.014883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-socket\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.015083 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-certs\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.015083 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.014994    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-kube-api-access-jjzwt\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.115649 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115612    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0f56d5-c954-4398-9511-92bd60911538-istiod-ca-cert\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.115847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-istio-token\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.115847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-socket\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.115847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115704    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-certs\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.115847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-kube-api-access-jjzwt\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.115847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-credential-socket\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.115847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-data\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.115847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115788    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0f56d5-c954-4398-9511-92bd60911538-istio-podinfo\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.116221 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.115875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-envoy\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.116221 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.116183    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-certs\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.116292 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.116262    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-credential-socket\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.116344 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.116313    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-data\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.116401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.116354    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-socket\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.116401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.116361    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0f56d5-c954-4398-9511-92bd60911538-istiod-ca-cert\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.118194 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.118177    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-envoy\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.118674 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.118652    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0f56d5-c954-4398-9511-92bd60911538-istio-podinfo\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.124068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.124040    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-istio-token\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.124242 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.124223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-kube-api-access-jjzwt\") pod \"e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") " pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.210140 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.210111    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:41.351444 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.351422    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"]
Jul 27 19:43:41.353577 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:43:41.353552    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0f56d5_c954_4398_9511_92bd60911538.slice/crio-c0c7663b05f6952ec64c8d6161089b1adf743b62a797b8043d22508931643966 WatchSource:0}: Error finding container c0c7663b05f6952ec64c8d6161089b1adf743b62a797b8043d22508931643966: Status 404 returned error can't find the container with id c0c7663b05f6952ec64c8d6161089b1adf743b62a797b8043d22508931643966
Jul 27 19:43:41.355684 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.355648    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:41.355760 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.355715    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:41.355760 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.355751    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:41.677092 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.676999    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" event={"ID":"9b0f56d5-c954-4398-9511-92bd60911538","Type":"ContainerStarted","Data":"e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1"}
Jul 27 19:43:41.677092 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.677058    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" event={"ID":"9b0f56d5-c954-4398-9511-92bd60911538","Type":"ContainerStarted","Data":"c0c7663b05f6952ec64c8d6161089b1adf743b62a797b8043d22508931643966"}
Jul 27 19:43:41.702786 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:41.702737    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" podStartSLOduration=1.7027222499999999 podStartE2EDuration="1.70272225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:41.700149622 +0000 UTC m=+2308.407289115" watchObservedRunningTime="2026-07-27 19:43:41.70272225 +0000 UTC m=+2308.409861745"
Jul 27 19:43:42.210321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:42.210284    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:42.215602 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:42.215579    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:42.683578 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:42.683541    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:42.684576 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:42.684555    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:48.869972 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:48.869936    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:43:53.421276 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.421237    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"]
Jul 27 19:43:53.421697 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.421682    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy"
Jul 27 19:43:53.421742 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.421698    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0ec1e5-ad88-4e57-9fdc-e8ab2f5f1ef0" containerName="istio-proxy"
Jul 27 19:43:53.425010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.424989    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:53.427620 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.427600    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-70aa40\""
Jul 27 19:43:53.427735 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.427653    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-70aa40-dockercfg-7gmp6\""
Jul 27 19:43:53.433402 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.433375    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"]
Jul 27 19:43:53.532106 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.532065    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh92f\" (UniqueName: \"kubernetes.io/projected/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-kube-api-access-vh92f\") pod \"payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j\" (UID: \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:53.532278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.532193    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j\" (UID: \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:53.633638 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.633595    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh92f\" (UniqueName: \"kubernetes.io/projected/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-kube-api-access-vh92f\") pod \"payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j\" (UID: \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:53.633868 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.633700    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j\" (UID: \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:53.634477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.634456    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j\" (UID: \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:53.642122 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.642094    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh92f\" (UniqueName: \"kubernetes.io/projected/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-kube-api-access-vh92f\") pod \"payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j\" (UID: \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:53.737546 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.737506    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:53.928720 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:53.928687    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"]
Jul 27 19:43:53.928838 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:43:53.928686    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46485d8_e28b_4c24_bbe1_9786f1fdfaef.slice/crio-3b3d105303af85afe9e9f9603594d6d1a132da4039fbf767610e5a1eccb93878 WatchSource:0}: Error finding container 3b3d105303af85afe9e9f9603594d6d1a132da4039fbf767610e5a1eccb93878: Status 404 returned error can't find the container with id 3b3d105303af85afe9e9f9603594d6d1a132da4039fbf767610e5a1eccb93878
Jul 27 19:43:54.760432 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:54.760394    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j" event={"ID":"e46485d8-e28b-4c24-bbe1-9786f1fdfaef","Type":"ContainerStarted","Data":"b55f990a895a8db29812c616a3aa3db69ecd183ae4ee2798e2bad2b2be261ad2"}
Jul 27 19:43:54.760949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:54.760450    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j" event={"ID":"e46485d8-e28b-4c24-bbe1-9786f1fdfaef","Type":"ContainerStarted","Data":"3b3d105303af85afe9e9f9603594d6d1a132da4039fbf767610e5a1eccb93878"}
Jul 27 19:43:54.760949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:54.760478    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:43:54.778859 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:54.778785    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j" podStartSLOduration=1.7787676289999999 podStartE2EDuration="1.778767629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:54.776399509 +0000 UTC m=+2321.483539001" watchObservedRunningTime="2026-07-27 19:43:54.778767629 +0000 UTC m=+2321.485907121"
Jul 27 19:43:57.563485 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.563443    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:43:57.685147 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.685116    2557 patch_prober.go:28] interesting pod/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Jul 27 19:43:57.685306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.685179    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Jul 27 19:43:57.784402 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.784371    2557 generic.go:356] "Generic (PLEG): container finished" podID="9b0f56d5-c954-4398-9511-92bd60911538" containerID="e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1" exitCode=0
Jul 27 19:43:57.789791 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.789766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" event={"ID":"9b0f56d5-c954-4398-9511-92bd60911538","Type":"ContainerDied","Data":"e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1"}
Jul 27 19:43:57.790192 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.790166    2557 scope.go:117] "RemoveContainer" containerID="e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1"
Jul 27 19:43:57.791306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.791270    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:57.791388 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.791348    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:57.791388 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:57.791380    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:58.798451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:58.798413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" event={"ID":"9b0f56d5-c954-4398-9511-92bd60911538","Type":"ContainerStarted","Data":"d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a"}
Jul 27 19:43:59.211081 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:59.211036    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:43:59.211521 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:59.211493    2557 patch_prober.go:28] interesting pod/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Jul 27 19:43:59.211627 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:43:59.211565    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Jul 27 19:44:00.211130 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:00.211091    2557 patch_prober.go:28] interesting pod/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Jul 27 19:44:00.211713 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:00.211677    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Jul 27 19:44:01.211110 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:01.211066    2557 patch_prober.go:28] interesting pod/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Jul 27 19:44:01.211320 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:01.211131    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Jul 27 19:44:02.211368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:02.210856    2557 patch_prober.go:28] interesting pod/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Jul 27 19:44:02.211368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:02.210939    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Jul 27 19:44:03.214535 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:03.214499    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:44:03.215052 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:03.215036    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:44:03.215568 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:03.215548    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:44:05.770613 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:05.770580    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:44:13.658417 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:13.658385    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:44:57.667477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:44:57.667430    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:45:00.138604 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.138569    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"]
Jul 27 19:45:00.142598 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.142581    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"]
Jul 27 19:45:00.142715 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.142694    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"
Jul 27 19:45:00.145126 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.145108    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:45:00.145866 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.145851    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b"]
Jul 27 19:45:00.145979 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.145965    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"
Jul 27 19:45:00.150398 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.150379    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b"
Jul 27 19:45:00.153187 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.153165    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"]
Jul 27 19:45:00.157757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.157734    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b"]
Jul 27 19:45:00.158333 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.158306    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"
Jul 27 19:45:00.167687 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.167667    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"
Jul 27 19:45:00.171906 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.171884    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"]
Jul 27 19:45:00.205883 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.205855    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b"
Jul 27 19:45:00.334129 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.334095    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"]
Jul 27 19:45:00.335375 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:45:00.335349    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e136ce4_6731_4c09_88cf_a598f9824c23.slice/crio-825571534e142c43457aa2254d4e192f6c06906c793be2e1b5d6f5ce96997b69 WatchSource:0}: Error finding container 825571534e142c43457aa2254d4e192f6c06906c793be2e1b5d6f5ce96997b69: Status 404 returned error can't find the container with id 825571534e142c43457aa2254d4e192f6c06906c793be2e1b5d6f5ce96997b69
Jul 27 19:45:00.395004 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.394981    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b"]
Jul 27 19:45:00.396025 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:45:00.395998    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6c5c6f_c598_47e4_9eb1_5218fb853bda.slice/crio-3289a94fc9b16be6847b93e72ccb28bdbc452329399a2503c19dfca55bddafff WatchSource:0}: Error finding container 3289a94fc9b16be6847b93e72ccb28bdbc452329399a2503c19dfca55bddafff: Status 404 returned error can't find the container with id 3289a94fc9b16be6847b93e72ccb28bdbc452329399a2503c19dfca55bddafff
Jul 27 19:45:00.569728 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:00.569705    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"]
Jul 27 19:45:00.570991 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:45:00.570957    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f82fe9_264c_423a_b686_e44183195a34.slice/crio-d57ab6c85fbf4f1ae5296df94bbc5fa288e8aa4b103d9f9f16e13809bb4b8e92 WatchSource:0}: Error finding container d57ab6c85fbf4f1ae5296df94bbc5fa288e8aa4b103d9f9f16e13809bb4b8e92: Status 404 returned error can't find the container with id d57ab6c85fbf4f1ae5296df94bbc5fa288e8aa4b103d9f9f16e13809bb4b8e92
Jul 27 19:45:01.200296 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.200242    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b" event={"ID":"2d6c5c6f-c598-47e4-9eb1-5218fb853bda","Type":"ContainerStarted","Data":"ebcf0c4f3be159ff8ee80cfea4d8b7d95f947472d514f79c6ab9cc21ff6ae7db"}
Jul 27 19:45:01.200713 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.200312    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b" event={"ID":"2d6c5c6f-c598-47e4-9eb1-5218fb853bda","Type":"ContainerStarted","Data":"3289a94fc9b16be6847b93e72ccb28bdbc452329399a2503c19dfca55bddafff"}
Jul 27 19:45:01.210389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.210355    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77" event={"ID":"43f82fe9-264c-423a-b686-e44183195a34","Type":"ContainerStarted","Data":"d4cea863e937ad6ad45a46108ccca06e6aa60fb34e0aa2efec2e1e09be1090af"}
Jul 27 19:45:01.210552 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.210429    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77" event={"ID":"43f82fe9-264c-423a-b686-e44183195a34","Type":"ContainerStarted","Data":"d57ab6c85fbf4f1ae5296df94bbc5fa288e8aa4b103d9f9f16e13809bb4b8e92"}
Jul 27 19:45:01.211988 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.211964    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw" event={"ID":"4e136ce4-6731-4c09-88cf-a598f9824c23","Type":"ContainerStarted","Data":"12905e26908680d27fe11dfd87939e1bb80ef0fa09c9eff77b97dfa2b17a9a66"}
Jul 27 19:45:01.212091 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.212003    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw" event={"ID":"4e136ce4-6731-4c09-88cf-a598f9824c23","Type":"ContainerStarted","Data":"825571534e142c43457aa2254d4e192f6c06906c793be2e1b5d6f5ce96997b69"}
Jul 27 19:45:01.217334 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.217290    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b" podStartSLOduration=1.217277193 podStartE2EDuration="1.217277193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:45:01.213960928 +0000 UTC m=+2387.921100420" watchObservedRunningTime="2026-07-27 19:45:01.217277193 +0000 UTC m=+2387.924416684"
Jul 27 19:45:01.228089 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.228053    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77" podStartSLOduration=1.22804158 podStartE2EDuration="1.22804158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:45:01.226743809 +0000 UTC m=+2387.933883299" watchObservedRunningTime="2026-07-27 19:45:01.22804158 +0000 UTC m=+2387.935181070"
Jul 27 19:45:01.241309 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:01.241272    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw" podStartSLOduration=1.241259731 podStartE2EDuration="1.241259731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:45:01.239678223 +0000 UTC m=+2387.946817727" watchObservedRunningTime="2026-07-27 19:45:01.241259731 +0000 UTC m=+2387.948399222"
Jul 27 19:45:02.219763 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:02.219730    2557 generic.go:356] "Generic (PLEG): container finished" podID="2d6c5c6f-c598-47e4-9eb1-5218fb853bda" containerID="ebcf0c4f3be159ff8ee80cfea4d8b7d95f947472d514f79c6ab9cc21ff6ae7db" exitCode=0
Jul 27 19:45:02.220290 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:02.219872    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b" event={"ID":"2d6c5c6f-c598-47e4-9eb1-5218fb853bda","Type":"ContainerDied","Data":"ebcf0c4f3be159ff8ee80cfea4d8b7d95f947472d514f79c6ab9cc21ff6ae7db"}
Jul 27 19:45:02.221400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:02.221377    2557 generic.go:356] "Generic (PLEG): container finished" podID="43f82fe9-264c-423a-b686-e44183195a34" containerID="d4cea863e937ad6ad45a46108ccca06e6aa60fb34e0aa2efec2e1e09be1090af" exitCode=0
Jul 27 19:45:02.221507 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:02.221443    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77" event={"ID":"43f82fe9-264c-423a-b686-e44183195a34","Type":"ContainerDied","Data":"d4cea863e937ad6ad45a46108ccca06e6aa60fb34e0aa2efec2e1e09be1090af"}
Jul 27 19:45:02.222848 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:02.222802    2557 generic.go:356] "Generic (PLEG): container finished" podID="4e136ce4-6731-4c09-88cf-a598f9824c23" containerID="12905e26908680d27fe11dfd87939e1bb80ef0fa09c9eff77b97dfa2b17a9a66" exitCode=0
Jul 27 19:45:02.222944 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:02.222852    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw" event={"ID":"4e136ce4-6731-4c09-88cf-a598f9824c23","Type":"ContainerDied","Data":"12905e26908680d27fe11dfd87939e1bb80ef0fa09c9eff77b97dfa2b17a9a66"}
Jul 27 19:45:03.376446 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:03.376420    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b"
Jul 27 19:45:03.436336 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:03.436312    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"
Jul 27 19:45:03.439477 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:03.439456    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"
Jul 27 19:45:04.235987 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.235956    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"
Jul 27 19:45:04.236193 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.236002    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw" event={"ID":"4e136ce4-6731-4c09-88cf-a598f9824c23","Type":"ContainerDied","Data":"825571534e142c43457aa2254d4e192f6c06906c793be2e1b5d6f5ce96997b69"}
Jul 27 19:45:04.236193 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.236053    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="825571534e142c43457aa2254d4e192f6c06906c793be2e1b5d6f5ce96997b69"
Jul 27 19:45:04.237400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.237379    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b"
Jul 27 19:45:04.237534 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.237421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753025-mq95b" event={"ID":"2d6c5c6f-c598-47e4-9eb1-5218fb853bda","Type":"ContainerDied","Data":"3289a94fc9b16be6847b93e72ccb28bdbc452329399a2503c19dfca55bddafff"}
Jul 27 19:45:04.237534 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.237457    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3289a94fc9b16be6847b93e72ccb28bdbc452329399a2503c19dfca55bddafff"
Jul 27 19:45:04.239027 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.239003    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77" event={"ID":"43f82fe9-264c-423a-b686-e44183195a34","Type":"ContainerDied","Data":"d57ab6c85fbf4f1ae5296df94bbc5fa288e8aa4b103d9f9f16e13809bb4b8e92"}
Jul 27 19:45:04.239133 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.239051    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d57ab6c85fbf4f1ae5296df94bbc5fa288e8aa4b103d9f9f16e13809bb4b8e92"
Jul 27 19:45:04.239133 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:04.239016    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"
Jul 27 19:45:13.976742 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:13.976713    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:45:13.982106 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:13.982085    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:45:13.983975 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:13.983958    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:45:13.988959 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:13.988945    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:45:14.809690 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:14.809663    2557 scope.go:117] "RemoveContainer" containerID="263a19e42c5d10dd486d9ef52fcef01629ded2a0ff234e30773d2ff2f7dad4d4"
Jul 27 19:45:24.467510 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:24.467468    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:45:50.470799 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:45:50.470720    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:46:08.072934 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:46:08.072896    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:46:20.257753 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:46:20.257713    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:46:42.666447 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:46:42.666413    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:47:00.163818 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:47:00.163772    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:47:27.473760 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:47:27.473723    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:47:44.969444 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:47:44.969410    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:47:57.160374 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:47:57.160339    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:48:14.852098 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:48:14.852066    2557 scope.go:117] "RemoveContainer" containerID="33b0b60f11948d0c7cd21583de20317f0e4dc2a7981a35dae879cf59f6bbd54c"
Jul 27 19:48:14.864526 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:48:14.864502    2557 scope.go:117] "RemoveContainer" containerID="c789d6fa576ba4fc6513f26fcb2bf98ca9db0c599099a5f2749b5d0b2dc5e2b5"
Jul 27 19:48:17.465718 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:48:17.465687    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:48:35.264407 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:48:35.264326    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:48:58.872962 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:48:58.872925    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:49:14.891465 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:49:14.891430    2557 scope.go:117] "RemoveContainer" containerID="c3fc0b2c7bcaa3a4b3fa800d440a1bdb95ddafadb4d8ed69a1e11a3e782fddb0"
Jul 27 19:49:16.466511 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:49:16.466478    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:49:41.865750 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:49:41.865715    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:49:57.358962 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:49:57.358932    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:50:10.364846 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:50:10.364725    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:50:14.025473 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:50:14.025445    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:50:14.031278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:50:14.031258    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:50:14.032058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:50:14.032038    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:50:14.036714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:50:14.036697    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:50:14.917850 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:50:14.917792    2557 scope.go:117] "RemoveContainer" containerID="da2761a2b22f26d51c5b48ad262dcce455dd518c182d16ccaf81ec589884416d"
Jul 27 19:50:24.959714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:50:24.959676    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:50:56.556680 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:50:56.556644    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:51:13.769967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:51:13.769931    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:51:34.462257 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:51:34.462177    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:51:51.358691 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:51:51.358649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:52:33.060134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:52:33.060092    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:53:04.060909 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:04.060832    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:53:18.556110 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:18.556073    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:53:33.255632 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:33.255591    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:53:38.866312 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.866271    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7705-140660634950576"]
Jul 27 19:53:38.867011 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.866992    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f82fe9-264c-423a-b686-e44183195a34" containerName="cleanup"
Jul 27 19:53:38.867100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.867012    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f82fe9-264c-423a-b686-e44183195a34" containerName="cleanup"
Jul 27 19:53:38.867100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.867035    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e136ce4-6731-4c09-88cf-a598f9824c23" containerName="cleanup"
Jul 27 19:53:38.867100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.867043    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e136ce4-6731-4c09-88cf-a598f9824c23" containerName="cleanup"
Jul 27 19:53:38.867100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.867058    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d6c5c6f-c598-47e4-9eb1-5218fb853bda" containerName="cleanup"
Jul 27 19:53:38.867100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.867067    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6c5c6f-c598-47e4-9eb1-5218fb853bda" containerName="cleanup"
Jul 27 19:53:38.867351 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.867174    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f82fe9-264c-423a-b686-e44183195a34" containerName="cleanup"
Jul 27 19:53:38.867351 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.867190    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d6c5c6f-c598-47e4-9eb1-5218fb853bda" containerName="cleanup"
Jul 27 19:53:38.867351 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.867204    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e136ce4-6731-4c09-88cf-a598f9824c23" containerName="cleanup"
Jul 27 19:53:38.870559 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.870538    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660634950576"
Jul 27 19:53:38.873152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.873130    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8p9gv\""
Jul 27 19:53:38.876775 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.876751    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660634950576"]
Jul 27 19:53:38.944373 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:38.944344    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkmtm\" (UniqueName: \"kubernetes.io/projected/ca8e7c40-8056-409e-b527-128757cca267-kube-api-access-nkmtm\") pod \"test-curl-7705-140660634950576\" (UID: \"ca8e7c40-8056-409e-b527-128757cca267\") " pod="opendatahub/test-curl-7705-140660634950576"
Jul 27 19:53:39.045588 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:39.045552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkmtm\" (UniqueName: \"kubernetes.io/projected/ca8e7c40-8056-409e-b527-128757cca267-kube-api-access-nkmtm\") pod \"test-curl-7705-140660634950576\" (UID: \"ca8e7c40-8056-409e-b527-128757cca267\") " pod="opendatahub/test-curl-7705-140660634950576"
Jul 27 19:53:39.053311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:39.053285    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkmtm\" (UniqueName: \"kubernetes.io/projected/ca8e7c40-8056-409e-b527-128757cca267-kube-api-access-nkmtm\") pod \"test-curl-7705-140660634950576\" (UID: \"ca8e7c40-8056-409e-b527-128757cca267\") " pod="opendatahub/test-curl-7705-140660634950576"
Jul 27 19:53:39.181091 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:39.181066    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660634950576"
Jul 27 19:53:39.526696 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:39.526671    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660634950576"]
Jul 27 19:53:39.527120 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:53:39.527101    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca8e7c40_8056_409e_b527_128757cca267.slice/crio-125df4956e6bc793db0f2c0a5818db0054568704a2216cdd77e7be1705641d54 WatchSource:0}: Error finding container 125df4956e6bc793db0f2c0a5818db0054568704a2216cdd77e7be1705641d54: Status 404 returned error can't find the container with id 125df4956e6bc793db0f2c0a5818db0054568704a2216cdd77e7be1705641d54
Jul 27 19:53:39.528423 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:39.528403    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:53:40.435237 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:40.435195    2557 generic.go:356] "Generic (PLEG): container finished" podID="ca8e7c40-8056-409e-b527-128757cca267" containerID="00d2cfec87283114f1e194bd0f752ecbc1f0a0cf58608ec96f32bb16af1caf3f" exitCode=0
Jul 27 19:53:40.435653 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:40.435250    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660634950576" event={"ID":"ca8e7c40-8056-409e-b527-128757cca267","Type":"ContainerDied","Data":"00d2cfec87283114f1e194bd0f752ecbc1f0a0cf58608ec96f32bb16af1caf3f"}
Jul 27 19:53:40.435653 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:40.435286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660634950576" event={"ID":"ca8e7c40-8056-409e-b527-128757cca267","Type":"ContainerStarted","Data":"125df4956e6bc793db0f2c0a5818db0054568704a2216cdd77e7be1705641d54"}
Jul 27 19:53:41.584184 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.584159    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660634950576"
Jul 27 19:53:41.619769 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.619744    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7705-140660634950576_ca8e7c40-8056-409e-b527-128757cca267/test-curl-7705-140660634950576/0.log"
Jul 27 19:53:41.651722 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.649933    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7705-140660634950576"]
Jul 27 19:53:41.656925 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.656894    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7705-140660634950576"]
Jul 27 19:53:41.666194 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.666171    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkmtm\" (UniqueName: \"kubernetes.io/projected/ca8e7c40-8056-409e-b527-128757cca267-kube-api-access-nkmtm\") pod \"ca8e7c40-8056-409e-b527-128757cca267\" (UID: \"ca8e7c40-8056-409e-b527-128757cca267\") "
Jul 27 19:53:41.668324 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.668299    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca8e7c40-8056-409e-b527-128757cca267-kube-api-access-nkmtm" (OuterVolumeSpecName: "kube-api-access-nkmtm") pod "ca8e7c40-8056-409e-b527-128757cca267" (UID: "ca8e7c40-8056-409e-b527-128757cca267"). InnerVolumeSpecName "kube-api-access-nkmtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:53:41.767072 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.766988    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkmtm\" (UniqueName: \"kubernetes.io/projected/ca8e7c40-8056-409e-b527-128757cca267-kube-api-access-nkmtm\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:53:41.791434 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.791402    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca8e7c40-8056-409e-b527-128757cca267" path="/var/lib/kubelet/pods/ca8e7c40-8056-409e-b527-128757cca267/volumes"
Jul 27 19:53:41.795123 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.795101    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7705-140660634947888"]
Jul 27 19:53:41.795527 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.795513    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8e7c40-8056-409e-b527-128757cca267" containerName="test-curl-7705-140660634950576"
Jul 27 19:53:41.795583 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.795528    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8e7c40-8056-409e-b527-128757cca267" containerName="test-curl-7705-140660634950576"
Jul 27 19:53:41.795629 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.795607    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca8e7c40-8056-409e-b527-128757cca267" containerName="test-curl-7705-140660634950576"
Jul 27 19:53:41.799058 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.798976    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660634947888"
Jul 27 19:53:41.804451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.804431    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660634947888"]
Jul 27 19:53:41.868381 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.868342    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nrqz\" (UniqueName: \"kubernetes.io/projected/4eed9128-60c6-4e21-a814-f500c46eb7a0-kube-api-access-4nrqz\") pod \"test-curl-7705-140660634947888\" (UID: \"4eed9128-60c6-4e21-a814-f500c46eb7a0\") " pod="opendatahub/test-curl-7705-140660634947888"
Jul 27 19:53:41.969259 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.969203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nrqz\" (UniqueName: \"kubernetes.io/projected/4eed9128-60c6-4e21-a814-f500c46eb7a0-kube-api-access-4nrqz\") pod \"test-curl-7705-140660634947888\" (UID: \"4eed9128-60c6-4e21-a814-f500c46eb7a0\") " pod="opendatahub/test-curl-7705-140660634947888"
Jul 27 19:53:41.976574 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:41.976541    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nrqz\" (UniqueName: \"kubernetes.io/projected/4eed9128-60c6-4e21-a814-f500c46eb7a0-kube-api-access-4nrqz\") pod \"test-curl-7705-140660634947888\" (UID: \"4eed9128-60c6-4e21-a814-f500c46eb7a0\") " pod="opendatahub/test-curl-7705-140660634947888"
Jul 27 19:53:42.109968 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:42.109884    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660634947888"
Jul 27 19:53:42.252998 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:42.252958    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660634947888"]
Jul 27 19:53:42.253129 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:53:42.252955    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eed9128_60c6_4e21_a814_f500c46eb7a0.slice/crio-84ecace1fbdeb53a0b3812f944b3ccdd2d1ab62cf2b6ca39b25b810581df8626 WatchSource:0}: Error finding container 84ecace1fbdeb53a0b3812f944b3ccdd2d1ab62cf2b6ca39b25b810581df8626: Status 404 returned error can't find the container with id 84ecace1fbdeb53a0b3812f944b3ccdd2d1ab62cf2b6ca39b25b810581df8626
Jul 27 19:53:42.448710 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:42.448678    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660634950576"
Jul 27 19:53:42.448959 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:42.448718    2557 scope.go:117] "RemoveContainer" containerID="00d2cfec87283114f1e194bd0f752ecbc1f0a0cf58608ec96f32bb16af1caf3f"
Jul 27 19:53:42.450217 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:42.450185    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660634947888" event={"ID":"4eed9128-60c6-4e21-a814-f500c46eb7a0","Type":"ContainerStarted","Data":"84ecace1fbdeb53a0b3812f944b3ccdd2d1ab62cf2b6ca39b25b810581df8626"}
Jul 27 19:53:43.459126 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:43.459093    2557 generic.go:356] "Generic (PLEG): container finished" podID="4eed9128-60c6-4e21-a814-f500c46eb7a0" containerID="ae62fda899a0dc6450fb048eb9cb6ab0298be3647c997f301d404ddf7cf02380" exitCode=0
Jul 27 19:53:43.459512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:43.459168    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660634947888" event={"ID":"4eed9128-60c6-4e21-a814-f500c46eb7a0","Type":"ContainerDied","Data":"ae62fda899a0dc6450fb048eb9cb6ab0298be3647c997f301d404ddf7cf02380"}
Jul 27 19:53:44.607721 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.607696    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660634947888"
Jul 27 19:53:44.629277 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.629246    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7705-140660634947888_4eed9128-60c6-4e21-a814-f500c46eb7a0/test-curl-7705-140660634947888/0.log"
Jul 27 19:53:44.655827 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.655780    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7705-140660634947888"]
Jul 27 19:53:44.659181 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.659157    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7705-140660634947888"]
Jul 27 19:53:44.692320 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.692297    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nrqz\" (UniqueName: \"kubernetes.io/projected/4eed9128-60c6-4e21-a814-f500c46eb7a0-kube-api-access-4nrqz\") pod \"4eed9128-60c6-4e21-a814-f500c46eb7a0\" (UID: \"4eed9128-60c6-4e21-a814-f500c46eb7a0\") "
Jul 27 19:53:44.694873 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.694847    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eed9128-60c6-4e21-a814-f500c46eb7a0-kube-api-access-4nrqz" (OuterVolumeSpecName: "kube-api-access-4nrqz") pod "4eed9128-60c6-4e21-a814-f500c46eb7a0" (UID: "4eed9128-60c6-4e21-a814-f500c46eb7a0"). InnerVolumeSpecName "kube-api-access-4nrqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:53:44.794327 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.794266    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nrqz\" (UniqueName: \"kubernetes.io/projected/4eed9128-60c6-4e21-a814-f500c46eb7a0-kube-api-access-4nrqz\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:53:44.837043 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.837012    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:44.837471 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.837457    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eed9128-60c6-4e21-a814-f500c46eb7a0" containerName="test-curl-7705-140660634947888"
Jul 27 19:53:44.837518 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.837474    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eed9128-60c6-4e21-a814-f500c46eb7a0" containerName="test-curl-7705-140660634947888"
Jul 27 19:53:44.837562 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.837553    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eed9128-60c6-4e21-a814-f500c46eb7a0" containerName="test-curl-7705-140660634947888"
Jul 27 19:53:44.840766 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.840744    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:44.845924 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.845902    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:44.895596 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.895556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69v2x\" (UniqueName: \"kubernetes.io/projected/72421456-c33b-4a71-af83-083cbad47be6-kube-api-access-69v2x\") pod \"test-curl-7705-140660637755264\" (UID: \"72421456-c33b-4a71-af83-083cbad47be6\") " pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:44.996704 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:44.996677    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69v2x\" (UniqueName: \"kubernetes.io/projected/72421456-c33b-4a71-af83-083cbad47be6-kube-api-access-69v2x\") pod \"test-curl-7705-140660637755264\" (UID: \"72421456-c33b-4a71-af83-083cbad47be6\") " pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:45.005195 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:45.005170    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69v2x\" (UniqueName: \"kubernetes.io/projected/72421456-c33b-4a71-af83-083cbad47be6-kube-api-access-69v2x\") pod \"test-curl-7705-140660637755264\" (UID: \"72421456-c33b-4a71-af83-083cbad47be6\") " pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:45.151546 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:45.151459    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:45.287210 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:45.287185    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:45.288095 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:53:45.288069    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72421456_c33b_4a71_af83_083cbad47be6.slice/crio-106e548cb7c5fba28878b9073599a50ac169b1c0a53071de96befbde78fc3c26 WatchSource:0}: Error finding container 106e548cb7c5fba28878b9073599a50ac169b1c0a53071de96befbde78fc3c26: Status 404 returned error can't find the container with id 106e548cb7c5fba28878b9073599a50ac169b1c0a53071de96befbde78fc3c26
Jul 27 19:53:45.472667 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:45.472639    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660634947888"
Jul 27 19:53:45.472860 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:45.472683    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84ecace1fbdeb53a0b3812f944b3ccdd2d1ab62cf2b6ca39b25b810581df8626"
Jul 27 19:53:45.474026 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:45.473989    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660637755264" event={"ID":"72421456-c33b-4a71-af83-083cbad47be6","Type":"ContainerStarted","Data":"106e548cb7c5fba28878b9073599a50ac169b1c0a53071de96befbde78fc3c26"}
Jul 27 19:53:45.483466 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:53:45.483442    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7705-140660634947888\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="4eed9128-60c6-4e21-a814-f500c46eb7a0" pod="opendatahub/test-curl-7705-140660634947888"
Jul 27 19:53:45.791245 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:45.791164    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eed9128-60c6-4e21-a814-f500c46eb7a0" path="/var/lib/kubelet/pods/4eed9128-60c6-4e21-a814-f500c46eb7a0/volumes"
Jul 27 19:53:46.481711 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:46.481675    2557 generic.go:356] "Generic (PLEG): container finished" podID="72421456-c33b-4a71-af83-083cbad47be6" containerID="1a5a630ea82a3063ed9b514872eaf1dd9b6d4dc0dcc8db88a242b470bf3178f6" exitCode=0
Jul 27 19:53:46.481903 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:46.481743    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660637755264" event={"ID":"72421456-c33b-4a71-af83-083cbad47be6","Type":"ContainerDied","Data":"1a5a630ea82a3063ed9b514872eaf1dd9b6d4dc0dcc8db88a242b470bf3178f6"}
Jul 27 19:53:47.632407 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.632380    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:47.653679 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.653654    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7705-140660637755264_72421456-c33b-4a71-af83-083cbad47be6/test-curl-7705-140660637755264/0.log"
Jul 27 19:53:47.682927 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.682903    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:47.686875 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.686854    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:47.723636 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.723617    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69v2x\" (UniqueName: \"kubernetes.io/projected/72421456-c33b-4a71-af83-083cbad47be6-kube-api-access-69v2x\") pod \"72421456-c33b-4a71-af83-083cbad47be6\" (UID: \"72421456-c33b-4a71-af83-083cbad47be6\") "
Jul 27 19:53:47.725860 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.725833    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72421456-c33b-4a71-af83-083cbad47be6-kube-api-access-69v2x" (OuterVolumeSpecName: "kube-api-access-69v2x") pod "72421456-c33b-4a71-af83-083cbad47be6" (UID: "72421456-c33b-4a71-af83-083cbad47be6"). InnerVolumeSpecName "kube-api-access-69v2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:53:47.791191 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.791127    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72421456-c33b-4a71-af83-083cbad47be6" path="/var/lib/kubelet/pods/72421456-c33b-4a71-af83-083cbad47be6/volumes"
Jul 27 19:53:47.819667 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.819648    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:47.820102 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.820089    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72421456-c33b-4a71-af83-083cbad47be6" containerName="test-curl-7705-140660637755264"
Jul 27 19:53:47.820154 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.820104    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="72421456-c33b-4a71-af83-083cbad47be6" containerName="test-curl-7705-140660637755264"
Jul 27 19:53:47.820195 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.820166    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="72421456-c33b-4a71-af83-083cbad47be6" containerName="test-curl-7705-140660637755264"
Jul 27 19:53:47.823424 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.823409    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:47.825176 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.825158    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69v2x\" (UniqueName: \"kubernetes.io/projected/72421456-c33b-4a71-af83-083cbad47be6-kube-api-access-69v2x\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:53:47.830597 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.830525    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:47.926185 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:47.926122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpt2p\" (UniqueName: \"kubernetes.io/projected/6b43d05e-f584-49a0-81c0-57f18a4ab1bf-kube-api-access-xpt2p\") pod \"test-curl-7705-140660637755264\" (UID: \"6b43d05e-f584-49a0-81c0-57f18a4ab1bf\") " pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:48.027432 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:48.027397    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpt2p\" (UniqueName: \"kubernetes.io/projected/6b43d05e-f584-49a0-81c0-57f18a4ab1bf-kube-api-access-xpt2p\") pod \"test-curl-7705-140660637755264\" (UID: \"6b43d05e-f584-49a0-81c0-57f18a4ab1bf\") " pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:48.036949 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:48.036919    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpt2p\" (UniqueName: \"kubernetes.io/projected/6b43d05e-f584-49a0-81c0-57f18a4ab1bf-kube-api-access-xpt2p\") pod \"test-curl-7705-140660637755264\" (UID: \"6b43d05e-f584-49a0-81c0-57f18a4ab1bf\") " pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:48.133757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:48.133690    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:48.273170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:48.273147    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:48.273684 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:53:48.273658    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b43d05e_f584_49a0_81c0_57f18a4ab1bf.slice/crio-93b39ea8687f878f1b9ddd5132985c4b58406519116c0f93a078a25377fba8ab WatchSource:0}: Error finding container 93b39ea8687f878f1b9ddd5132985c4b58406519116c0f93a078a25377fba8ab: Status 404 returned error can't find the container with id 93b39ea8687f878f1b9ddd5132985c4b58406519116c0f93a078a25377fba8ab
Jul 27 19:53:48.495130 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:48.495096    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660637755264" event={"ID":"6b43d05e-f584-49a0-81c0-57f18a4ab1bf","Type":"ContainerStarted","Data":"93b39ea8687f878f1b9ddd5132985c4b58406519116c0f93a078a25377fba8ab"}
Jul 27 19:53:48.496279 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:48.496259    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:48.496401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:48.496302    2557 scope.go:117] "RemoveContainer" containerID="1a5a630ea82a3063ed9b514872eaf1dd9b6d4dc0dcc8db88a242b470bf3178f6"
Jul 27 19:53:48.659745 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:48.659714    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:53:49.505011 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:49.504975    2557 generic.go:356] "Generic (PLEG): container finished" podID="6b43d05e-f584-49a0-81c0-57f18a4ab1bf" containerID="d1a5188367af5c489cb0c81035302d4c97f664d309e923d0b5dad304a1b9b034" exitCode=0
Jul 27 19:53:49.505216 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:49.505031    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660637755264" event={"ID":"6b43d05e-f584-49a0-81c0-57f18a4ab1bf","Type":"ContainerDied","Data":"d1a5188367af5c489cb0c81035302d4c97f664d309e923d0b5dad304a1b9b034"}
Jul 27 19:53:50.661346 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.661324    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:50.681900 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.681858    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7705-140660637755264_6b43d05e-f584-49a0-81c0-57f18a4ab1bf/test-curl-7705-140660637755264/0.log"
Jul 27 19:53:50.710256 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.710232    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:50.713693 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.713673    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7705-140660637755264"]
Jul 27 19:53:50.750497 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.750476    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpt2p\" (UniqueName: \"kubernetes.io/projected/6b43d05e-f584-49a0-81c0-57f18a4ab1bf-kube-api-access-xpt2p\") pod \"6b43d05e-f584-49a0-81c0-57f18a4ab1bf\" (UID: \"6b43d05e-f584-49a0-81c0-57f18a4ab1bf\") "
Jul 27 19:53:50.754841 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.753463    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b43d05e-f584-49a0-81c0-57f18a4ab1bf-kube-api-access-xpt2p" (OuterVolumeSpecName: "kube-api-access-xpt2p") pod "6b43d05e-f584-49a0-81c0-57f18a4ab1bf" (UID: "6b43d05e-f584-49a0-81c0-57f18a4ab1bf"). InnerVolumeSpecName "kube-api-access-xpt2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:53:50.840075 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.840002    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:50.840472 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.840458    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b43d05e-f584-49a0-81c0-57f18a4ab1bf" containerName="test-curl-7705-140660637755264"
Jul 27 19:53:50.840512 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.840475    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b43d05e-f584-49a0-81c0-57f18a4ab1bf" containerName="test-curl-7705-140660637755264"
Jul 27 19:53:50.840566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.840557    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b43d05e-f584-49a0-81c0-57f18a4ab1bf" containerName="test-curl-7705-140660637755264"
Jul 27 19:53:50.843721 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.843693    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:50.848113 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.848086    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:50.851570 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.851545    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpt2p\" (UniqueName: \"kubernetes.io/projected/6b43d05e-f584-49a0-81c0-57f18a4ab1bf-kube-api-access-xpt2p\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:53:50.952712 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:50.952668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qssgd\" (UniqueName: \"kubernetes.io/projected/cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431-kube-api-access-qssgd\") pod \"test-curl-7705-140660635170400\" (UID: \"cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431\") " pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:51.053505 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:51.053472    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qssgd\" (UniqueName: \"kubernetes.io/projected/cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431-kube-api-access-qssgd\") pod \"test-curl-7705-140660635170400\" (UID: \"cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431\") " pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:51.062498 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:51.062468    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qssgd\" (UniqueName: \"kubernetes.io/projected/cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431-kube-api-access-qssgd\") pod \"test-curl-7705-140660635170400\" (UID: \"cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431\") " pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:51.154295 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:51.154223    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:51.295777 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:51.295741    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:51.296106 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:53:51.296075    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb2883c3_07a7_45ee_a2b3_a4dc7b2f2431.slice/crio-afacb4367219ae0a92b84b68d7e7d8fe19b196afa682332682321d762780761d WatchSource:0}: Error finding container afacb4367219ae0a92b84b68d7e7d8fe19b196afa682332682321d762780761d: Status 404 returned error can't find the container with id afacb4367219ae0a92b84b68d7e7d8fe19b196afa682332682321d762780761d
Jul 27 19:53:51.521277 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:51.521241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660635170400" event={"ID":"cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431","Type":"ContainerStarted","Data":"afacb4367219ae0a92b84b68d7e7d8fe19b196afa682332682321d762780761d"}
Jul 27 19:53:51.522543 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:51.522525    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93b39ea8687f878f1b9ddd5132985c4b58406519116c0f93a078a25377fba8ab"
Jul 27 19:53:51.522543 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:51.522532    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:51.533409 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:53:51.533386    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7705-140660637755264\" is forbidden: User \"system:node:ip-10-0-142-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-171.ec2.internal' and this object" podUID="6b43d05e-f584-49a0-81c0-57f18a4ab1bf" pod="opendatahub/test-curl-7705-140660637755264"
Jul 27 19:53:51.791445 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:51.791376    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b43d05e-f584-49a0-81c0-57f18a4ab1bf" path="/var/lib/kubelet/pods/6b43d05e-f584-49a0-81c0-57f18a4ab1bf/volumes"
Jul 27 19:53:52.529993 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:52.529957    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431" containerID="a81b757d56baa4182195b333aec5dec702c0656b0de85c02abec72946e9448d9" exitCode=0
Jul 27 19:53:52.530152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:52.530008    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660635170400" event={"ID":"cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431","Type":"ContainerDied","Data":"a81b757d56baa4182195b333aec5dec702c0656b0de85c02abec72946e9448d9"}
Jul 27 19:53:53.679026 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:53.679001    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:53.698087 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:53.698042    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7705-140660635170400_cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431/test-curl-7705-140660635170400/0.log"
Jul 27 19:53:53.724683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:53.724651    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:53.729755 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:53.729731    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:53.779800 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:53.779776    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qssgd\" (UniqueName: \"kubernetes.io/projected/cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431-kube-api-access-qssgd\") pod \"cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431\" (UID: \"cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431\") "
Jul 27 19:53:53.781951 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:53.781928    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431-kube-api-access-qssgd" (OuterVolumeSpecName: "kube-api-access-qssgd") pod "cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431" (UID: "cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431"). InnerVolumeSpecName "kube-api-access-qssgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:53:53.791272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:53.791251    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431" path="/var/lib/kubelet/pods/cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431/volumes"
Jul 27 19:53:53.881567 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:53.881538    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qssgd\" (UniqueName: \"kubernetes.io/projected/cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431-kube-api-access-qssgd\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:53:54.544141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:54.544111    2557 scope.go:117] "RemoveContainer" containerID="a81b757d56baa4182195b333aec5dec702c0656b0de85c02abec72946e9448d9"
Jul 27 19:53:54.544141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:54.544134    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:57.358069 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.358033    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"]
Jul 27 19:53:57.358488 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.358475    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431" containerName="test-curl-7705-140660635170400"
Jul 27 19:53:57.358539 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.358505    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431" containerName="test-curl-7705-140660635170400"
Jul 27 19:53:57.358608 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.358595    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2883c3-07a7-45ee-a2b3-a4dc7b2f2431" containerName="test-curl-7705-140660635170400"
Jul 27 19:53:57.363329 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.363311    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.365743 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.365723    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-f227a8-openshift-default-dockercfg-nj6t6\""
Jul 27 19:53:57.374721 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.374698    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"]
Jul 27 19:53:57.417780 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.417747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9bx\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-kube-api-access-mq9bx\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.417780 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.417781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-credential-socket\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.417989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.417846    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-podinfo\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.417989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.417891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-data\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.417989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.417934    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istiod-ca-cert\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.417989 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.417977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-certs\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.418155 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.417995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-envoy\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.418155 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.418024    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-token\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.418155 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.418049    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-socket\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9bx\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-kube-api-access-mq9bx\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519068 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-credential-socket\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519113    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-podinfo\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519157    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-data\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istiod-ca-cert\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519236    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-certs\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-envoy\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-token\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519334    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-socket\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519552    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-credential-socket\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519605    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-data\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519634    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-certs\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.519785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.519762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-socket\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.520052 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.520028    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istiod-ca-cert\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.521707 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.521682    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-envoy\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.521942 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.521926    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-podinfo\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.527055 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.527025    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-token\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.527179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.527160    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9bx\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-kube-api-access-mq9bx\") pod \"e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") " pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.675225 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.675145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:57.823099 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:53:57.823069    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8daccb_b5e2_4aa7_98a1_29fe513fdf85.slice/crio-1331a5df47e51759b09f6fc4a1284f76c76d08a4f29df4ec32657c80a1dd05f7 WatchSource:0}: Error finding container 1331a5df47e51759b09f6fc4a1284f76c76d08a4f29df4ec32657c80a1dd05f7: Status 404 returned error can't find the container with id 1331a5df47e51759b09f6fc4a1284f76c76d08a4f29df4ec32657c80a1dd05f7
Jul 27 19:53:57.823265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.823241    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"]
Jul 27 19:53:57.825497 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.825467    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:53:57.825559 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.825534    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:53:57.825594 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:57.825563    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:53:58.571151 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:58.571116    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" event={"ID":"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85","Type":"ContainerStarted","Data":"5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac"}
Jul 27 19:53:58.571495 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:58.571173    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" event={"ID":"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85","Type":"ContainerStarted","Data":"1331a5df47e51759b09f6fc4a1284f76c76d08a4f29df4ec32657c80a1dd05f7"}
Jul 27 19:53:58.593396 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:58.593340    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" podStartSLOduration=1.5933260759999999 podStartE2EDuration="1.593326076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:53:58.590889421 +0000 UTC m=+2925.298028912" watchObservedRunningTime="2026-07-27 19:53:58.593326076 +0000 UTC m=+2925.300465627"
Jul 27 19:53:58.675683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:58.675657    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:58.680600 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:58.680579    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:59.577437 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:59.577405    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:53:59.579880 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:53:59.578323    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:54:09.658774 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:09.658737    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:54:16.410329 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.410297    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"]
Jul 27 19:54:16.416375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.416356    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.419155 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.419133    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-b78801-openshift-default-dockercfg-jh2qk\""
Jul 27 19:54:16.435785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.435756    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"]
Jul 27 19:54:16.510801 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.510767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-istio-token\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.511016 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.510880    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-envoy\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.511016 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.510909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9002582-5a74-4c94-a077-629dda01f48b-istiod-ca-cert\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.511016 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.510932    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnchm\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-kube-api-access-bnchm\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.511179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.511001    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-credential-socket\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.511179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.511051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9002582-5a74-4c94-a077-629dda01f48b-istio-podinfo\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.511179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.511088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-socket\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.511323 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.511204    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-certs\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.511323 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.511238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-data\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612103 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612069    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-envoy\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612103 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612104    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9002582-5a74-4c94-a077-629dda01f48b-istiod-ca-cert\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612120    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnchm\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-kube-api-access-bnchm\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-credential-socket\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9002582-5a74-4c94-a077-629dda01f48b-istio-podinfo\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-socket\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-certs\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612254    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-data\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-istio-token\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612647    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-certs\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612742    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-data\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612916 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612853    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-credential-socket\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.612974 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.612937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-socket\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.613373 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.613338    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9002582-5a74-4c94-a077-629dda01f48b-istiod-ca-cert\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.614928 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.614896    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9002582-5a74-4c94-a077-629dda01f48b-istio-podinfo\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.615041 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.615016    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-envoy\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.620530 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.620509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-istio-token\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.620961 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.620941    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnchm\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-kube-api-access-bnchm\") pod \"e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") " pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.727370 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.727338    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:16.893506 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.893476    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"]
Jul 27 19:54:16.894239 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:54:16.894211    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9002582_5a74_4c94_a077_629dda01f48b.slice/crio-221bc855466ba280b99ea5f47763e241e5896aed646c173cbb5ea7b1c4fdd76f WatchSource:0}: Error finding container 221bc855466ba280b99ea5f47763e241e5896aed646c173cbb5ea7b1c4fdd76f: Status 404 returned error can't find the container with id 221bc855466ba280b99ea5f47763e241e5896aed646c173cbb5ea7b1c4fdd76f
Jul 27 19:54:16.896669 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.896634    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:16.896770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.896715    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:16.896770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:16.896758    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:17.706347 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.706316    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" event={"ID":"c9002582-5a74-4c94-a077-629dda01f48b","Type":"ContainerStarted","Data":"9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2"}
Jul 27 19:54:17.706798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.706376    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" event={"ID":"c9002582-5a74-4c94-a077-629dda01f48b","Type":"ContainerStarted","Data":"221bc855466ba280b99ea5f47763e241e5896aed646c173cbb5ea7b1c4fdd76f"}
Jul 27 19:54:17.707917 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.707896    2557 generic.go:356] "Generic (PLEG): container finished" podID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerID="5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac" exitCode=0
Jul 27 19:54:17.708010 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.707961    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" event={"ID":"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85","Type":"ContainerDied","Data":"5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac"}
Jul 27 19:54:17.708305 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.708293    2557 scope.go:117] "RemoveContainer" containerID="5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac"
Jul 27 19:54:17.709303 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.709267    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:17.709392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.709353    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:17.709392 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.709389    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:17.727483 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.727462    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:17.730131 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.730094    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" podStartSLOduration=1.730080401 podStartE2EDuration="1.730080401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:17.72792595 +0000 UTC m=+2944.435065439" watchObservedRunningTime="2026-07-27 19:54:17.730080401 +0000 UTC m=+2944.437219892"
Jul 27 19:54:17.733896 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:17.733874    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:18.718070 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:18.718035    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" event={"ID":"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85","Type":"ContainerStarted","Data":"e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33"}
Jul 27 19:54:18.718451 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:18.718274    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:18.719343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:18.719321    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:19.675577 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:19.675544    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:54:19.675865 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:19.675843    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Jul 27 19:54:19.675926 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:19.675890    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Jul 27 19:54:20.676358 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:20.676323    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Jul 27 19:54:20.676757 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:20.676376    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Jul 27 19:54:21.676284 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:21.676252    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Jul 27 19:54:21.676457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:21.676302    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Jul 27 19:54:22.679042 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:22.679012    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:54:22.679435 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:22.679417    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:54:22.680136 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:22.680117    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:54:28.267485 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:28.267454    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:54:34.760017 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:34.759930    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 19:54:34.760017 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:34.760007    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:54:36.851641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:36.851603    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9002582-5a74-4c94-a077-629dda01f48b" containerID="9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2" exitCode=0
Jul 27 19:54:36.852375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:36.851677    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" event={"ID":"c9002582-5a74-4c94-a077-629dda01f48b","Type":"ContainerDied","Data":"9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2"}
Jul 27 19:54:36.852375 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:36.852118    2557 scope.go:117] "RemoveContainer" containerID="9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2"
Jul 27 19:54:36.853164 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:36.853136    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:36.853235 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:36.853202    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:36.853273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:36.853235    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:54:37.860664 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:37.860630    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" event={"ID":"c9002582-5a74-4c94-a077-629dda01f48b","Type":"ContainerStarted","Data":"925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded"}
Jul 27 19:54:38.728141 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:38.728103    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:38.728371 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:38.728348    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Jul 27 19:54:38.728447 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:38.728397    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Jul 27 19:54:39.727963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:39.727931    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Jul 27 19:54:39.728415 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:39.727987    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Jul 27 19:54:40.728032 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:40.727996    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Jul 27 19:54:40.728471 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:40.728057    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Jul 27 19:54:41.728769 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:41.728725    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Jul 27 19:54:41.729280 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:41.728827    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Jul 27 19:54:42.732276 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:42.732244    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:42.732739 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:42.732718    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:42.733355 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:42.733339    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:54:51.828423 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:54:51.828371    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pfwms_5f7c4ef4-3c7d-472f-b9a4-e32600630f91/payload-processing/0.log"
Jul 27 19:55:10.869623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:10.869589    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:55:14.069266 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:14.069241    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:55:14.074837 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:14.074768    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:55:14.077717 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:14.077697    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:55:14.082702 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:14.082687    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjqns_37ae55c3-ad1a-47fc-8490-c56c7f411f43/ovn-acl-logging/0.log"
Jul 27 19:55:37.768637 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:37.768606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:55:47.447439 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:47.447404    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pfwms_5f7c4ef4-3c7d-472f-b9a4-e32600630f91/payload-processing/0.log"
Jul 27 19:55:52.764862 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:52.764829    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"]
Jul 27 19:55:52.768592 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:52.768568    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:52.771371 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:52.771347    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-3ff2a8-serving-cert\""
Jul 27 19:55:52.771371 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:52.771359    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t9v8k\""
Jul 27 19:55:52.779794 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:52.779769    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"]
Jul 27 19:55:52.908853 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:52.908785    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84gkh\" (UniqueName: \"kubernetes.io/projected/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-kube-api-access-84gkh\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:52.909024 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:52.908918    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:52.909074 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:52.909055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.010175 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.010135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84gkh\" (UniqueName: \"kubernetes.io/projected/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-kube-api-access-84gkh\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.010335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.010196    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.010335 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.010269    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.010410 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:55:53.010351    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-serving-cert: secret "maas-api-e2e-ipp-cleanup-3ff2a8-serving-cert" not found
Jul 27 19:55:53.010450 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:55:53.010423    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls podName:5a44d121-abd3-46c5-8ac0-d6b5f94a36eb nodeName:}" failed. No retries permitted until 2026-07-27 19:55:53.510404458 +0000 UTC m=+3040.217543928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv" (UID: "5a44d121-abd3-46c5-8ac0-d6b5f94a36eb") : secret "maas-api-e2e-ipp-cleanup-3ff2a8-serving-cert" not found
Jul 27 19:55:53.010839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.010801    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.019321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.019262    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84gkh\" (UniqueName: \"kubernetes.io/projected/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-kube-api-access-84gkh\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.397516 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.397437    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"]
Jul 27 19:55:53.401499 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.401482    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:53.404167 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.404143    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-3ff2a8\""
Jul 27 19:55:53.404284 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.404143    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-3ff2a8-dockercfg-h7w6k\""
Jul 27 19:55:53.415184 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.415162    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"]
Jul 27 19:55:53.515788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.515747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a77eb61c-ca8a-4323-a8ea-c995c81641c1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj\" (UID: \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:53.515977 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.515841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.515977 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.515866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mgbm\" (UniqueName: \"kubernetes.io/projected/a77eb61c-ca8a-4323-a8ea-c995c81641c1-kube-api-access-2mgbm\") pod \"payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj\" (UID: \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:53.518367 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.518349    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.616699 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.616654    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a77eb61c-ca8a-4323-a8ea-c995c81641c1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj\" (UID: \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:53.616944 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.616752    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mgbm\" (UniqueName: \"kubernetes.io/projected/a77eb61c-ca8a-4323-a8ea-c995c81641c1-kube-api-access-2mgbm\") pod \"payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj\" (UID: \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:53.617450 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.617429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a77eb61c-ca8a-4323-a8ea-c995c81641c1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj\" (UID: \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:53.625914 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.625891    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mgbm\" (UniqueName: \"kubernetes.io/projected/a77eb61c-ca8a-4323-a8ea-c995c81641c1-kube-api-access-2mgbm\") pod \"payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj\" (UID: \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:53.682251 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.682227    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:53.715242 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.715210    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:53.873188 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:53.873160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"]
Jul 27 19:55:53.873579 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:55:53.873509    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77eb61c_ca8a_4323_a8ea_c995c81641c1.slice/crio-ddd95c221db0d5ce8f88b2136f42e832e3f37b4f69040a2bc17b8ef7adb2dac4 WatchSource:0}: Error finding container ddd95c221db0d5ce8f88b2136f42e832e3f37b4f69040a2bc17b8ef7adb2dac4: Status 404 returned error can't find the container with id ddd95c221db0d5ce8f88b2136f42e832e3f37b4f69040a2bc17b8ef7adb2dac4
Jul 27 19:55:54.057946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:54.057860    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"]
Jul 27 19:55:54.058073 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:55:54.057965    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a44d121_abd3_46c5_8ac0_d6b5f94a36eb.slice/crio-66a8df256f4f1e72578f95499cb487af0be34b3f7cf8e473150677595eb8b84f WatchSource:0}: Error finding container 66a8df256f4f1e72578f95499cb487af0be34b3f7cf8e473150677595eb8b84f: Status 404 returned error can't find the container with id 66a8df256f4f1e72578f95499cb487af0be34b3f7cf8e473150677595eb8b84f
Jul 27 19:55:54.358227 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:54.358113    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj" event={"ID":"a77eb61c-ca8a-4323-a8ea-c995c81641c1","Type":"ContainerStarted","Data":"dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df"}
Jul 27 19:55:54.358405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:54.358286    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:55:54.358405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:54.358342    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj" event={"ID":"a77eb61c-ca8a-4323-a8ea-c995c81641c1","Type":"ContainerStarted","Data":"ddd95c221db0d5ce8f88b2136f42e832e3f37b4f69040a2bc17b8ef7adb2dac4"}
Jul 27 19:55:54.359380 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:54.359359    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv" event={"ID":"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb","Type":"ContainerStarted","Data":"66a8df256f4f1e72578f95499cb487af0be34b3f7cf8e473150677595eb8b84f"}
Jul 27 19:55:54.376280 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:54.376243    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj" podStartSLOduration=1.376229952 podStartE2EDuration="1.376229952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:54.37469508 +0000 UTC m=+3041.081834572" watchObservedRunningTime="2026-07-27 19:55:54.376229952 +0000 UTC m=+3041.083369443"
Jul 27 19:55:55.375197 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:55.375151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv" event={"ID":"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb","Type":"ContainerStarted","Data":"e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b"}
Jul 27 19:55:55.375692 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:55.375350    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:55:55.394671 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:55.394624    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv" podStartSLOduration=2.932568194 podStartE2EDuration="3.394609478s" totalImagesPullingTime="462.041284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:55.39098262 +0000 UTC m=+3042.098122111" watchObservedRunningTime="2026-07-27 19:55:55.394609478 +0000 UTC m=+3042.101748968"
Jul 27 19:55:57.477661 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:55:57.477626    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:56:01.387395 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:01.387360    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:56:05.377177 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:05.377101    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:56:17.603403 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:17.603368    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"]
Jul 27 19:56:17.608515 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:17.608495    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"
Jul 27 19:56:17.610803 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:17.610780    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:56:17.616200 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:17.616164    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"]
Jul 27 19:56:17.643862 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:17.643833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756239b-9f77-441f-a2bb-ea326d161f20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c\" (UID: \"f756239b-9f77-441f-a2bb-ea326d161f20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"
Jul 27 19:56:17.744967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:17.744935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756239b-9f77-441f-a2bb-ea326d161f20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c\" (UID: \"f756239b-9f77-441f-a2bb-ea326d161f20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"
Jul 27 19:56:17.745575 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:17.745554    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756239b-9f77-441f-a2bb-ea326d161f20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c\" (UID: \"f756239b-9f77-441f-a2bb-ea326d161f20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"
Jul 27 19:56:17.922187 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:17.922105    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"
Jul 27 19:56:18.072484 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:18.072453    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"]
Jul 27 19:56:18.072818 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:56:18.072787    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf756239b_9f77_441f_a2bb_ea326d161f20.slice/crio-3d27a9653c8853bd5fd427b1f85f181c9849c16a5a15c3c713b6a67069c309f1 WatchSource:0}: Error finding container 3d27a9653c8853bd5fd427b1f85f181c9849c16a5a15c3c713b6a67069c309f1: Status 404 returned error can't find the container with id 3d27a9653c8853bd5fd427b1f85f181c9849c16a5a15c3c713b6a67069c309f1
Jul 27 19:56:18.532148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:18.532104    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c" event={"ID":"f756239b-9f77-441f-a2bb-ea326d161f20","Type":"ContainerStarted","Data":"edf5c3a19fcd78eb1a2f1771700e89fcad6b31931c3254b099b284a7845bc97a"}
Jul 27 19:56:18.532354 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:18.532165    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c" event={"ID":"f756239b-9f77-441f-a2bb-ea326d161f20","Type":"ContainerStarted","Data":"3d27a9653c8853bd5fd427b1f85f181c9849c16a5a15c3c713b6a67069c309f1"}
Jul 27 19:56:18.548136 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:18.548090    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c" podStartSLOduration=1.5480771089999998 podStartE2EDuration="1.548077109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:18.547742007 +0000 UTC m=+3065.254881511" watchObservedRunningTime="2026-07-27 19:56:18.548077109 +0000 UTC m=+3065.255216600"
Jul 27 19:56:19.541006 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:19.540975    2557 generic.go:356] "Generic (PLEG): container finished" podID="f756239b-9f77-441f-a2bb-ea326d161f20" containerID="edf5c3a19fcd78eb1a2f1771700e89fcad6b31931c3254b099b284a7845bc97a" exitCode=0
Jul 27 19:56:19.541401 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:19.541072    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c" event={"ID":"f756239b-9f77-441f-a2bb-ea326d161f20","Type":"ContainerDied","Data":"edf5c3a19fcd78eb1a2f1771700e89fcad6b31931c3254b099b284a7845bc97a"}
Jul 27 19:56:20.696419 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:20.696396    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"
Jul 27 19:56:20.776906 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:20.776874    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756239b-9f77-441f-a2bb-ea326d161f20-maas-api-service-ca\") pod \"f756239b-9f77-441f-a2bb-ea326d161f20\" (UID: \"f756239b-9f77-441f-a2bb-ea326d161f20\") "
Jul 27 19:56:20.777239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:20.777218    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f756239b-9f77-441f-a2bb-ea326d161f20-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f756239b-9f77-441f-a2bb-ea326d161f20" (UID: "f756239b-9f77-441f-a2bb-ea326d161f20"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:20.878060 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:20.877966    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756239b-9f77-441f-a2bb-ea326d161f20-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:56:21.555932 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:21.555898    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"
Jul 27 19:56:21.556134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:21.555939    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c" event={"ID":"f756239b-9f77-441f-a2bb-ea326d161f20","Type":"ContainerDied","Data":"3d27a9653c8853bd5fd427b1f85f181c9849c16a5a15c3c713b6a67069c309f1"}
Jul 27 19:56:21.556134 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:21.555984    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d27a9653c8853bd5fd427b1f85f181c9849c16a5a15c3c713b6a67069c309f1"
Jul 27 19:56:27.822623 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:27.822569    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"]
Jul 27 19:56:27.823100 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:27.822846    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv" podUID="5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" containerName="maas-api" containerID="cri-o://e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b" gracePeriod=30
Jul 27 19:56:27.894026 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:27.893990    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"]
Jul 27 19:56:27.894293 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:27.894244    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj" podUID="a77eb61c-ca8a-4323-a8ea-c995c81641c1" containerName="payload-processing" containerID="cri-o://dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df" gracePeriod=30
Jul 27 19:56:28.038269 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.038235    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"]
Jul 27 19:56:28.043568 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.043388    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3ff2a8-2st5c"]
Jul 27 19:56:28.175919 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.175893    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:56:28.216422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.216399    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:56:28.250136 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250108    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-openshift-service-ca\") pod \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") "
Jul 27 19:56:28.250306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250169    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a77eb61c-ca8a-4323-a8ea-c995c81641c1-plugins-config-volume\") pod \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\" (UID: \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\") "
Jul 27 19:56:28.250306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250221    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls\") pod \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") "
Jul 27 19:56:28.250306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250257    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mgbm\" (UniqueName: \"kubernetes.io/projected/a77eb61c-ca8a-4323-a8ea-c995c81641c1-kube-api-access-2mgbm\") pod \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\" (UID: \"a77eb61c-ca8a-4323-a8ea-c995c81641c1\") "
Jul 27 19:56:28.250306 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250290    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84gkh\" (UniqueName: \"kubernetes.io/projected/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-kube-api-access-84gkh\") pod \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\" (UID: \"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb\") "
Jul 27 19:56:28.250550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250513    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" (UID: "5a44d121-abd3-46c5-8ac0-d6b5f94a36eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:28.250550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250525    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77eb61c-ca8a-4323-a8ea-c995c81641c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a77eb61c-ca8a-4323-a8ea-c995c81641c1" (UID: "a77eb61c-ca8a-4323-a8ea-c995c81641c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:28.250724 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250702    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-openshift-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.250797 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.250731    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a77eb61c-ca8a-4323-a8ea-c995c81641c1-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.252877 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.252800    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77eb61c-ca8a-4323-a8ea-c995c81641c1-kube-api-access-2mgbm" (OuterVolumeSpecName: "kube-api-access-2mgbm") pod "a77eb61c-ca8a-4323-a8ea-c995c81641c1" (UID: "a77eb61c-ca8a-4323-a8ea-c995c81641c1"). InnerVolumeSpecName "kube-api-access-2mgbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:28.253023 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.253004    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-kube-api-access-84gkh" (OuterVolumeSpecName: "kube-api-access-84gkh") pod "5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" (UID: "5a44d121-abd3-46c5-8ac0-d6b5f94a36eb"). InnerVolumeSpecName "kube-api-access-84gkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:28.253071 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.253027    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" (UID: "5a44d121-abd3-46c5-8ac0-d6b5f94a36eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:56:28.352021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.351987    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-maas-api-tls\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.352021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.352018    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mgbm\" (UniqueName: \"kubernetes.io/projected/a77eb61c-ca8a-4323-a8ea-c995c81641c1-kube-api-access-2mgbm\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.352021 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.352028    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84gkh\" (UniqueName: \"kubernetes.io/projected/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb-kube-api-access-84gkh\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.604430 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.604398    2557 generic.go:356] "Generic (PLEG): container finished" podID="a77eb61c-ca8a-4323-a8ea-c995c81641c1" containerID="dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df" exitCode=0
Jul 27 19:56:28.604641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.604444    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"
Jul 27 19:56:28.604641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.604491    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj" event={"ID":"a77eb61c-ca8a-4323-a8ea-c995c81641c1","Type":"ContainerDied","Data":"dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df"}
Jul 27 19:56:28.604641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.604540    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj" event={"ID":"a77eb61c-ca8a-4323-a8ea-c995c81641c1","Type":"ContainerDied","Data":"ddd95c221db0d5ce8f88b2136f42e832e3f37b4f69040a2bc17b8ef7adb2dac4"}
Jul 27 19:56:28.604641 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.604561    2557 scope.go:117] "RemoveContainer" containerID="dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df"
Jul 27 19:56:28.606242 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.606216    2557 generic.go:356] "Generic (PLEG): container finished" podID="5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" containerID="e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b" exitCode=0
Jul 27 19:56:28.606350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.606263    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv" event={"ID":"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb","Type":"ContainerDied","Data":"e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b"}
Jul 27 19:56:28.606350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.606299    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv" event={"ID":"5a44d121-abd3-46c5-8ac0-d6b5f94a36eb","Type":"ContainerDied","Data":"66a8df256f4f1e72578f95499cb487af0be34b3f7cf8e473150677595eb8b84f"}
Jul 27 19:56:28.606350 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.606330    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"
Jul 27 19:56:28.616012 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.615993    2557 scope.go:117] "RemoveContainer" containerID="dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df"
Jul 27 19:56:28.616284 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:56:28.616258    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df\": container with ID starting with dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df not found: ID does not exist" containerID="dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df"
Jul 27 19:56:28.616377 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.616297    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df"} err="failed to get container status \"dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df\": rpc error: code = NotFound desc = could not find container \"dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df\": container with ID starting with dc6d710c00feaf17bf097373884efcd7aa25d608f67c50b89a2bcce2eaaca9df not found: ID does not exist"
Jul 27 19:56:28.616377 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.616319    2557 scope.go:117] "RemoveContainer" containerID="e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b"
Jul 27 19:56:28.625490 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.625473    2557 scope.go:117] "RemoveContainer" containerID="e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b"
Jul 27 19:56:28.625762 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:56:28.625743    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b\": container with ID starting with e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b not found: ID does not exist" containerID="e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b"
Jul 27 19:56:28.625839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.625768    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b"} err="failed to get container status \"e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b\": rpc error: code = NotFound desc = could not find container \"e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b\": container with ID starting with e4773f7e5d681a28f851ab6c80d986adc53b66274731dacd3d61817ca1fedb8b not found: ID does not exist"
Jul 27 19:56:28.632991 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.632967    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"]
Jul 27 19:56:28.637788 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.637765    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3ff2a8-57bd5df964-w2zzj"]
Jul 27 19:56:28.654033 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.654006    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"]
Jul 27 19:56:28.659961 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:28.659940    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3ff2a8-5bf8d68bdb-bqcfv"]
Jul 27 19:56:29.792573 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:29.792535    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" path="/var/lib/kubelet/pods/5a44d121-abd3-46c5-8ac0-d6b5f94a36eb/volumes"
Jul 27 19:56:29.793027 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:29.793011    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77eb61c-ca8a-4323-a8ea-c995c81641c1" path="/var/lib/kubelet/pods/a77eb61c-ca8a-4323-a8ea-c995c81641c1/volumes"
Jul 27 19:56:29.793321 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:29.793309    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f756239b-9f77-441f-a2bb-ea326d161f20" path="/var/lib/kubelet/pods/f756239b-9f77-441f-a2bb-ea326d161f20/volumes"
Jul 27 19:56:32.363791 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:32.363756    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:56:34.848034 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.847995    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vh75"]
Jul 27 19:56:34.848526 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848512    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77eb61c-ca8a-4323-a8ea-c995c81641c1" containerName="payload-processing"
Jul 27 19:56:34.848575 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848528    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77eb61c-ca8a-4323-a8ea-c995c81641c1" containerName="payload-processing"
Jul 27 19:56:34.848575 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848546    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" containerName="maas-api"
Jul 27 19:56:34.848575 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848551    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" containerName="maas-api"
Jul 27 19:56:34.848575 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848560    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f756239b-9f77-441f-a2bb-ea326d161f20" containerName="revoke-keys"
Jul 27 19:56:34.848575 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848565    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f756239b-9f77-441f-a2bb-ea326d161f20" containerName="revoke-keys"
Jul 27 19:56:34.848725 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848636    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a44d121-abd3-46c5-8ac0-d6b5f94a36eb" containerName="maas-api"
Jul 27 19:56:34.848725 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848646    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f756239b-9f77-441f-a2bb-ea326d161f20" containerName="revoke-keys"
Jul 27 19:56:34.848725 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.848654    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77eb61c-ca8a-4323-a8ea-c995c81641c1" containerName="payload-processing"
Jul 27 19:56:34.853629 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.853610    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:34.863459 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.863432    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vh75"]
Jul 27 19:56:34.915340 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:34.915309    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln6t7\" (UniqueName: \"kubernetes.io/projected/a349f230-cbcd-4a03-8ece-ba143c7fe15f-kube-api-access-ln6t7\") pod \"kuadrant-operator-catalog-2vh75\" (UID: \"a349f230-cbcd-4a03-8ece-ba143c7fe15f\") " pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:35.016835 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:35.016776    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln6t7\" (UniqueName: \"kubernetes.io/projected/a349f230-cbcd-4a03-8ece-ba143c7fe15f-kube-api-access-ln6t7\") pod \"kuadrant-operator-catalog-2vh75\" (UID: \"a349f230-cbcd-4a03-8ece-ba143c7fe15f\") " pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:35.028275 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:35.028243    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln6t7\" (UniqueName: \"kubernetes.io/projected/a349f230-cbcd-4a03-8ece-ba143c7fe15f-kube-api-access-ln6t7\") pod \"kuadrant-operator-catalog-2vh75\" (UID: \"a349f230-cbcd-4a03-8ece-ba143c7fe15f\") " pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:35.166250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:35.166161    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:35.341455 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:35.341426    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vh75"]
Jul 27 19:56:35.343257 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:56:35.343214    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda349f230_cbcd_4a03_8ece_ba143c7fe15f.slice/crio-e2819ab5eace5c39707cd09ad0d7e209c392197843825a2b1a4010a320291288 WatchSource:0}: Error finding container e2819ab5eace5c39707cd09ad0d7e209c392197843825a2b1a4010a320291288: Status 404 returned error can't find the container with id e2819ab5eace5c39707cd09ad0d7e209c392197843825a2b1a4010a320291288
Jul 27 19:56:35.659632 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:35.659590    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2vh75" event={"ID":"a349f230-cbcd-4a03-8ece-ba143c7fe15f","Type":"ContainerStarted","Data":"e2819ab5eace5c39707cd09ad0d7e209c392197843825a2b1a4010a320291288"}
Jul 27 19:56:36.666994 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:36.666958    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2vh75" event={"ID":"a349f230-cbcd-4a03-8ece-ba143c7fe15f","Type":"ContainerStarted","Data":"2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0"}
Jul 27 19:56:36.685708 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:36.685663    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2vh75" podStartSLOduration=2.337682619 podStartE2EDuration="2.685647335s" totalImagesPullingTime="347.964716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:36.681847123 +0000 UTC m=+3083.388986614" watchObservedRunningTime="2026-07-27 19:56:36.685647335 +0000 UTC m=+3083.392786826"
Jul 27 19:56:39.285514 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.285480    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"]
Jul 27 19:56:39.289457 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.289437    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"
Jul 27 19:56:39.292215 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.292194    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:56:39.297196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.297171    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"]
Jul 27 19:56:39.357168 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.357133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d32ca06-8ed7-459a-a3f1-52e7da51342e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm\" (UID: \"6d32ca06-8ed7-459a-a3f1-52e7da51342e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"
Jul 27 19:56:39.458440 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.458400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d32ca06-8ed7-459a-a3f1-52e7da51342e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm\" (UID: \"6d32ca06-8ed7-459a-a3f1-52e7da51342e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"
Jul 27 19:56:39.459161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.459127    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d32ca06-8ed7-459a-a3f1-52e7da51342e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm\" (UID: \"6d32ca06-8ed7-459a-a3f1-52e7da51342e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"
Jul 27 19:56:39.602400 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.602312    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"
Jul 27 19:56:39.756550 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:39.756516    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"]
Jul 27 19:56:39.757712 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:56:39.757679    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d32ca06_8ed7_459a_a3f1_52e7da51342e.slice/crio-8873997b69dad714cca688bace03dc9fbc54116c30d00dc2d254128af4223252 WatchSource:0}: Error finding container 8873997b69dad714cca688bace03dc9fbc54116c30d00dc2d254128af4223252: Status 404 returned error can't find the container with id 8873997b69dad714cca688bace03dc9fbc54116c30d00dc2d254128af4223252
Jul 27 19:56:40.704915 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:40.704879    2557 generic.go:356] "Generic (PLEG): container finished" podID="6d32ca06-8ed7-459a-a3f1-52e7da51342e" containerID="e02865a690cc382d93d7bc7386f4036a88cfe69ac779317461f62ae52fde7fc2" exitCode=0
Jul 27 19:56:40.705283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:40.704970    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm" event={"ID":"6d32ca06-8ed7-459a-a3f1-52e7da51342e","Type":"ContainerDied","Data":"e02865a690cc382d93d7bc7386f4036a88cfe69ac779317461f62ae52fde7fc2"}
Jul 27 19:56:40.705283 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:40.705023    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm" event={"ID":"6d32ca06-8ed7-459a-a3f1-52e7da51342e","Type":"ContainerStarted","Data":"8873997b69dad714cca688bace03dc9fbc54116c30d00dc2d254128af4223252"}
Jul 27 19:56:41.863733 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:41.863699    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"
Jul 27 19:56:41.985096 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:41.984996    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d32ca06-8ed7-459a-a3f1-52e7da51342e-maas-api-service-ca\") pod \"6d32ca06-8ed7-459a-a3f1-52e7da51342e\" (UID: \"6d32ca06-8ed7-459a-a3f1-52e7da51342e\") "
Jul 27 19:56:41.985398 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:41.985373    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d32ca06-8ed7-459a-a3f1-52e7da51342e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d32ca06-8ed7-459a-a3f1-52e7da51342e" (UID: "6d32ca06-8ed7-459a-a3f1-52e7da51342e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:42.086276 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:42.086243    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d32ca06-8ed7-459a-a3f1-52e7da51342e-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:56:42.719683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:42.719646    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"
Jul 27 19:56:42.719885 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:42.719686    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm" event={"ID":"6d32ca06-8ed7-459a-a3f1-52e7da51342e","Type":"ContainerDied","Data":"8873997b69dad714cca688bace03dc9fbc54116c30d00dc2d254128af4223252"}
Jul 27 19:56:42.719885 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:42.719767    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8873997b69dad714cca688bace03dc9fbc54116c30d00dc2d254128af4223252"
Jul 27 19:56:45.166491 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:45.166443    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:45.166967 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:45.166519    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:45.188992 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:45.188965    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:45.761093 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:45.761063    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:45.833411 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:45.833381    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vh75"]
Jul 27 19:56:47.752219 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:47.752152    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2vh75" podUID="a349f230-cbcd-4a03-8ece-ba143c7fe15f" containerName="registry-server" containerID="cri-o://2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0" gracePeriod=2
Jul 27 19:56:48.037946 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.037917    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:48.149874 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.149831    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln6t7\" (UniqueName: \"kubernetes.io/projected/a349f230-cbcd-4a03-8ece-ba143c7fe15f-kube-api-access-ln6t7\") pod \"a349f230-cbcd-4a03-8ece-ba143c7fe15f\" (UID: \"a349f230-cbcd-4a03-8ece-ba143c7fe15f\") "
Jul 27 19:56:48.152002 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.151973    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a349f230-cbcd-4a03-8ece-ba143c7fe15f-kube-api-access-ln6t7" (OuterVolumeSpecName: "kube-api-access-ln6t7") pod "a349f230-cbcd-4a03-8ece-ba143c7fe15f" (UID: "a349f230-cbcd-4a03-8ece-ba143c7fe15f"). InnerVolumeSpecName "kube-api-access-ln6t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:48.250737 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.250705    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln6t7\" (UniqueName: \"kubernetes.io/projected/a349f230-cbcd-4a03-8ece-ba143c7fe15f-kube-api-access-ln6t7\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:56:48.760278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.760248    2557 generic.go:356] "Generic (PLEG): container finished" podID="a349f230-cbcd-4a03-8ece-ba143c7fe15f" containerID="2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0" exitCode=0
Jul 27 19:56:48.760839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.760353    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2vh75"
Jul 27 19:56:48.760839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.760389    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2vh75" event={"ID":"a349f230-cbcd-4a03-8ece-ba143c7fe15f","Type":"ContainerDied","Data":"2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0"}
Jul 27 19:56:48.760839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.760440    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2vh75" event={"ID":"a349f230-cbcd-4a03-8ece-ba143c7fe15f","Type":"ContainerDied","Data":"e2819ab5eace5c39707cd09ad0d7e209c392197843825a2b1a4010a320291288"}
Jul 27 19:56:48.760839 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.760467    2557 scope.go:117] "RemoveContainer" containerID="2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0"
Jul 27 19:56:48.770950 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.770933    2557 scope.go:117] "RemoveContainer" containerID="2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0"
Jul 27 19:56:48.771199 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:56:48.771181    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0\": container with ID starting with 2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0 not found: ID does not exist" containerID="2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0"
Jul 27 19:56:48.771263 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.771212    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0"} err="failed to get container status \"2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0\": rpc error: code = NotFound desc = could not find container \"2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0\": container with ID starting with 2d4d2cdff2a9a04badff023dd0d4e0ae677f1a7f6a6994cc012835d1b46b60d0 not found: ID does not exist"
Jul 27 19:56:48.784683 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.784659    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vh75"]
Jul 27 19:56:48.789084 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:48.789064    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vh75"]
Jul 27 19:56:49.791012 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:49.790972    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a349f230-cbcd-4a03-8ece-ba143c7fe15f" path="/var/lib/kubelet/pods/a349f230-cbcd-4a03-8ece-ba143c7fe15f/volumes"
Jul 27 19:56:53.966619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:53.966586    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:56:56.968971 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:56.968937    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"]
Jul 27 19:56:56.977884 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:56.977857    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f227a8-mbxqm"]
Jul 27 19:56:57.791522 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:56:57.791481    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d32ca06-8ed7-459a-a3f1-52e7da51342e" path="/var/lib/kubelet/pods/6d32ca06-8ed7-459a-a3f1-52e7da51342e/volumes"
Jul 27 19:57:05.072239 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:05.072196    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:57:52.765196 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:52.765108    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"]
Jul 27 19:57:52.765783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:52.765318    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy" containerID="cri-o://e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33" gracePeriod=30
Jul 27 19:57:53.270465 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.270430    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"]
Jul 27 19:57:53.270921 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.270906    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a349f230-cbcd-4a03-8ece-ba143c7fe15f" containerName="registry-server"
Jul 27 19:57:53.270984 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.270923    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a349f230-cbcd-4a03-8ece-ba143c7fe15f" containerName="registry-server"
Jul 27 19:57:53.270984 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.270938    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d32ca06-8ed7-459a-a3f1-52e7da51342e" containerName="revoke-keys"
Jul 27 19:57:53.270984 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.270944    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d32ca06-8ed7-459a-a3f1-52e7da51342e" containerName="revoke-keys"
Jul 27 19:57:53.271081 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.271021    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d32ca06-8ed7-459a-a3f1-52e7da51342e" containerName="revoke-keys"
Jul 27 19:57:53.271081 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.271031    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a349f230-cbcd-4a03-8ece-ba143c7fe15f" containerName="registry-server"
Jul 27 19:57:53.274148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.274130    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"
Jul 27 19:57:53.277344 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.277328    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:57:53.290942 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.290915    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"]
Jul 27 19:57:53.398395 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.398362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236c53ac-6170-4a4c-a58d-03d7214e1af1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk\" (UID: \"236c53ac-6170-4a4c-a58d-03d7214e1af1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"
Jul 27 19:57:53.499943 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.499912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236c53ac-6170-4a4c-a58d-03d7214e1af1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk\" (UID: \"236c53ac-6170-4a4c-a58d-03d7214e1af1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"
Jul 27 19:57:53.500541 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.500520    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236c53ac-6170-4a4c-a58d-03d7214e1af1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk\" (UID: \"236c53ac-6170-4a4c-a58d-03d7214e1af1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"
Jul 27 19:57:53.584736 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.584637    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"
Jul 27 19:57:53.939657 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:53.939624    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"]
Jul 27 19:57:53.940113 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:57:53.940088    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236c53ac_6170_4a4c_a58d_03d7214e1af1.slice/crio-f0f3cfdaee72e32ab908771f4e19b446073c1f6b7df964e9556da89264d216bb WatchSource:0}: Error finding container f0f3cfdaee72e32ab908771f4e19b446073c1f6b7df964e9556da89264d216bb: Status 404 returned error can't find the container with id f0f3cfdaee72e32ab908771f4e19b446073c1f6b7df964e9556da89264d216bb
Jul 27 19:57:54.198464 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:54.198434    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk" event={"ID":"236c53ac-6170-4a4c-a58d-03d7214e1af1","Type":"ContainerStarted","Data":"f0f3cfdaee72e32ab908771f4e19b446073c1f6b7df964e9556da89264d216bb"}
Jul 27 19:57:54.714373 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:57:54.714339    2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236c53ac_6170_4a4c_a58d_03d7214e1af1.slice/crio-conmon-10fd740c4a32801524636933db7353f74d4bfd45aab9c19621b9ae354f425fff.scope\": RecentStats: unable to find data in memory cache]"
Jul 27 19:57:55.206709 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:55.206677    2557 generic.go:356] "Generic (PLEG): container finished" podID="236c53ac-6170-4a4c-a58d-03d7214e1af1" containerID="10fd740c4a32801524636933db7353f74d4bfd45aab9c19621b9ae354f425fff" exitCode=0
Jul 27 19:57:55.207144 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:55.206746    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk" event={"ID":"236c53ac-6170-4a4c-a58d-03d7214e1af1","Type":"ContainerDied","Data":"10fd740c4a32801524636933db7353f74d4bfd45aab9c19621b9ae354f425fff"}
Jul 27 19:57:56.369399 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:56.369369    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"
Jul 27 19:57:56.430527 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:56.430495    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236c53ac-6170-4a4c-a58d-03d7214e1af1-maas-api-service-ca\") pod \"236c53ac-6170-4a4c-a58d-03d7214e1af1\" (UID: \"236c53ac-6170-4a4c-a58d-03d7214e1af1\") "
Jul 27 19:57:56.430908 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:56.430889    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/236c53ac-6170-4a4c-a58d-03d7214e1af1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "236c53ac-6170-4a4c-a58d-03d7214e1af1" (UID: "236c53ac-6170-4a4c-a58d-03d7214e1af1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:56.531368 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:56.531286    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/236c53ac-6170-4a4c-a58d-03d7214e1af1-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.222014 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:57.221989    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"
Jul 27 19:57:57.222202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:57.222028    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk" event={"ID":"236c53ac-6170-4a4c-a58d-03d7214e1af1","Type":"ContainerDied","Data":"f0f3cfdaee72e32ab908771f4e19b446073c1f6b7df964e9556da89264d216bb"}
Jul 27 19:57:57.222202 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:57.222075    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0f3cfdaee72e32ab908771f4e19b446073c1f6b7df964e9556da89264d216bb"
Jul 27 19:57:58.034625 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.034562    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:57:58.147273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147239    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq9bx\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-kube-api-access-mq9bx\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147273 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147279    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-token\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147486 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147319    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-envoy\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147486 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147441    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-socket\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147594 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147490    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-data\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147594 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147544    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-credential-socket\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147594 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147577    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istiod-ca-cert\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147626    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-certs\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147749 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147653    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-podinfo\") pod \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\" (UID: \"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85\") "
Jul 27 19:57:58.147904 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.147742    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:58.148045 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.148011    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:58.148259 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.148238    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.148340 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.148269    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:58.148402 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.148334    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:58.148642 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.148572    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:58.149724 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.149696    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:58.149837 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.149798    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-kube-api-access-mq9bx" (OuterVolumeSpecName: "kube-api-access-mq9bx") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "kube-api-access-mq9bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:58.149837 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.149822    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:58.150112 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.150094    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" (UID: "0c8daccb-b5e2-4aa7-98a1-29fe513fdf85"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:57:58.230640 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.230608    2557 generic.go:356] "Generic (PLEG): container finished" podID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerID="e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33" exitCode=0
Jul 27 19:57:58.230803 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.230641    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" event={"ID":"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85","Type":"ContainerDied","Data":"e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33"}
Jul 27 19:57:58.230803 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.230697    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr" event={"ID":"0c8daccb-b5e2-4aa7-98a1-29fe513fdf85","Type":"ContainerDied","Data":"1331a5df47e51759b09f6fc4a1284f76c76d08a4f29df4ec32657c80a1dd05f7"}
Jul 27 19:57:58.230803 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.230720    2557 scope.go:117] "RemoveContainer" containerID="e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33"
Jul 27 19:57:58.230803 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.230654    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"
Jul 27 19:57:58.240962 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.240946    2557 scope.go:117] "RemoveContainer" containerID="5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac"
Jul 27 19:57:58.250237 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.250211    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-envoy\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.250331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.250240    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-data\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.250331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.250254    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-credential-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.250331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.250267    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istiod-ca-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.250331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.250281    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-workload-certs\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.250331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.250293    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-podinfo\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.250331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.250306    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq9bx\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-kube-api-access-mq9bx\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.250331 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.250319    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85-istio-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.252961 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.252937    2557 scope.go:117] "RemoveContainer" containerID="e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33"
Jul 27 19:57:58.253251 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:57:58.253233    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33\": container with ID starting with e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33 not found: ID does not exist" containerID="e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33"
Jul 27 19:57:58.253330 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.253263    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33"} err="failed to get container status \"e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33\": rpc error: code = NotFound desc = could not find container \"e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33\": container with ID starting with e728fc848f44c7c548ba2ab58baf2c49aba6fa5d5e4270e7fa79ff1a0c89eb33 not found: ID does not exist"
Jul 27 19:57:58.253330 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.253288    2557 scope.go:117] "RemoveContainer" containerID="5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac"
Jul 27 19:57:58.253616 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:57:58.253597    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac\": container with ID starting with 5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac not found: ID does not exist" containerID="5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac"
Jul 27 19:57:58.253658 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.253622    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac"} err="failed to get container status \"5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac\": rpc error: code = NotFound desc = could not find container \"5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac\": container with ID starting with 5c12d417e187493bc445794c8521b549b845f3ce9c795296cf2ff1f41b83c6ac not found: ID does not exist"
Jul 27 19:57:58.256462 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.256442    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"]
Jul 27 19:57:58.261416 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:58.261393    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-f227a8-openshift-default-f9b4b56f8-rqfkr"]
Jul 27 19:57:59.791608 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:57:59.791573    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" path="/var/lib/kubelet/pods/0c8daccb-b5e2-4aa7-98a1-29fe513fdf85/volumes"
Jul 27 19:58:04.446178 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:04.446140    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"]
Jul 27 19:58:04.452700 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:04.452667    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b78801-ngzlk"]
Jul 27 19:58:05.791265 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:05.791230    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="236c53ac-6170-4a4c-a58d-03d7214e1af1" path="/var/lib/kubelet/pods/236c53ac-6170-4a4c-a58d-03d7214e1af1/volumes"
Jul 27 19:58:07.376729 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:07.376692    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:58:11.403281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.403249    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"]
Jul 27 19:58:11.403690 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.403462    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy" containerID="cri-o://925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded" gracePeriod=30
Jul 27 19:58:11.832129 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832093    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"]
Jul 27 19:58:11.832617 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832599    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy"
Jul 27 19:58:11.832716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832620    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy"
Jul 27 19:58:11.832716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832648    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236c53ac-6170-4a4c-a58d-03d7214e1af1" containerName="revoke-keys"
Jul 27 19:58:11.832716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832657    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="236c53ac-6170-4a4c-a58d-03d7214e1af1" containerName="revoke-keys"
Jul 27 19:58:11.832716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832669    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy"
Jul 27 19:58:11.832716 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832679    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy"
Jul 27 19:58:11.833006 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832797    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="236c53ac-6170-4a4c-a58d-03d7214e1af1" containerName="revoke-keys"
Jul 27 19:58:11.833006 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832832    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy"
Jul 27 19:58:11.833006 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.832841    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c8daccb-b5e2-4aa7-98a1-29fe513fdf85" containerName="istio-proxy"
Jul 27 19:58:11.837520 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.837499    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"
Jul 27 19:58:11.840118 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.840097    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:58:11.848589 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.848561    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"]
Jul 27 19:58:11.989221 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:11.989191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d91f7-3f19-467a-a6dc-abfb6fa3cb79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn\" (UID: \"141d91f7-3f19-467a-a6dc-abfb6fa3cb79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"
Jul 27 19:58:12.090870 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:12.090779    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d91f7-3f19-467a-a6dc-abfb6fa3cb79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn\" (UID: \"141d91f7-3f19-467a-a6dc-abfb6fa3cb79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"
Jul 27 19:58:12.091450 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:12.091429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d91f7-3f19-467a-a6dc-abfb6fa3cb79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn\" (UID: \"141d91f7-3f19-467a-a6dc-abfb6fa3cb79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"
Jul 27 19:58:12.151269 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:12.151234    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"
Jul 27 19:58:12.309610 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:12.309579    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"]
Jul 27 19:58:12.310443 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:58:12.310418    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141d91f7_3f19_467a_a6dc_abfb6fa3cb79.slice/crio-ef5da1c0728b43ba9548d91771576823f85ec981b2161049bafd34537ceff632 WatchSource:0}: Error finding container ef5da1c0728b43ba9548d91771576823f85ec981b2161049bafd34537ceff632: Status 404 returned error can't find the container with id ef5da1c0728b43ba9548d91771576823f85ec981b2161049bafd34537ceff632
Jul 27 19:58:12.328536 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:12.328506    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn" event={"ID":"141d91f7-3f19-467a-a6dc-abfb6fa3cb79","Type":"ContainerStarted","Data":"ef5da1c0728b43ba9548d91771576823f85ec981b2161049bafd34537ceff632"}
Jul 27 19:58:12.735169 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:12.735133    2557 patch_prober.go:28] interesting pod/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:58:12.735532 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:12.735198    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:58:13.345460 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:13.345364    2557 generic.go:356] "Generic (PLEG): container finished" podID="141d91f7-3f19-467a-a6dc-abfb6fa3cb79" containerID="19b7b489bbefa495bd2d3da689e29f5a531120ca3ff79274a5e9ab6de717f7cb" exitCode=0
Jul 27 19:58:13.345627 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:13.345448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn" event={"ID":"141d91f7-3f19-467a-a6dc-abfb6fa3cb79","Type":"ContainerDied","Data":"19b7b489bbefa495bd2d3da689e29f5a531120ca3ff79274a5e9ab6de717f7cb"}
Jul 27 19:58:14.502593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:14.502564    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"
Jul 27 19:58:14.517482 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:14.517451    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d91f7-3f19-467a-a6dc-abfb6fa3cb79-maas-api-service-ca\") pod \"141d91f7-3f19-467a-a6dc-abfb6fa3cb79\" (UID: \"141d91f7-3f19-467a-a6dc-abfb6fa3cb79\") "
Jul 27 19:58:14.517888 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:14.517868    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/141d91f7-3f19-467a-a6dc-abfb6fa3cb79-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "141d91f7-3f19-467a-a6dc-abfb6fa3cb79" (UID: "141d91f7-3f19-467a-a6dc-abfb6fa3cb79"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:14.618690 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:14.618604    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141d91f7-3f19-467a-a6dc-abfb6fa3cb79-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:15.359203 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:15.359114    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"
Jul 27 19:58:15.359203 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:15.359147    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn" event={"ID":"141d91f7-3f19-467a-a6dc-abfb6fa3cb79","Type":"ContainerDied","Data":"ef5da1c0728b43ba9548d91771576823f85ec981b2161049bafd34537ceff632"}
Jul 27 19:58:15.359389 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:15.359205    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef5da1c0728b43ba9548d91771576823f85ec981b2161049bafd34537ceff632"
Jul 27 19:58:16.687314 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.687288    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:58:16.736770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.736730    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-envoy\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.736770 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.736769    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-credential-socket\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.737049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.736793    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-socket\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.737049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.736852    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9002582-5a74-4c94-a077-629dda01f48b-istio-podinfo\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.737049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.736903    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-istio-token\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.737049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.736941    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnchm\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-kube-api-access-bnchm\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.737049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.736976    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-data\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.737049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.737012    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9002582-5a74-4c94-a077-629dda01f48b-istiod-ca-cert\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.737049 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.737039    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-certs\") pod \"c9002582-5a74-4c94-a077-629dda01f48b\" (UID: \"c9002582-5a74-4c94-a077-629dda01f48b\") "
Jul 27 19:58:16.737436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.737128    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:16.737436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.737201    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:16.737436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.737393    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:16.737436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.737397    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-credential-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:16.737436 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.737421    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:16.737963 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.737934    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9002582-5a74-4c94-a077-629dda01f48b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:16.738189 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.738165    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:16.739293 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.739256    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:16.739402 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.739308    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9002582-5a74-4c94-a077-629dda01f48b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:58:16.740070 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.740038    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-kube-api-access-bnchm" (OuterVolumeSpecName: "kube-api-access-bnchm") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "kube-api-access-bnchm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:16.740160 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.740074    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9002582-5a74-4c94-a077-629dda01f48b" (UID: "c9002582-5a74-4c94-a077-629dda01f48b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:16.838783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.838745    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-envoy\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:16.838783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.838773    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9002582-5a74-4c94-a077-629dda01f48b-istio-podinfo\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:16.838783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.838782    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-istio-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:16.838783 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.838791    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnchm\" (UniqueName: \"kubernetes.io/projected/c9002582-5a74-4c94-a077-629dda01f48b-kube-api-access-bnchm\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:16.839152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.838799    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-istio-data\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:16.839152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.838834    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9002582-5a74-4c94-a077-629dda01f48b-istiod-ca-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:16.839152 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:16.838848    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9002582-5a74-4c94-a077-629dda01f48b-workload-certs\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:17.373566 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.373532    2557 generic.go:356] "Generic (PLEG): container finished" podID="c9002582-5a74-4c94-a077-629dda01f48b" containerID="925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded" exitCode=0
Jul 27 19:58:17.373754 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.373586    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"
Jul 27 19:58:17.373754 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.373619    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" event={"ID":"c9002582-5a74-4c94-a077-629dda01f48b","Type":"ContainerDied","Data":"925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded"}
Jul 27 19:58:17.373754 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.373668    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn" event={"ID":"c9002582-5a74-4c94-a077-629dda01f48b","Type":"ContainerDied","Data":"221bc855466ba280b99ea5f47763e241e5896aed646c173cbb5ea7b1c4fdd76f"}
Jul 27 19:58:17.373754 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.373691    2557 scope.go:117] "RemoveContainer" containerID="925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded"
Jul 27 19:58:17.384173 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.384156    2557 scope.go:117] "RemoveContainer" containerID="9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2"
Jul 27 19:58:17.394772 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.394714    2557 scope.go:117] "RemoveContainer" containerID="925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded"
Jul 27 19:58:17.398024 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:58:17.396148    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded\": container with ID starting with 925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded not found: ID does not exist" containerID="925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded"
Jul 27 19:58:17.398024 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.396186    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded"} err="failed to get container status \"925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded\": rpc error: code = NotFound desc = could not find container \"925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded\": container with ID starting with 925f57073b11864e7592d222809ad5e35b95c89847a9f97e9671c4e56d2c0ded not found: ID does not exist"
Jul 27 19:58:17.398024 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.396211    2557 scope.go:117] "RemoveContainer" containerID="9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2"
Jul 27 19:58:17.398278 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:58:17.398256    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2\": container with ID starting with 9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2 not found: ID does not exist" containerID="9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2"
Jul 27 19:58:17.398322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.398284    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2"} err="failed to get container status \"9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2\": rpc error: code = NotFound desc = could not find container \"9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2\": container with ID starting with 9cccf3d1c1e030ab82b6c8eab5c4984d0e50c62d412e24333c910265eb3493f2 not found: ID does not exist"
Jul 27 19:58:17.412138 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.412116    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"]
Jul 27 19:58:17.415420 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.415401    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-b78801-openshift-default-777f779448-jwkjn"]
Jul 27 19:58:17.790834 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:17.790773    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9002582-5a74-4c94-a077-629dda01f48b" path="/var/lib/kubelet/pods/c9002582-5a74-4c94-a077-629dda01f48b/volumes"
Jul 27 19:58:22.477847 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:22.477796    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"]
Jul 27 19:58:22.481514 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:22.481491    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b4cd12-29753025-hms77"]
Jul 27 19:58:22.719110 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:22.719080    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"]
Jul 27 19:58:22.730157 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:22.730083    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b4cd12-5zqwn"]
Jul 27 19:58:23.791322 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:23.791288    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="141d91f7-3f19-467a-a6dc-abfb6fa3cb79" path="/var/lib/kubelet/pods/141d91f7-3f19-467a-a6dc-abfb6fa3cb79/volumes"
Jul 27 19:58:23.791819 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:23.791581    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43f82fe9-264c-423a-b686-e44183195a34" path="/var/lib/kubelet/pods/43f82fe9-264c-423a-b686-e44183195a34/volumes"
Jul 27 19:58:25.376468 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:25.376429    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:58:30.212163 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.212128    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"]
Jul 27 19:58:30.212564 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.212349    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy" containerID="cri-o://d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a" gracePeriod=30
Jul 27 19:58:30.631601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.631520    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"]
Jul 27 19:58:30.631992 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.631977    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy"
Jul 27 19:58:30.632056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.631993    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy"
Jul 27 19:58:30.632056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.632004    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141d91f7-3f19-467a-a6dc-abfb6fa3cb79" containerName="revoke-keys"
Jul 27 19:58:30.632056 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.632010    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="141d91f7-3f19-467a-a6dc-abfb6fa3cb79" containerName="revoke-keys"
Jul 27 19:58:30.632156 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.632089    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="141d91f7-3f19-467a-a6dc-abfb6fa3cb79" containerName="revoke-keys"
Jul 27 19:58:30.632156 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.632098    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy"
Jul 27 19:58:30.639166 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.639131    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"
Jul 27 19:58:30.642302 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.642278    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rkmj6\""
Jul 27 19:58:30.646381 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.646354    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"]
Jul 27 19:58:30.781148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.781110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5472e4fd-dacd-41d5-b558-d9377ef74497-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9\" (UID: \"5472e4fd-dacd-41d5-b558-d9377ef74497\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"
Jul 27 19:58:30.881916 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.881796    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5472e4fd-dacd-41d5-b558-d9377ef74497-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9\" (UID: \"5472e4fd-dacd-41d5-b558-d9377ef74497\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"
Jul 27 19:58:30.882422 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.882402    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5472e4fd-dacd-41d5-b558-d9377ef74497-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9\" (UID: \"5472e4fd-dacd-41d5-b558-d9377ef74497\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"
Jul 27 19:58:30.954116 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:30.954085    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"
Jul 27 19:58:31.309333 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:58:31.309289    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5472e4fd_dacd_41d5_b558_d9377ef74497.slice/crio-e383e4d1dec1fb34b31392c338416ea2893daa61d0f0115f4f2652e76ad605bc WatchSource:0}: Error finding container e383e4d1dec1fb34b31392c338416ea2893daa61d0f0115f4f2652e76ad605bc: Status 404 returned error can't find the container with id e383e4d1dec1fb34b31392c338416ea2893daa61d0f0115f4f2652e76ad605bc
Jul 27 19:58:31.310768 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:31.310738    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"]
Jul 27 19:58:31.462110 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:31.462068    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9" event={"ID":"5472e4fd-dacd-41d5-b558-d9377ef74497","Type":"ContainerStarted","Data":"e383e4d1dec1fb34b31392c338416ea2893daa61d0f0115f4f2652e76ad605bc"}
Jul 27 19:58:32.469474 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:32.469434    2557 generic.go:356] "Generic (PLEG): container finished" podID="5472e4fd-dacd-41d5-b558-d9377ef74497" containerID="c1f4ac3f7e7db74ded224b924c143357555cbbd130af969f07fd5b22d5a0523a" exitCode=0
Jul 27 19:58:32.469955 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:32.469520    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9" event={"ID":"5472e4fd-dacd-41d5-b558-d9377ef74497","Type":"ContainerDied","Data":"c1f4ac3f7e7db74ded224b924c143357555cbbd130af969f07fd5b22d5a0523a"}
Jul 27 19:58:33.217266 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:33.217233    2557 patch_prober.go:28] interesting pod/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:58:33.217456 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:33.217282    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:58:33.614429 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:33.614406    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"
Jul 27 19:58:33.710231 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:33.710194    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5472e4fd-dacd-41d5-b558-d9377ef74497-maas-api-service-ca\") pod \"5472e4fd-dacd-41d5-b558-d9377ef74497\" (UID: \"5472e4fd-dacd-41d5-b558-d9377ef74497\") "
Jul 27 19:58:33.710553 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:33.710531    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5472e4fd-dacd-41d5-b558-d9377ef74497-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5472e4fd-dacd-41d5-b558-d9377ef74497" (UID: "5472e4fd-dacd-41d5-b558-d9377ef74497"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:33.810888 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:33.810864    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5472e4fd-dacd-41d5-b558-d9377ef74497-maas-api-service-ca\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:34.485207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:34.485174    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9" event={"ID":"5472e4fd-dacd-41d5-b558-d9377ef74497","Type":"ContainerDied","Data":"e383e4d1dec1fb34b31392c338416ea2893daa61d0f0115f4f2652e76ad605bc"}
Jul 27 19:58:34.485207 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:34.485200    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"
Jul 27 19:58:34.485409 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:34.485222    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e383e4d1dec1fb34b31392c338416ea2893daa61d0f0115f4f2652e76ad605bc"
Jul 27 19:58:35.472902 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.472875    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:58:35.492406 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.492335    2557 generic.go:356] "Generic (PLEG): container finished" podID="9b0f56d5-c954-4398-9511-92bd60911538" containerID="d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a" exitCode=0
Jul 27 19:58:35.492406 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.492386    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"
Jul 27 19:58:35.492601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.492435    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" event={"ID":"9b0f56d5-c954-4398-9511-92bd60911538","Type":"ContainerDied","Data":"d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a"}
Jul 27 19:58:35.492601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.492525    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl" event={"ID":"9b0f56d5-c954-4398-9511-92bd60911538","Type":"ContainerDied","Data":"c0c7663b05f6952ec64c8d6161089b1adf743b62a797b8043d22508931643966"}
Jul 27 19:58:35.492601 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.492549    2557 scope.go:117] "RemoveContainer" containerID="d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a"
Jul 27 19:58:35.502009 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.501927    2557 scope.go:117] "RemoveContainer" containerID="e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1"
Jul 27 19:58:35.512761 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.512744    2557 scope.go:117] "RemoveContainer" containerID="d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a"
Jul 27 19:58:35.513147 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:58:35.513125    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a\": container with ID starting with d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a not found: ID does not exist" containerID="d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a"
Jul 27 19:58:35.513220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.513155    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a"} err="failed to get container status \"d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a\": rpc error: code = NotFound desc = could not find container \"d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a\": container with ID starting with d03b0ff0fa6dc6cc2f5848d128e78195a0bf093fed72aaefca152dd8f17f951a not found: ID does not exist"
Jul 27 19:58:35.513220 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.513171    2557 scope.go:117] "RemoveContainer" containerID="e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1"
Jul 27 19:58:35.513427 ip-10-0-142-171 kubenswrapper[2557]: E0727 19:58:35.513410    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1\": container with ID starting with e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1 not found: ID does not exist" containerID="e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1"
Jul 27 19:58:35.513480 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.513436    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1"} err="failed to get container status \"e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1\": rpc error: code = NotFound desc = could not find container \"e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1\": container with ID starting with e21a87676216425b58d1ca3353b42a418f598ae96d2aef2175fd724a977ef2e1 not found: ID does not exist"
Jul 27 19:58:35.628106 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628074    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-envoy\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628151    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0f56d5-c954-4398-9511-92bd60911538-istiod-ca-cert\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628189    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-certs\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628233    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0f56d5-c954-4398-9511-92bd60911538-istio-podinfo\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628255    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-credential-socket\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628311 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628295    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-kube-api-access-jjzwt\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628346    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-data\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628379    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-istio-token\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628413    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-socket\") pod \"9b0f56d5-c954-4398-9511-92bd60911538\" (UID: \"9b0f56d5-c954-4398-9511-92bd60911538\") "
Jul 27 19:58:35.628759 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628722    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b0f56d5-c954-4398-9511-92bd60911538-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:35.628885 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.628859    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:35.629024 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.629002    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:35.629108 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.629019    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:35.629785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.629751    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:35.630481 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.630455    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:35.630746 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.630726    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b0f56d5-c954-4398-9511-92bd60911538-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:58:35.630867 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.630801    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-kube-api-access-jjzwt" (OuterVolumeSpecName: "kube-api-access-jjzwt") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "kube-api-access-jjzwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:35.630986 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.630952    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b0f56d5-c954-4398-9511-92bd60911538" (UID: "9b0f56d5-c954-4398-9511-92bd60911538"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:35.729773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729729    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b0f56d5-c954-4398-9511-92bd60911538-istiod-ca-cert\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.729773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729768    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-certs\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.729773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729776    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b0f56d5-c954-4398-9511-92bd60911538-istio-podinfo\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.729773 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729784    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-credential-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.730111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729794    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-kube-api-access-jjzwt\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.730111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729803    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-data\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.730111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729832    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b0f56d5-c954-4398-9511-92bd60911538-istio-token\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.730111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729840    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-workload-socket\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.730111 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.729848    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b0f56d5-c954-4398-9511-92bd60911538-istio-envoy\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:35.819608 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.819575    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"]
Jul 27 19:58:35.826187 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:35.826161    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b4cd12-openshift-default-689779dbcb-58htl"]
Jul 27 19:58:37.790595 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:37.790561    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b0f56d5-c954-4398-9511-92bd60911538" path="/var/lib/kubelet/pods/9b0f56d5-c954-4398-9511-92bd60911538/volumes"
Jul 27 19:58:41.326017 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.325987    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"]
Jul 27 19:58:41.329313 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.329291    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70aa40-29753025-9v6kw"]
Jul 27 19:58:41.377442 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.377409    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"]
Jul 27 19:58:41.377663 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.377637    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j" podUID="e46485d8-e28b-4c24-bbe1-9786f1fdfaef" containerName="payload-pre-processing" containerID="cri-o://b55f990a895a8db29812c616a3aa3db69ecd183ae4ee2798e2bad2b2be261ad2" gracePeriod=30
Jul 27 19:58:41.541231 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.541196    2557 generic.go:356] "Generic (PLEG): container finished" podID="e46485d8-e28b-4c24-bbe1-9786f1fdfaef" containerID="b55f990a895a8db29812c616a3aa3db69ecd183ae4ee2798e2bad2b2be261ad2" exitCode=0
Jul 27 19:58:41.541409 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.541273    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j" event={"ID":"e46485d8-e28b-4c24-bbe1-9786f1fdfaef","Type":"ContainerDied","Data":"b55f990a895a8db29812c616a3aa3db69ecd183ae4ee2798e2bad2b2be261ad2"}
Jul 27 19:58:41.598296 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.598222    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"]
Jul 27 19:58:41.601508 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.601486    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70aa40-l2sq9"]
Jul 27 19:58:41.648353 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.648324    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:58:41.789007 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.788981    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh92f\" (UniqueName: \"kubernetes.io/projected/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-kube-api-access-vh92f\") pod \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\" (UID: \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\") "
Jul 27 19:58:41.789186 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.789017    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-plugins-config-volume\") pod \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\" (UID: \"e46485d8-e28b-4c24-bbe1-9786f1fdfaef\") "
Jul 27 19:58:41.789505 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.789478    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e46485d8-e28b-4c24-bbe1-9786f1fdfaef" (UID: "e46485d8-e28b-4c24-bbe1-9786f1fdfaef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:41.791362 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.791334    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-kube-api-access-vh92f" (OuterVolumeSpecName: "kube-api-access-vh92f") pod "e46485d8-e28b-4c24-bbe1-9786f1fdfaef" (UID: "e46485d8-e28b-4c24-bbe1-9786f1fdfaef"). InnerVolumeSpecName "kube-api-access-vh92f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:41.791567 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.791542    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e136ce4-6731-4c09-88cf-a598f9824c23" path="/var/lib/kubelet/pods/4e136ce4-6731-4c09-88cf-a598f9824c23/volumes"
Jul 27 19:58:41.791985 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.791968    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5472e4fd-dacd-41d5-b558-d9377ef74497" path="/var/lib/kubelet/pods/5472e4fd-dacd-41d5-b558-d9377ef74497/volumes"
Jul 27 19:58:41.890172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.890072    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh92f\" (UniqueName: \"kubernetes.io/projected/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-kube-api-access-vh92f\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.890172 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:41.890100    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e46485d8-e28b-4c24-bbe1-9786f1fdfaef-plugins-config-volume\") on node \"ip-10-0-142-171.ec2.internal\" DevicePath \"\""
Jul 27 19:58:42.549192 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:42.549158    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"
Jul 27 19:58:42.549192 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:42.549181    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j" event={"ID":"e46485d8-e28b-4c24-bbe1-9786f1fdfaef","Type":"ContainerDied","Data":"3b3d105303af85afe9e9f9603594d6d1a132da4039fbf767610e5a1eccb93878"}
Jul 27 19:58:42.549723 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:42.549268    2557 scope.go:117] "RemoveContainer" containerID="b55f990a895a8db29812c616a3aa3db69ecd183ae4ee2798e2bad2b2be261ad2"
Jul 27 19:58:42.578824 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:42.578787    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"]
Jul 27 19:58:42.586019 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:42.585997    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-70aa40-784cd4888-gh94j"]
Jul 27 19:58:43.782042 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:43.782004    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9qskn"]
Jul 27 19:58:43.793136 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:43.793105    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e46485d8-e28b-4c24-bbe1-9786f1fdfaef" path="/var/lib/kubelet/pods/e46485d8-e28b-4c24-bbe1-9786f1fdfaef/volumes"
Jul 27 19:58:55.377028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:55.377000    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m4sn9_3808157f-f65a-48eb-b595-3ca7ad156c37/manager/0.log"
Jul 27 19:58:55.507492 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:55.507462    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c6f6dbc64-6zhqs_a578d919-1308-49c3-b00d-5d81813a0d20/manager/0.log"
Jul 27 19:58:55.771567 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:55.771542    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6zxxd_3ca466e8-37d0-4c65-a989-0091b37535a7/manager/0.log"
Jul 27 19:58:56.219620 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:56.219593    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-tp56r_6f4cea95-f704-4075-9f41-647c7833d23e/copy-manifests/0.log"
Jul 27 19:58:56.227645 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:56.227624    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-tp56r_6f4cea95-f704-4075-9f41-647c7833d23e/manager/0.log"
Jul 27 19:58:56.745001 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:56.744972    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29752995-mjplw_82a7d3e7-f06e-44ce-96ff-3f53e3284b32/cleanup/0.log"
Jul 27 19:58:56.867468 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:56.867435    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753010-xwrcp_3f415ef6-d279-4149-9708-c77ed3e1fc7c/cleanup/0.log"
Jul 27 19:58:56.989798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:56.989773    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753025-mq95b_2d6c5c6f-c598-47e4-9eb1-5218fb853bda/cleanup/0.log"
Jul 27 19:58:57.107709 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:57.107627    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-7jvhk_3149a751-1bc7-4626-bbbc-6ddd07645030/postgres/0.log"
Jul 27 19:58:57.923506 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:57.923473    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng_2e3d6089-231f-4093-a237-30f83d92e80f/util/0.log"
Jul 27 19:58:57.933843 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:57.933792    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng_2e3d6089-231f-4093-a237-30f83d92e80f/pull/0.log"
Jul 27 19:58:57.944282 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:57.944261    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng_2e3d6089-231f-4093-a237-30f83d92e80f/extract/0.log"
Jul 27 19:58:58.065243 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.065217    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr_f85c885a-eb46-4bfc-80ef-a2def0fdd015/util/0.log"
Jul 27 19:58:58.077153 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.077127    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr_f85c885a-eb46-4bfc-80ef-a2def0fdd015/pull/0.log"
Jul 27 19:58:58.086659 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.086639    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr_f85c885a-eb46-4bfc-80ef-a2def0fdd015/extract/0.log"
Jul 27 19:58:58.204186 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.204157    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7_db5b3d8c-cb52-49cb-bfb6-32d1b706cb67/extract/0.log"
Jul 27 19:58:58.217724 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.217696    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7_db5b3d8c-cb52-49cb-bfb6-32d1b706cb67/util/0.log"
Jul 27 19:58:58.230037 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.230018    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7_db5b3d8c-cb52-49cb-bfb6-32d1b706cb67/pull/0.log"
Jul 27 19:58:58.350066 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.350041    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx_a078f27a-3b79-470c-a48c-9c1080c47dce/util/0.log"
Jul 27 19:58:58.360947 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.360919    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx_a078f27a-3b79-470c-a48c-9c1080c47dce/pull/0.log"
Jul 27 19:58:58.372742 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.372724    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx_a078f27a-3b79-470c-a48c-9c1080c47dce/extract/0.log"
Jul 27 19:58:58.766426 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:58.766399    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cvd4s_475507cd-7cc3-47ed-8458-d989dbe5b905/manager/0.log"
Jul 27 19:58:59.000742 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:59.000713    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fl264_7a879a55-e1d2-466d-b695-babc997a4bc3/registry-server/0.log"
Jul 27 19:58:59.272069 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:59.272002    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9qskn_08ef8509-cbbc-4df6-a9f9-75d46146c345/limitador/0.log"
Jul 27 19:58:59.937908 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:58:59.937882    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k22wq_1236f2fb-ebba-4d24-b16b-c9317418de00/discovery/0.log"
Jul 27 19:59:00.203161 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:00.203081    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd59b47cf-nbqnw_3721133b-3593-4bbe-81c5-54721da8df09/kube-auth-proxy/0.log"
Jul 27 19:59:00.471779 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:00.471702    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2nz8x_45fd0158-f8ad-4457-9990-0d0dfff39d3e/payload-pre-processing/0.log"
Jul 27 19:59:00.608135 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:00.608109    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pfwms_5f7c4ef4-3c7d-472f-b9a4-e32600630f91/payload-processing/0.log"
Jul 27 19:59:00.732421 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:00.732336    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c46d44f97-sg67g_002f617c-ef0b-4876-a28c-c81bca7377a5/router/0.log"
Jul 27 19:59:01.107752 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:01.107680    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-b7ns4_f99c4768-6259-4175-af25-466872ae2698/main/0.log"
Jul 27 19:59:01.470194 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:01.470163    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flvlxb_1ae7a693-c1d8-4743-89e2-f3376f7e0ee3/main/0.log"
Jul 27 19:59:10.932642 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:10.932613    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hkjc9_442de7e6-e05f-4f4e-9dda-87387ec140ca/global-pull-secret-syncer/0.log"
Jul 27 19:59:11.018343 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:11.018310    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-svscn_58f7a128-f075-4083-a9ab-0768740754ad/konnectivity-agent/0.log"
Jul 27 19:59:11.139345 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:11.139309    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-171.ec2.internal_2c128425dd9f25041f1129ff56b0147d/haproxy/0.log"
Jul 27 19:59:14.651266 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.651236    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng_2e3d6089-231f-4093-a237-30f83d92e80f/extract/0.log"
Jul 27 19:59:14.686263 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.686231    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng_2e3d6089-231f-4093-a237-30f83d92e80f/util/0.log"
Jul 27 19:59:14.732148 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.732120    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzzng_2e3d6089-231f-4093-a237-30f83d92e80f/pull/0.log"
Jul 27 19:59:14.768707 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.768681    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr_f85c885a-eb46-4bfc-80ef-a2def0fdd015/extract/0.log"
Jul 27 19:59:14.797214 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.797187    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr_f85c885a-eb46-4bfc-80ef-a2def0fdd015/util/0.log"
Jul 27 19:59:14.836908 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.836887    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lfxwr_f85c885a-eb46-4bfc-80ef-a2def0fdd015/pull/0.log"
Jul 27 19:59:14.871171 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.871145    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7_db5b3d8c-cb52-49cb-bfb6-32d1b706cb67/extract/0.log"
Jul 27 19:59:14.900994 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.900974    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7_db5b3d8c-cb52-49cb-bfb6-32d1b706cb67/util/0.log"
Jul 27 19:59:14.926714 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.926646    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73468t7_db5b3d8c-cb52-49cb-bfb6-32d1b706cb67/pull/0.log"
Jul 27 19:59:14.960377 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.960351    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx_a078f27a-3b79-470c-a48c-9c1080c47dce/extract/0.log"
Jul 27 19:59:14.987733 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:14.987714    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx_a078f27a-3b79-470c-a48c-9c1080c47dce/util/0.log"
Jul 27 19:59:15.017091 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:15.017067    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qgrfx_a078f27a-3b79-470c-a48c-9c1080c47dce/pull/0.log"
Jul 27 19:59:15.069798 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:15.069764    2557 scope.go:117] "RemoveContainer" containerID="d4cea863e937ad6ad45a46108ccca06e6aa60fb34e0aa2efec2e1e09be1090af"
Jul 27 19:59:15.081539 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:15.081517    2557 scope.go:117] "RemoveContainer" containerID="12905e26908680d27fe11dfd87939e1bb80ef0fa09c9eff77b97dfa2b17a9a66"
Jul 27 19:59:15.427374 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:15.427345    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cvd4s_475507cd-7cc3-47ed-8458-d989dbe5b905/manager/0.log"
Jul 27 19:59:15.514316 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:15.514279    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fl264_7a879a55-e1d2-466d-b695-babc997a4bc3/registry-server/0.log"
Jul 27 19:59:15.779929 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:15.779902    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9qskn_08ef8509-cbbc-4df6-a9f9-75d46146c345/limitador/0.log"
Jul 27 19:59:17.636315 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:17.636267    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e05c319e-4e24-41fd-8650-58db8e119822/alertmanager/0.log"
Jul 27 19:59:17.672785 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:17.672761    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e05c319e-4e24-41fd-8650-58db8e119822/config-reloader/0.log"
Jul 27 19:59:17.715297 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:17.715273    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e05c319e-4e24-41fd-8650-58db8e119822/kube-rbac-proxy-web/0.log"
Jul 27 19:59:17.744365 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:17.744343    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e05c319e-4e24-41fd-8650-58db8e119822/kube-rbac-proxy/0.log"
Jul 27 19:59:17.768796 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:17.768773    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e05c319e-4e24-41fd-8650-58db8e119822/kube-rbac-proxy-metric/0.log"
Jul 27 19:59:17.797602 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:17.797578    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e05c319e-4e24-41fd-8650-58db8e119822/prom-label-proxy/0.log"
Jul 27 19:59:17.825326 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:17.825309    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e05c319e-4e24-41fd-8650-58db8e119822/init-config-reloader/0.log"
Jul 27 19:59:17.871355 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:17.871329    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-nqgjq_f175664a-1582-4bcb-b693-68c79235cd50/cluster-monitoring-operator/0.log"
Jul 27 19:59:18.054778 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:18.054754    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-nl9d7_953fa1b0-2c22-4be9-9f83-720d368a9ecc/monitoring-plugin/0.log"
Jul 27 19:59:18.283688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:18.283659    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-znk94_52b48837-9920-402a-9b89-aa5d439d75cd/node-exporter/0.log"
Jul 27 19:59:18.312233 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:18.312210    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-znk94_52b48837-9920-402a-9b89-aa5d439d75cd/kube-rbac-proxy/0.log"
Jul 27 19:59:18.333359 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:18.333342    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-znk94_52b48837-9920-402a-9b89-aa5d439d75cd/init-textfile/0.log"
Jul 27 19:59:18.915201 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:18.915169    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f85cbfccd-rnhvz_346c1b1c-f058-4ae1-9d29-5e3d5f4cf456/thanos-query/0.log"
Jul 27 19:59:18.942657 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:18.942635    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f85cbfccd-rnhvz_346c1b1c-f058-4ae1-9d29-5e3d5f4cf456/kube-rbac-proxy-web/0.log"
Jul 27 19:59:18.977510 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:18.977487    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f85cbfccd-rnhvz_346c1b1c-f058-4ae1-9d29-5e3d5f4cf456/kube-rbac-proxy/0.log"
Jul 27 19:59:19.004147 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:19.004115    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f85cbfccd-rnhvz_346c1b1c-f058-4ae1-9d29-5e3d5f4cf456/prom-label-proxy/0.log"
Jul 27 19:59:19.028094 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:19.028052    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f85cbfccd-rnhvz_346c1b1c-f058-4ae1-9d29-5e3d5f4cf456/kube-rbac-proxy-rules/0.log"
Jul 27 19:59:19.052059 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:19.052037    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f85cbfccd-rnhvz_346c1b1c-f058-4ae1-9d29-5e3d5f4cf456/kube-rbac-proxy-metrics/0.log"
Jul 27 19:59:20.308396 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:20.308352    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-tqgm6_6ee70953-9fcf-4271-b319-4cc2ef2b6bed/networking-console-plugin/0.log"
Jul 27 19:59:21.040652 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.040618    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/1.log"
Jul 27 19:59:21.044919 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.044898    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ldsb7_433f4a96-4572-4997-af45-4e2bd22c32ad/console-operator/2.log"
Jul 27 19:59:21.158652 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.158610    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"]
Jul 27 19:59:21.159104 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159091    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy"
Jul 27 19:59:21.159158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159106    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy"
Jul 27 19:59:21.159158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159119    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5472e4fd-dacd-41d5-b558-d9377ef74497" containerName="revoke-keys"
Jul 27 19:59:21.159158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159125    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5472e4fd-dacd-41d5-b558-d9377ef74497" containerName="revoke-keys"
Jul 27 19:59:21.159158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159134    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy"
Jul 27 19:59:21.159158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159140    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy"
Jul 27 19:59:21.159158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159146    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy"
Jul 27 19:59:21.159158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159151    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy"
Jul 27 19:59:21.159158 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159158    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e46485d8-e28b-4c24-bbe1-9786f1fdfaef" containerName="payload-pre-processing"
Jul 27 19:59:21.159405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159164    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e46485d8-e28b-4c24-bbe1-9786f1fdfaef" containerName="payload-pre-processing"
Jul 27 19:59:21.159405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159229    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9002582-5a74-4c94-a077-629dda01f48b" containerName="istio-proxy"
Jul 27 19:59:21.159405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159235    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy"
Jul 27 19:59:21.159405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159244    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0f56d5-c954-4398-9511-92bd60911538" containerName="istio-proxy"
Jul 27 19:59:21.159405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159249    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e46485d8-e28b-4c24-bbe1-9786f1fdfaef" containerName="payload-pre-processing"
Jul 27 19:59:21.159405 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.159255    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5472e4fd-dacd-41d5-b558-d9377ef74497" containerName="revoke-keys"
Jul 27 19:59:21.164191 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.164176    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.169005 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.168977    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hwxjc\"/\"openshift-service-ca.crt\""
Jul 27 19:59:21.169121 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.169056    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hwxjc\"/\"default-dockercfg-g7p4f\""
Jul 27 19:59:21.169862 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.169844    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hwxjc\"/\"kube-root-ca.crt\""
Jul 27 19:59:21.190736 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.190714    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"]
Jul 27 19:59:21.248961 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.248931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-proc\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.249125 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.249026    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxcbb\" (UniqueName: \"kubernetes.io/projected/d7764b74-ba81-4380-b231-f312ded23cd7-kube-api-access-kxcbb\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.249125 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.249053    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-podres\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.249125 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.249075    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-sys\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.249260 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.249245    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-lib-modules\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-sys\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350231    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-lib-modules\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350272 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350271    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-proc\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350323    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-sys\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350385    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-proc\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxcbb\" (UniqueName: \"kubernetes.io/projected/d7764b74-ba81-4380-b231-f312ded23cd7-kube-api-access-kxcbb\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-podres\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350463    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-lib-modules\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.350688 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.350509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7764b74-ba81-4380-b231-f312ded23cd7-podres\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.359939 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.359910    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxcbb\" (UniqueName: \"kubernetes.io/projected/d7764b74-ba81-4380-b231-f312ded23cd7-kube-api-access-kxcbb\") pod \"perf-node-gather-daemonset-22kwc\" (UID: \"d7764b74-ba81-4380-b231-f312ded23cd7\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.474599 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.474558    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.615604 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.615574    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"]
Jul 27 19:59:21.616298 ip-10-0-142-171 kubenswrapper[2557]: W0727 19:59:21.616271    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd7764b74_ba81_4380_b231_f312ded23cd7.slice/crio-7f4bd804371b861bafa9d6e87c6230a0d22f622859fe5f38eae84ada3837eaff WatchSource:0}: Error finding container 7f4bd804371b861bafa9d6e87c6230a0d22f622859fe5f38eae84ada3837eaff: Status 404 returned error can't find the container with id 7f4bd804371b861bafa9d6e87c6230a0d22f622859fe5f38eae84ada3837eaff
Jul 27 19:59:21.706281 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.706218    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-697bdbd84f-2qfqf_cf548cb5-3e8a-4d5a-8481-c0a1ec90bb4c/console/0.log"
Jul 27 19:59:21.749600 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.749581    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-nzcpj_4dc0e035-4d4e-4dad-b7c3-1ebf83749c9d/download-server/0.log"
Jul 27 19:59:21.801095 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.801064    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc" event={"ID":"d7764b74-ba81-4380-b231-f312ded23cd7","Type":"ContainerStarted","Data":"c05a3407488be0229ea31e49bce09b224e5a053cc3f66de7527e0aaf9d7d8b89"}
Jul 27 19:59:21.801255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.801110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc" event={"ID":"d7764b74-ba81-4380-b231-f312ded23cd7","Type":"ContainerStarted","Data":"7f4bd804371b861bafa9d6e87c6230a0d22f622859fe5f38eae84ada3837eaff"}
Jul 27 19:59:21.801255 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.801131    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:21.822624 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:21.822573    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc" podStartSLOduration=0.822558275 podStartE2EDuration="822.558275ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:59:21.820003797 +0000 UTC m=+3248.527143287" watchObservedRunningTime="2026-07-27 19:59:21.822558275 +0000 UTC m=+3248.529697765"
Jul 27 19:59:22.434280 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:22.434248    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-2x7jv_60142d34-80c8-4db5-b5f1-1652bea170af/volume-data-source-validator/0.log"
Jul 27 19:59:23.606658 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:23.606629    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-shw9l_51464ba8-9e7a-4d4e-8980-fde4058526cf/dns/0.log"
Jul 27 19:59:23.634619 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:23.634591    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-shw9l_51464ba8-9e7a-4d4e-8980-fde4058526cf/kube-rbac-proxy/0.log"
Jul 27 19:59:23.659734 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:23.659707    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-frh26_1112b3ac-a158-4cd1-b49e-3e6dc65be58e/dns-node-resolver/0.log"
Jul 27 19:59:24.311863 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:24.311835    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rtvcd_408b1c2b-d4fd-491a-9a34-35a8c3a090d0/node-ca/0.log"
Jul 27 19:59:25.481882 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:25.481850    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k22wq_1236f2fb-ebba-4d24-b16b-c9317418de00/discovery/0.log"
Jul 27 19:59:25.543250 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:25.543218    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd59b47cf-nbqnw_3721133b-3593-4bbe-81c5-54721da8df09/kube-auth-proxy/0.log"
Jul 27 19:59:25.633922 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:25.633892    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2nz8x_45fd0158-f8ad-4457-9990-0d0dfff39d3e/payload-pre-processing/0.log"
Jul 27 19:59:25.665458 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:25.665434    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pfwms_5f7c4ef4-3c7d-472f-b9a4-e32600630f91/payload-processing/0.log"
Jul 27 19:59:25.699071 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:25.699049    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c46d44f97-sg67g_002f617c-ef0b-4876-a28c-c81bca7377a5/router/0.log"
Jul 27 19:59:26.556004 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:26.555971    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hkqdb_c1506781-81db-4e02-be04-1d57e9f98e6f/serve-healthcheck-canary/0.log"
Jul 27 19:59:27.096776 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:27.096744    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-h49xz_dc0e5d7c-561f-476b-beb9-ab84d87b23fb/insights-operator/0.log"
Jul 27 19:59:27.098431 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:27.098413    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-h49xz_dc0e5d7c-561f-476b-beb9-ab84d87b23fb/insights-operator/1.log"
Jul 27 19:59:27.304195 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:27.304163    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9mpz_f5bb22c9-1338-46a3-9863-4a3c2a87c68e/kube-rbac-proxy/0.log"
Jul 27 19:59:27.336639 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:27.336615    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9mpz_f5bb22c9-1338-46a3-9863-4a3c2a87c68e/exporter/0.log"
Jul 27 19:59:27.365179 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:27.365112    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9mpz_f5bb22c9-1338-46a3-9863-4a3c2a87c68e/extractor/0.log"
Jul 27 19:59:27.817943 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:27.817917    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-22kwc"
Jul 27 19:59:29.984125 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:29.984087    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m4sn9_3808157f-f65a-48eb-b595-3ca7ad156c37/manager/0.log"
Jul 27 19:59:30.150278 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:30.150257    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c6f6dbc64-6zhqs_a578d919-1308-49c3-b00d-5d81813a0d20/manager/0.log"
Jul 27 19:59:30.261364 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:30.261336    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6zxxd_3ca466e8-37d0-4c65-a989-0091b37535a7/manager/0.log"
Jul 27 19:59:30.552192 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:30.552147    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-tp56r_6f4cea95-f704-4075-9f41-647c7833d23e/manager/0.log"
Jul 27 19:59:30.606502 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:30.606474    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-tp56r_6f4cea95-f704-4075-9f41-647c7833d23e/copy-manifests/0.log"
Jul 27 19:59:31.697460 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:31.697431    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k22wq_1236f2fb-ebba-4d24-b16b-c9317418de00/discovery/0.log"
Jul 27 19:59:31.728702 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:31.728627    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd59b47cf-nbqnw_3721133b-3593-4bbe-81c5-54721da8df09/kube-auth-proxy/0.log"
Jul 27 19:59:31.797593 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:31.797562    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2nz8x_45fd0158-f8ad-4457-9990-0d0dfff39d3e/payload-pre-processing/0.log"
Jul 27 19:59:31.818042 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:31.818017    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pfwms_5f7c4ef4-3c7d-472f-b9a4-e32600630f91/payload-processing/0.log"
Jul 27 19:59:31.831937 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:31.831914    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c46d44f97-sg67g_002f617c-ef0b-4876-a28c-c81bca7377a5/router/0.log"
Jul 27 19:59:31.929844 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:31.929800    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5kbpc_77cb3dfa-92d9-4842-8319-cfb1149d18cc/openshift-lws-operator/0.log"
Jul 27 19:59:33.273646 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:33.273615    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k22wq_1236f2fb-ebba-4d24-b16b-c9317418de00/discovery/0.log"
Jul 27 19:59:33.308028 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:33.307997    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd59b47cf-nbqnw_3721133b-3593-4bbe-81c5-54721da8df09/kube-auth-proxy/0.log"
Jul 27 19:59:33.385135 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:33.385098    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2nz8x_45fd0158-f8ad-4457-9990-0d0dfff39d3e/payload-pre-processing/0.log"
Jul 27 19:59:33.410170 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:33.410139    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pfwms_5f7c4ef4-3c7d-472f-b9a4-e32600630f91/payload-processing/0.log"
Jul 27 19:59:33.425731 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:33.425707    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c46d44f97-sg67g_002f617c-ef0b-4876-a28c-c81bca7377a5/router/0.log"
Jul 27 19:59:37.377606 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:37.377436    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5_d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a/kube-storage-version-migrator-operator/1.log"
Jul 27 19:59:37.380043 ip-10-0-142-171 kubenswrapper[2557]: I0727 19:59:37.378485    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-tbhg5_d9d97a66-be6e-42d3-a1c1-7d7b0f39ed8a/kube-storage-version-migrator-operator/0.log"