Jul 24 14:20:30.559837 ip-10-0-134-104 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 14:20:30.559847 ip-10-0-134-104 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 14:20:30.559855 ip-10-0-134-104 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 14:20:30.560115 ip-10-0-134-104 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 14:20:40.754020 ip-10-0-134-104 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 14:20:40.754037 ip-10-0-134-104 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 28e8b10028bb4d469015d917ad25d462 --
Jul 24 14:22:13.454339 ip-10-0-134-104 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 14:22:13.796828 ip-10-0-134-104 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:22:13.796828 ip-10-0-134-104 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 14:22:13.796828 ip-10-0-134-104 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:22:13.796828 ip-10-0-134-104 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 14:22:13.796828 ip-10-0-134-104 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:22:13.798444 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.798326    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 14:22:13.807795 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807761    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:13.807795 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807785    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:13.807795 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807788    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:13.807795 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807791    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:13.807795 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807796    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:13.807795 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807799    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:13.807795 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807802    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:13.807795 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807806    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807809    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807813    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807816    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807819    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807822    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807824    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807827    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807830    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807833    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807836    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807838    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807841    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807844    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807847    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807849    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807852    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807855    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807858    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807861    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:13.808110 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807863    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807866    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807868    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807879    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807881    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807884    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807887    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807889    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807892    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807895    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807897    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807900    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807902    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807905    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807908    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807911    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807915    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807918    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807920    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807925    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:13.808584 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807930    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807933    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807936    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807939    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807942    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807945    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807947    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807950    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807953    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807956    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807958    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807961    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807965    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807968    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807970    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807973    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807976    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807978    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807982    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807985    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:13.809077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807988    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807990    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807993    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807995    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.807998    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808001    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808005    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808008    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808010    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808013    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808016    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808018    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808021    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808039    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808042    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808045    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808048    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808051    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808054    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808056    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:13.809566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808059    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808061    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808064    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808066    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808070    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808072    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808075    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808077    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808081    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808085    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808088    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808090    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808842    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808850    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808853    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808855    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808858    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808861    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808866    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:13.810060 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808869    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808872    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808875    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808878    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808881    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808883    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808886    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808888    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808891    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808894    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808897    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808900    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808904    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808908    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808912    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808915    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808917    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808921    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808923    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:13.810525 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808926    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808928    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808931    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808934    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808938    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808941    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808944    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808947    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808950    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808953    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808955    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808958    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808960    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808963    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808966    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808969    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808971    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808974    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808977    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:13.811003 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808980    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808982    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808985    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808987    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808990    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808994    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808996    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.808999    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809001    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809004    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809006    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809008    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809011    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809013    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809017    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809020    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809023    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809040    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809043    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809045    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:13.811478 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809048    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809051    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809054    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809057    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809059    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809062    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809065    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809068    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809071    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809073    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809076    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809079    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809081    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809084    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809087    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809090    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809093    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809095    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809099    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:13.811956 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809102    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809104    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809107    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809109    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809112    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809114    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809117    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809119    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809123    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809126    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809128    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809131    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809133    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809136    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809138    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809527    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809532    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809536    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809539    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809542    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:13.812433 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809545    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809547    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809550    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809553    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809555    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809558    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809561    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809563    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809566    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809568    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809571    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809575    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809579    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809582    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809584    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809587    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809589    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809592    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809594    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:13.812945 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809597    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809599    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809602    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809605    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809607    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809609    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809613    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809617    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809620    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809623    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809626    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809632    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809635    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809638    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809640    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809643    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809646    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809648    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809651    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809655    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:13.813430 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809657    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809660    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809663    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809666    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809668    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809671    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809674    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809676    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809679    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809681    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809684    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809686    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809689    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809691    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809694    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809697    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809700    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809703    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809706    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809709    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:13.813917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809711    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809714    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809716    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809722    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809725    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809731    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809734    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809737    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809739    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809742    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809744    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809747    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809749    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809752    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809754    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809757    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809759    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809762    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809765    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:13.814454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809767    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809770    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809772    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809774    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809777    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809779    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809782    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809786    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809790    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809793    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809796    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809799    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809801    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809804    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809807    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.809809    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809892    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809904    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809925    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809931    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 14:22:13.814918 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809937    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809942    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809947    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809952    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809955    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809958    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809961    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809964    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809968    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809971    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809974    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809977    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809981    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809984    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809988    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809991    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809994    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.809997    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810002    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810006    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810009    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810012    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810015    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810019    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 14:22:13.815465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810022    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810037    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810040    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810043    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810049    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810052    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810056    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810059    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810062    2574 flags.go:64] FLAG: --enable-server="true"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810065    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810071    2574 flags.go:64] FLAG: --event-burst="100"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810074    2574 flags.go:64] FLAG: --event-qps="50"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810077    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810080    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810083    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810087    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810090    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810093    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810096    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810099    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810102    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810106    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810109    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810112    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810114    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 14:22:13.816094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810117    2574 flags.go:64] FLAG: --feature-gates=""
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810123    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810126    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810129    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810132    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810136    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810139    2574 flags.go:64] FLAG: --help="false"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810142    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810146    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810149    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810151    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810156    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810159    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810162    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810165    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810168    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810171    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810174    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810177    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810180    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810183    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810186    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810203    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810207    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 14:22:13.816701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810210    2574 flags.go:64] FLAG: --lock-file=""
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810213    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810217    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810220    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810226    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810229    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810232    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810235    2574 flags.go:64] FLAG: --logging-format="text"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810238    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810243    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810246    2574 flags.go:64] FLAG: --manifest-url=""
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810249    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810253    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810256    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810260    2574 flags.go:64] FLAG: --max-pods="110"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810263    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810266    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810269    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810272    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810275    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810279    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810282    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810290    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810293    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810296    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 14:22:13.817304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810299    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810302    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810308    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810311    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810314    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810317    2574 flags.go:64] FLAG: --port="10250"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810320    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810323    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f1bfe50e39e7e28c"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810326    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810329    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810333    2574 flags.go:64] FLAG: --register-node="true"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810336    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810340    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810343    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810346    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810349    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810354    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810357    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810360    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810363    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810366    2574 flags.go:64] FLAG: --runonce="false"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810369    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810372    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810375    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810378    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 14:22:13.817905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810381    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810384    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810387    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810391    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810393    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810396    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810399    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810402    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810405    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810408    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810411    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810422    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810425    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810429    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810434    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810436    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810439    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810442    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810445    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810448    2574 flags.go:64] FLAG: --v="2"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810452    2574 flags.go:64] FLAG: --version="false"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810457    2574 flags.go:64] FLAG: --vmodule=""
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810461    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810465    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810601    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:13.818535 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810612    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810618    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810621    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810624    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810627    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810630    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810633    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810636    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810639    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810642    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810645    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810647    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810650    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810653    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810655    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810658    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810660    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810663    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810665    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810668    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:13.819173 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810670    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810673    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810675    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810677    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810681    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810685    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810688    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810690    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810693    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810696    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810700    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810703    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810705    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810710    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810713    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810715    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810718    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810721    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810723    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810726    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:13.819696 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810728    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810731    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810734    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810736    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810739    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810741    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810744    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810746    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810749    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810751    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810754    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810756    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810759    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810762    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810764    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810767    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810769    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810772    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810774    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810777    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:13.820212 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810779    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810782    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810786    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810789    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810792    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810797    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810799    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810802    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810804    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810807    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810810    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810813    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810815    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810819    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810823    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810826    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810829    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810832    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810835    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:13.820698 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810838    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810841    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810844    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810846    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810849    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810852    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810855    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810859    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810861    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810865    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810868    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810871    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810873    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810876    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810879    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810883    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810886    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810889    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:13.821207 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.810893    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.810898    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.817979    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.817999    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.819085    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.819094    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819161    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819167    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819171    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819174    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819178    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819181    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819184    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819187    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819190    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:13.821642 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819193    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819196    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819199    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819202    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819206    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819208    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819212    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819214    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819217    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819220    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819222    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819225    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819227    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819230    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819232    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819235    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819238    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819240    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819244    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:13.822017 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819247    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819251    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819253    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819258    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819261    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819264    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819268    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819271    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819274    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819277    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819279    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819282    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819285    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819289    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819292    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819295    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819299    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819301    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819304    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:13.822491 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819307    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819311    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819313    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819316    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819319    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819321    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819324    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819327    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819329    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819332    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819334    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819337    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819340    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819343    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819346    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819349    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819352    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819355    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819357    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819360    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:13.822951 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819362    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819365    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819367    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819370    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819372    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819375    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819377    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819380    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819383    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819385    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819388    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819391    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819393    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819395    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819398    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819401    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819403    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819406    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819408    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819411    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:13.823453 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819414    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819416    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819419    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819423    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819426    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819429    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819432    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819435    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819439    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819441    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819444    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819446    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.819453    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819570    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819575    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:13.823938 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819578    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819581    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819584    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819587    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819590    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819593    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819595    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819598    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819601    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819604    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819607    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819609    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819612    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819614    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819617    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819619    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819622    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819624    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819627    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819629    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:13.824329 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819632    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819634    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819637    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819640    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819643    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819646    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819649    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819651    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819654    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819656    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819659    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819661    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819664    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819666    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819669    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819672    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819674    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819676    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819679    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:13.824814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819682    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819685    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819689    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819692    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819695    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819698    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819701    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819705    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819707    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819710    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819713    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819715    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819718    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819720    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819723    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819726    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819729    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819732    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819734    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819737    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:13.825291 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819740    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819742    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819745    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819748    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819751    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819754    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819756    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819759    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819761    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819764    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819766    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819769    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819773    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819776    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819779    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819782    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819784    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819787    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819789    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:13.825774 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819792    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819795    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819797    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819799    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819802    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819805    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819807    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819810    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819813    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819815    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819818    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819820    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819823    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819825    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819828    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819831    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819833    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819836    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:13.826257 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:13.819839    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:13.826725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.819844    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:22:13.826725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.819979    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 14:22:13.826725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.822082    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 14:22:13.826725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.823782    2574 server.go:1019] "Starting client certificate rotation"
Jul 24 14:22:13.826725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.823889    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 14:22:13.826725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.823923    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 14:22:13.826725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.826566    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 14:22:13.829475 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.829459    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 14:22:13.838698 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.838673    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 24 14:22:13.843000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.842980    2574 log.go:25] "Validated CRI v1 image API"
Jul 24 14:22:13.843831 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.843815    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 14:22:13.846770 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.846738    2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 840db29a-52f1-412d-8c4c-0777b9d4ed70:/dev/nvme0n1p3 cf3358f4-f6b5-4bcc-aa87-e7a5d9284733:/dev/nvme0n1p4]
Jul 24 14:22:13.846843 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.846769    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 14:22:13.851912 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.851797    2574 manager.go:216] Machine: {Timestamp:2026-07-24 14:22:13.850572063 +0000 UTC m=+0.292322573 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100112 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec208e3e75e9d949dcf89017861015c7 SystemUUID:ec208e3e-75e9-d949-dcf8-9017861015c7 BootID:28e8b100-28bb-4d46-9015-d917ad25d462 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b9:4b:1e:46:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b9:4b:1e:46:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:10:45:1a:69:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 14:22:13.851912 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.851900    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 14:22:13.852086 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.852007    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 14:22:13.854873 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.854843    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 14:22:13.855017 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.854873    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 14:22:13.856014 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.855998    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 14:22:13.856095 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.856019    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 14:22:13.856095 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.856044    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 14:22:13.856689 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.856675    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 14:22:13.858094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.858080    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 14:22:13.861079 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861061    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 14:22:13.861439 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861426    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 14:22:13.861556 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861547    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 14:22:13.861602 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861575    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 14:22:13.861602 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861584    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 14:22:13.861602 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861595    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 14:22:13.861602 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861604    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 24 14:22:13.861764 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861613    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 14:22:13.861974 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861961    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 14:22:13.862015 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.861986    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 14:22:13.863928 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.863910    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 14:22:13.865629 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.865613    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 14:22:13.865688 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.865643    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 14:22:13.866369 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866344    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 14:22:13.866369 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866360    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 14:22:13.866369 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866372    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866381    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866393    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866400    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866413    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866420    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866430    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866441    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866456    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 14:22:13.866530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.866462    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 14:22:13.867050 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.867040    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 14:22:13.867050 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.867051    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 14:22:13.870152 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.870135    2574 server.go:1268] "Started kubelet"
Jul 24 14:22:13.870277 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.870224    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 14:22:13.870375 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.870296    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 14:22:13.870375 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.870300    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 14:22:13.870963 ip-10-0-134-104 systemd[1]: Started Kubernetes Kubelet.
Jul 24 14:22:13.872174 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.872146    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 14:22:13.875535 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.875129    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:13.875535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.875243    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:13.875535 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.875487    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:13.877593 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.876548    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 14:22:13.878767 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.878736    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 14:22:13.884568 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.883722    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f3e15da1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.870108065 +0000 UTC m=+0.311858573,LastTimestamp:2026-07-24 14:22:13.870108065 +0000 UTC m=+0.311858573,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:13.884759 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.884736    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 14:22:13.884837 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.884741    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 14:22:13.885044 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.885006    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:22:13.885459 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.885439    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 14:22:13.885459 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.885461    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 14:22:13.885614 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.885600    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 14:22:13.885664 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.885615    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 14:22:13.885664 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.885600    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 14:22:13.885664 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.885645    2574 factory.go:55] Registering systemd factory
Jul 24 14:22:13.885664 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.885662    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 24 14:22:13.886016 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.885991    2574 factory.go:153] Registering CRI-O factory
Jul 24 14:22:13.886016 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.886009    2574 factory.go:223] Registration of the crio container factory successfully
Jul 24 14:22:13.886198 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.886076    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 14:22:13.886198 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.886099    2574 factory.go:103] Registering Raw factory
Jul 24 14:22:13.886198 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.886109    2574 manager.go:1196] Started watching for new ooms in manager
Jul 24 14:22:13.887158 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.887144    2574 manager.go:349] Starting recovery of all containers
Jul 24 14:22:13.889285 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.889254    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:13.889501 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.889465    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 14:22:13.897423 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.897406    2574 manager.go:354] Recovery completed
Jul 24 14:22:13.901430 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.901415    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:13.903882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.903866    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:13.903947 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.903900    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:13.903947 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.903911    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:13.904461 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.904447    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 14:22:13.904461 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.904459    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 14:22:13.904559 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.904473    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 14:22:13.904559 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.904535    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:13.905428 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.905412    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:13.905507 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.905438    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:13.905507 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.905464    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:13.905752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.905739    2574 policy_none.go:49] "None policy: Start"
Jul 24 14:22:13.905788 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.905755    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 14:22:13.905788 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.905765    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 14:22:13.906786 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.906776    2574 policy_none.go:47] "Start"
Jul 24 14:22:13.908402 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.908311    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,LastTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:13.920405 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.920334    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e51102  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,LastTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:13.930076 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.929986    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e53772  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903914866 +0000 UTC m=+0.345665377,LastTimestamp:2026-07-24 14:22:13.903914866 +0000 UTC m=+0.345665377,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:13.933972 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.933946    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lrsvg"
Jul 24 14:22:13.944173 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.944096    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,LastTimestamp:2026-07-24 14:22:13.905426239 +0000 UTC m=+0.347176749,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:13.946898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.946884    2574 manager.go:337] "Starting Device Plugin manager"
Jul 24 14:22:13.946964 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.946918    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 14:22:13.946964 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.946929    2574 server.go:87] "Starting device plugin registration server"
Jul 24 14:22:13.947241 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.947228    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 14:22:13.947286 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.947244    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 14:22:13.947349 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.947329    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 14:22:13.947545 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.947424    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 14:22:13.947545 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:13.947438    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 14:22:13.947900 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.947873    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 14:22:13.947979 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.947925    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:22:13.956859 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.956778    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e51102\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e51102  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,LastTimestamp:2026-07-24 14:22:13.905443464 +0000 UTC m=+0.347193974,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:13.969905 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.969816    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e53772\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e53772  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903914866 +0000 UTC m=+0.345665377,LastTimestamp:2026-07-24 14:22:13.905468498 +0000 UTC m=+0.347219008,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:13.983241 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:13.983155    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f9077295  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.956489877 +0000 UTC m=+0.398240378,LastTimestamp:2026-07-24 14:22:13.956489877 +0000 UTC m=+0.398240378,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.010889 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.010851    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 14:22:14.012146 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.012120    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 14:22:14.012251 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.012170    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 14:22:14.012251 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.012197    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 14:22:14.012251 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.012238    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 14:22:14.032021 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.031994    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:14.048130 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.048062    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:14.049187 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.049166    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:14.049290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.049197    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:14.049290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.049212    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:14.049290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.049236    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.063325 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.063243    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,LastTimestamp:2026-07-24 14:22:14.049180729 +0000 UTC m=+0.490931238,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.075948 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.075903    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.075948 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.075882    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e51102\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e51102  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,LastTimestamp:2026-07-24 14:22:14.049203764 +0000 UTC m=+0.490954276,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.081079 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.080985    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e53772\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e53772  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903914866 +0000 UTC m=+0.345665377,LastTimestamp:2026-07-24 14:22:14.049217017 +0000 UTC m=+0.490967526,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.092817 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.092778    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms"
Jul 24 14:22:14.112928 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.112896    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal"]
Jul 24 14:22:14.113007 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.112993    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:14.116642 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.116620    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:14.116750 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.116651    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:14.116750 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.116661    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:14.118943 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.118929    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:14.119168 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.119154    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.119207 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.119194    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:14.119750 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.119732    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:14.119823 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.119764    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:14.119823 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.119779    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:14.120339 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.120325    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:14.120378 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.120353    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:14.120378 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.120362    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:14.122064 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.122048    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.122129 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.122079    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:14.122788 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.122772    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:14.122883 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.122795    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:14.122883 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.122804    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:14.127488 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.127423    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,LastTimestamp:2026-07-24 14:22:14.116637619 +0000 UTC m=+0.558388128,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.143289 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.143186    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e51102\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e51102  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,LastTimestamp:2026-07-24 14:22:14.116656072 +0000 UTC m=+0.558406581,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.145065 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.145047    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.149568 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.149554    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.154513 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.154448    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e53772\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e53772  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903914866 +0000 UTC m=+0.345665377,LastTimestamp:2026-07-24 14:22:14.116665609 +0000 UTC m=+0.558416119,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.164336 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.164260    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,LastTimestamp:2026-07-24 14:22:14.119747514 +0000 UTC m=+0.561498033,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.175714 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.175637    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e51102\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e51102  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,LastTimestamp:2026-07-24 14:22:14.11977119 +0000 UTC m=+0.561521703,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.186846 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.186815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675a7bee8955409b744ccede8cdbf52a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal\" (UID: \"675a7bee8955409b744ccede8cdbf52a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.186846 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.186848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/977e39685fd9fa3034b3c1273f0bec72-config\") pod \"kube-apiserver-proxy-ip-10-0-134-104.ec2.internal\" (UID: \"977e39685fd9fa3034b3c1273f0bec72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.187042 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.186864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/675a7bee8955409b744ccede8cdbf52a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal\" (UID: \"675a7bee8955409b744ccede8cdbf52a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.202493 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.202411    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e53772\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e53772  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903914866 +0000 UTC m=+0.345665377,LastTimestamp:2026-07-24 14:22:14.119784843 +0000 UTC m=+0.561535353,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.217550 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.217465    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,LastTimestamp:2026-07-24 14:22:14.120339722 +0000 UTC m=+0.562090231,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.229778 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.229694    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e51102\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e51102  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,LastTimestamp:2026-07-24 14:22:14.120357852 +0000 UTC m=+0.562108362,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.239886 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.239804    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e53772\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e53772  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903914866 +0000 UTC m=+0.345665377,LastTimestamp:2026-07-24 14:22:14.120366843 +0000 UTC m=+0.562117354,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.256485 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.256401    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,LastTimestamp:2026-07-24 14:22:14.122783881 +0000 UTC m=+0.564534391,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.270321 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.270229    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e51102\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e51102  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,LastTimestamp:2026-07-24 14:22:14.122799485 +0000 UTC m=+0.564549994,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.276213 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.276197    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:14.277120 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.277101    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:14.277238 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.277137    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:14.277238 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.277156    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:14.277238 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.277191    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.278729 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.278653    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e53772\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e53772  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903914866 +0000 UTC m=+0.345665377,LastTimestamp:2026-07-24 14:22:14.122808629 +0000 UTC m=+0.564559139,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.287476 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.287450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675a7bee8955409b744ccede8cdbf52a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal\" (UID: \"675a7bee8955409b744ccede8cdbf52a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.287584 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.287478    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/977e39685fd9fa3034b3c1273f0bec72-config\") pod \"kube-apiserver-proxy-ip-10-0-134-104.ec2.internal\" (UID: \"977e39685fd9fa3034b3c1273f0bec72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.287584 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.287497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/675a7bee8955409b744ccede8cdbf52a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal\" (UID: \"675a7bee8955409b744ccede8cdbf52a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.287584 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.287572    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/675a7bee8955409b744ccede8cdbf52a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal\" (UID: \"675a7bee8955409b744ccede8cdbf52a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.287710 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.287625    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/675a7bee8955409b744ccede8cdbf52a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal\" (UID: \"675a7bee8955409b744ccede8cdbf52a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.287710 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.287664    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/977e39685fd9fa3034b3c1273f0bec72-config\") pod \"kube-apiserver-proxy-ip-10-0-134-104.ec2.internal\" (UID: \"977e39685fd9fa3034b3c1273f0bec72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.289288 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.289219    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e4b721  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903882017 +0000 UTC m=+0.345632526,LastTimestamp:2026-07-24 14:22:14.277119538 +0000 UTC m=+0.718870052,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.289392 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.289315    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.301985 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.301045    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-104.ec2.internal.18c53fc2f5e51102\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-104.ec2.internal.18c53fc2f5e51102  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-104.ec2.internal,UID:ip-10-0-134-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:13.903905026 +0000 UTC m=+0.345655535,LastTimestamp:2026-07-24 14:22:14.277146399 +0000 UTC m=+0.718896909,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:14.447879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.447835    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.453784 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.453459    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.506353 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.506182    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms"
Jul 24 14:22:14.690102 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.690064    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:14.692101 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.692082    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:14.692205 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.692117    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:14.692205 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.692129    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:14.692205 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.692156    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.716620 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.716577    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:14.717016 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:14.716993    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:14.887559 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.887526    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:14.999266 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:14.999238    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:15.000357 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.000333    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:15.000462 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.000373    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:15.000462 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.000388    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:15.072879 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:15.072844    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977e39685fd9fa3034b3c1273f0bec72.slice/crio-a482e0c9e26f4394033238b99ffa76e1bff6455d00d1d3e7771639982882bdec WatchSource:0}: Error finding container a482e0c9e26f4394033238b99ffa76e1bff6455d00d1d3e7771639982882bdec: Status 404 returned error can't find the container with id a482e0c9e26f4394033238b99ffa76e1bff6455d00d1d3e7771639982882bdec
Jul 24 14:22:15.073079 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:22:15.073062    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675a7bee8955409b744ccede8cdbf52a.slice/crio-29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 WatchSource:0}: Error finding container 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83: Status 404 returned error can't find the container with id 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83
Jul 24 14:22:15.079597 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.079575    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:22:15.089329 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:15.089257    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc33bfb3732  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\",Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:15.079761714 +0000 UTC m=+1.521512215,LastTimestamp:2026-07-24 14:22:15.079761714 +0000 UTC m=+1.521512215,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:15.103424 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:15.103338    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-104.ec2.internal.18c53fc33bfc0dc9  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-104.ec2.internal,UID:977e39685fd9fa3034b3c1273f0bec72,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\",Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:15.079816649 +0000 UTC m=+1.521567147,LastTimestamp:2026-07-24 14:22:15.079816649 +0000 UTC m=+1.521567147,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:15.149260 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:15.149231    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:15.317072 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:15.316989    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s"
Jul 24 14:22:15.329523 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:15.329497    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:15.342626 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:15.342591    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:15.517683 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.517647    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:15.518646 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.518628    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:15.518713 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.518661    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:15.518713 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.518671    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:15.518713 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.518702    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:15.538139 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:15.538113    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:15.884860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:15.884830    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:16.017197 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:16.017130    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal" event={"ID":"977e39685fd9fa3034b3c1273f0bec72","Type":"ContainerStarted","Data":"a482e0c9e26f4394033238b99ffa76e1bff6455d00d1d3e7771639982882bdec"}
Jul 24 14:22:16.018375 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:16.018338    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerStarted","Data":"29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83"}
Jul 24 14:22:16.681556 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:16.681516    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:16.885722 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:16.885691    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:16.926553 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:16.926520    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s"
Jul 24 14:22:17.017218 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.017136    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:17.138693 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.138642    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:17.139933 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.139893    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:17.140089 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.139945    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:17.140089 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.139962    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:17.140089 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.139999    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:17.159828 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.159792    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:17.168986 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.168955    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:17.170076 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.170046    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:17.170198 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.170091    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:17.170198 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.170104    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:17.207821 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.207739    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3ba16360c  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" in 2.115s (2.115s including waiting). Image size: 278280461 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.195460108 +0000 UTC m=+3.637210606,LastTimestamp:2026-07-24 14:22:17.195460108 +0000 UTC m=+3.637210606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:17.250074 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.249980    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-104.ec2.internal.18c53fc3bca8a21f  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-104.ec2.internal,UID:977e39685fd9fa3034b3c1273f0bec72,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\" in 2.158s (2.158s including waiting). Image size: 317186379 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.238610463 +0000 UTC m=+3.680360966,LastTimestamp:2026-07-24 14:22:17.238610463 +0000 UTC m=+3.680360966,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:17.308855 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.308772    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-104.ec2.internal.18c53fc3c02da417  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-104.ec2.internal,UID:977e39685fd9fa3034b3c1273f0bec72,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.297658903 +0000 UTC m=+3.739409426,LastTimestamp:2026-07-24 14:22:17.297658903 +0000 UTC m=+3.739409426,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:17.322411 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.322330    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-104.ec2.internal.18c53fc3c0b379cb  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-104.ec2.internal,UID:977e39685fd9fa3034b3c1273f0bec72,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.306429899 +0000 UTC m=+3.748180399,LastTimestamp:2026-07-24 14:22:17.306429899 +0000 UTC m=+3.748180399,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:17.426630 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.426539    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.41415858 +0000 UTC m=+3.855909079,LastTimestamp:2026-07-24 14:22:17.41415858 +0000 UTC m=+3.855909079,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:17.436728 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.436635    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.424805965 +0000 UTC m=+3.866556481,LastTimestamp:2026-07-24 14:22:17.424805965 +0000 UTC m=+3.866556481,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:17.484902 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:17.484872    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:17.888318 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:17.888288    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:18.026394 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.026351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal" event={"ID":"977e39685fd9fa3034b3c1273f0bec72","Type":"ContainerStarted","Data":"0282852de783681290861b8a8319c888c178a3da4af1c0567e080fcfbdf4750d"}
Jul 24 14:22:18.026394 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.026384    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:18.027851 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.027826    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerStarted","Data":"4f33f152d0ce6f44e769b0fde5c432075dfd2165b95914d27758ab40a042b0ce"}
Jul 24 14:22:18.027963 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.027889    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:18.028536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.028517    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:18.028626 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.028554    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:18.028626 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.028570    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:18.028780 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:18.028765    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:18.028857 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.028840    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:18.028916 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.028876    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:18.028916 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.028890    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:18.029078 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:18.029064    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:18.064872 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:18.064840    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:18.888988 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:18.888949    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:19.029636 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.029609    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:19.030150 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.029609    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:19.030627 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.030600    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:19.030722 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.030633    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:19.030722 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.030645    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:19.030722 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.030601    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:19.030722 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.030713    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:19.030861 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.030726    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:19.030906 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:19.030890    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:19.030948 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:19.030929    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:19.887838 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:19.887797    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:20.137296 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:20.137257    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s"
Jul 24 14:22:20.360384 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:20.360331    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:20.361537 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:20.361517    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:20.361617 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:20.361551    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:20.361617 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:20.361565    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:20.361617 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:20.361610    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:20.381547 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:20.381519    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:20.848045 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:20.847991    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:20.884584 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:20.884553    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:21.886480 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:21.886446    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:21.893194 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:21.893172    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:21.894229 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:21.894209    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:21.894350 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:21.894240    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:21.894350 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:21.894250    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:22.703746 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:22.703711    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:22.888984 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:22.888952    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:22.959267 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:22.959180    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:23.170833 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:23.170795    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:23.887500 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:23.887472    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:23.950698 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:23.950665    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:22:24.887300 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:24.887257    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:25.890569 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:25.890541    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:26.547496 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:26.547458    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:26.781863 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:26.781819    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:26.782821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:26.782801    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:26.782902 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:26.782832    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:26.782902 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:26.782842    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:26.782902 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:26.782873    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:26.798946 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:26.798875    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:26.890731 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:26.890700    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:27.883760 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:27.883731    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:28.885628 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:28.885556    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:29.045988 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:29.045962    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/0.log"
Jul 24 14:22:29.046145 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:29.045998    2574 generic.go:356] "Generic (PLEG): container finished" podID="675a7bee8955409b744ccede8cdbf52a" containerID="4f33f152d0ce6f44e769b0fde5c432075dfd2165b95914d27758ab40a042b0ce" exitCode=1
Jul 24 14:22:29.046145 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:29.046051    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerDied","Data":"4f33f152d0ce6f44e769b0fde5c432075dfd2165b95914d27758ab40a042b0ce"}
Jul 24 14:22:29.046211 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:29.046151    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:29.047011 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:29.046991    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:29.047141 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:29.047022    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:29.047141 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:29.047055    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:29.047254 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:29.047242    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:29.061149 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:29.061061    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc67cabab03  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:29.049969411 +0000 UTC m=+15.491719908,LastTimestamp:2026-07-24 14:22:29.049969411 +0000 UTC m=+15.491719908,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:29.153453 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:29.153327    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.41415858 +0000 UTC m=+3.855909079,LastTimestamp:2026-07-24 14:22:29.121326003 +0000 UTC m=+15.563076499,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:29.162629 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:29.162548    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.424805965 +0000 UTC m=+3.866556481,LastTimestamp:2026-07-24 14:22:29.130497247 +0000 UTC m=+15.572247744,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:29.411315 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:29.411244    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:29.885040 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:29.884997    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:30.049972 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:30.049946    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/0.log"
Jul 24 14:22:30.050325 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:30.049990    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerStarted","Data":"8be1a209aee72cdb647580873018a67ab9f7880acff0ec081cfb6404b6526e7f"}
Jul 24 14:22:30.050325 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:30.050117    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:30.050989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:30.050971    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:30.051094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:30.051003    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:30.051094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:30.051012    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:30.051219 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:30.051206    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:30.885088 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:30.885056    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:31.065326 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:31.065300    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:31.066320 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:31.066297    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:31.066437 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:31.066335    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:31.066437 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:31.066348    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:31.884738 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:31.884706    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:31.897407 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:31.897377    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:32.420828 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:32.420792    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:32.889868 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:32.889795    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:33.270595 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:33.270558    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:33.558457 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:33.558374    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:33.799740 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:33.799703    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:33.800773 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:33.800748    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:33.800866 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:33.800784    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:33.800866 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:33.800795    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:33.800866 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:33.800819    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:33.817892 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:33.817831    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:33.886240 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:33.886207    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:33.951553 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:33.951520    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:22:34.886223 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:34.886194    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:35.890321 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:35.890290    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:36.886322 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:36.886291    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:37.884416 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:37.884373    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:38.884605 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:38.884575    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:39.887538 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:39.887501    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:40.569494 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:40.569460    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:40.818694 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:40.818655    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:40.819700 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:40.819647    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:40.819700 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:40.819677    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:40.819700 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:40.819691    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:40.819863 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:40.819723    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:40.839923 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:40.839893    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:40.887801 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:40.887771    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:41.068093 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.068064    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/1.log"
Jul 24 14:22:41.068445 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.068428    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/0.log"
Jul 24 14:22:41.068495 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.068463    2574 generic.go:356] "Generic (PLEG): container finished" podID="675a7bee8955409b744ccede8cdbf52a" containerID="8be1a209aee72cdb647580873018a67ab9f7880acff0ec081cfb6404b6526e7f" exitCode=1
Jul 24 14:22:41.068495 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.068487    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerDied","Data":"8be1a209aee72cdb647580873018a67ab9f7880acff0ec081cfb6404b6526e7f"}
Jul 24 14:22:41.068579 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.068568    2574 scope.go:117] "RemoveContainer" containerID="4f33f152d0ce6f44e769b0fde5c432075dfd2165b95914d27758ab40a042b0ce"
Jul 24 14:22:41.068656 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.068640    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:41.069476 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.069463    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:41.069588 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.069491    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:41.069588 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.069507    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:41.070139 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:41.069685    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:41.070139 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.069729    2574 scope.go:117] "RemoveContainer" containerID="4f33f152d0ce6f44e769b0fde5c432075dfd2165b95914d27758ab40a042b0ce"
Jul 24 14:22:41.078170 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:41.078126    2574 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_0 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: '4f33f152d0ce6f44e769b0fde5c432075dfd2165b95914d27758ab40a042b0ce'" containerID="4f33f152d0ce6f44e769b0fde5c432075dfd2165b95914d27758ab40a042b0ce"
Jul 24 14:22:41.078257 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:41.078182    2574 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_0 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: '4f33f152d0ce6f44e769b0fde5c432075dfd2165b95914d27758ab40a042b0ce'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" logger="UnhandledError"
Jul 24 14:22:41.078333 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:41.078315    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:22:41.087115 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:41.087044    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:41.886481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:41.886452    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:42.071175 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:42.071149    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/1.log"
Jul 24 14:22:42.884634 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:42.884602    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:43.883230 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:43.883200    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:43.951998 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:43.951948    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:22:44.888798 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:44.888767    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:45.885613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:45.885588    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:46.885893 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:46.885869    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:47.499041 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:47.499001    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:47.582185 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:47.582140    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:47.841075 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.840961    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:47.841919 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.841901    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:47.841987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.841934    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:47.841987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.841944    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:47.841987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.841972    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:47.862004 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:47.861976    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:47.884067 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.884046    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:47.976922 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.976899    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:47.977982 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.977963    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:47.978057 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.977998    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:47.978057 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:47.978013    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:48.884920 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:48.884892    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:49.891258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:49.891233    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:50.897595 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:50.897564    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:51.888167 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:51.888139    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:52.606611 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:52.606581    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:52.891638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:52.891565    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:53.887712 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:53.887681    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:53.952992 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:53.952939    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:22:54.012987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.012955    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:54.014947 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.014932    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:54.015013 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.014961    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:54.015013 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.014971    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:54.015164 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:54.015152    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:54.027611 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:54.027512    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc67cabab03\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc67cabab03  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:29.049969411 +0000 UTC m=+15.491719908,LastTimestamp:2026-07-24 14:22:54.015883954 +0000 UTC m=+40.457634453,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:54.103730 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:54.103651    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.41415858 +0000 UTC m=+3.855909079,LastTimestamp:2026-07-24 14:22:54.09171956 +0000 UTC m=+40.533470069,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:54.115840 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:54.115764    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.424805965 +0000 UTC m=+3.866556481,LastTimestamp:2026-07-24 14:22:54.10016361 +0000 UTC m=+40.541914108,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:22:54.595583 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:54.595544    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:54.862731 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.862648    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:54.863663 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.863645    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:54.863757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.863675    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:54.863757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.863686    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:54.863757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.863716    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:54.884184 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:54.884157    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:54.884184 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:54.884171    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:55.090398 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:55.090369    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/1.log"
Jul 24 14:22:55.090803 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:55.090420    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerStarted","Data":"c8c7d43d0934fc8d0405b4d4e8bfbafab4c68b8d49b2dec3c24418196cafb726"}
Jul 24 14:22:55.090803 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:55.090558    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:55.091452 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:55.091428    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:55.091568 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:55.091464    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:55.091568 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:55.091479    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:55.091728 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:55.091713    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:22:55.884348 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:55.884321    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:56.886777 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:56.886744    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:57.397709 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:57.397679    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:57.885555 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:57.885528    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:58.829219 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:22:58.829181    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:58.885778 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:58.885749    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:59.888982 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:22:59.888948    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:00.899219 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:00.899186    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:01.606736 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:01.606696    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:01.884855 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:01.884769    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:01.885690 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:01.885673    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:01.885783 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:01.885704    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:01.885783 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:01.885719    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:01.885783 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:01.885745    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:01.889873 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:01.889855    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:01.910448 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:01.910419    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:02.885128 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:02.885100    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:03.893576 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:03.893544    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:03.953459 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:03.953426    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:23:04.884682 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:04.884650    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:05.891293 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:05.891264    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:06.108828 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.108803    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/2.log"
Jul 24 14:23:06.109178 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.109160    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/1.log"
Jul 24 14:23:06.109235 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.109194    2574 generic.go:356] "Generic (PLEG): container finished" podID="675a7bee8955409b744ccede8cdbf52a" containerID="c8c7d43d0934fc8d0405b4d4e8bfbafab4c68b8d49b2dec3c24418196cafb726" exitCode=1
Jul 24 14:23:06.109235 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.109222    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerDied","Data":"c8c7d43d0934fc8d0405b4d4e8bfbafab4c68b8d49b2dec3c24418196cafb726"}
Jul 24 14:23:06.109311 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.109274    2574 scope.go:117] "RemoveContainer" containerID="8be1a209aee72cdb647580873018a67ab9f7880acff0ec081cfb6404b6526e7f"
Jul 24 14:23:06.109345 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.109337    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:06.112253 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.112078    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:06.112253 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.112119    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:06.112253 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.112131    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:06.112417 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:06.112306    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:06.112417 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.112351    2574 scope.go:117] "RemoveContainer" containerID="8be1a209aee72cdb647580873018a67ab9f7880acff0ec081cfb6404b6526e7f"
Jul 24 14:23:06.120567 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:06.120537    2574 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_1 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: '8be1a209aee72cdb647580873018a67ab9f7880acff0ec081cfb6404b6526e7f'" containerID="8be1a209aee72cdb647580873018a67ab9f7880acff0ec081cfb6404b6526e7f"
Jul 24 14:23:06.120657 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:06.120582    2574 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_1 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: '8be1a209aee72cdb647580873018a67ab9f7880acff0ec081cfb6404b6526e7f'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" logger="UnhandledError"
Jul 24 14:23:06.120752 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:06.120732    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:23:06.130085 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:06.129991    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:23:06.12068218 +0000 UTC m=+52.562432693,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:23:06.887415 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:06.887388    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:07.111684 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:07.111658    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/2.log"
Jul 24 14:23:07.887467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:07.887435    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:08.619772 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:08.619737    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:08.885248 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:08.885180    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:08.911483 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:08.911458    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:08.912817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:08.912796    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:08.912938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:08.912826    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:08.912938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:08.912836    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:08.912938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:08.912862    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:08.938434 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:08.938404    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:09.886964 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:09.886937    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:10.894601 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:10.894573    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:11.885784 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:11.885757    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:12.884126 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:12.884095    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:13.884475 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:13.884448    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:13.954467 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:13.954433    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:23:14.887763 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:14.887729    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:15.631722 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:15.631686    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:15.886047 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:15.885949    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:15.939509 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:15.939477    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:15.941521 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:15.941502    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:15.941596 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:15.941534    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:15.941596 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:15.941544    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:15.941596 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:15.941571    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:15.965735 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:15.965699    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:16.884314 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:16.884281    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:17.890348 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:17.890315    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:18.884753 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:18.884719    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:19.885146 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:19.885099    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:20.013165 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.013125    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:20.020208 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.020179    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:20.020336 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.020219    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:20.020336 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.020232    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:20.020447 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:20.020435    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:20.020632 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:20.020604    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:23:20.031972 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:20.031893    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:23:20.020566714 +0000 UTC m=+66.462317211,Count:3,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:23:20.212067 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.212020    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:20.213090 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.213071    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:20.213181 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.213103    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:20.213181 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.213112    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:20.887946 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:20.887917    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:21.884885 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:21.884855    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:22.641637 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:22.641593    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:22.884708 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:22.884680    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:22.966617 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:22.966574    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:22.967602 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:22.967581    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:22.967703 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:22.967620    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:22.967703 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:22.967636    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:22.967703 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:22.967671    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:22.985473 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:22.985442    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:23.188067 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:23.188012    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:23:23.889785 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:23.889747    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:23.955383 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:23.955350    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:23:24.885932 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:24.885902    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:25.889521 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:25.889486    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:26.886896 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:26.886860    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:27.885302 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:27.885273    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:28.851425 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:28.851388    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:23:28.885350 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:28.885316    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:29.563160 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:29.563124    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:23:29.652630 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:29.652592    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:29.892686 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:29.892612    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:29.986098 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:29.986054    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:29.987017 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:29.986991    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:29.987151 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:29.987046    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:29.987151 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:29.987057    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:29.987151 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:29.987083    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:30.006081 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:30.006049    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:30.885277 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:30.885238    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:31.886930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:31.886901    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:32.884335 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:32.884307    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:33.012821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.012789    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:33.013705 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.013689    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:33.013757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.013718    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:33.013757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.013733    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:33.013952 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:33.013941    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:33.026386 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:33.026292    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc67cabab03\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc67cabab03  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:29.049969411 +0000 UTC m=+15.491719908,LastTimestamp:2026-07-24 14:23:33.014675681 +0000 UTC m=+79.456426191,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:23:33.087489 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:33.087411    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.41415858 +0000 UTC m=+3.855909079,LastTimestamp:2026-07-24 14:23:33.077939451 +0000 UTC m=+79.519689966,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:23:33.097779 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:33.097713    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.424805965 +0000 UTC m=+3.866556481,LastTimestamp:2026-07-24 14:23:33.086037177 +0000 UTC m=+79.527787693,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:23:33.153546 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.153469    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/2.log"
Jul 24 14:23:33.153546 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.153519    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerStarted","Data":"cdd2d519dc5e210d573e96c5600876f8303c9e207060fd717fc7a61d4bee9234"}
Jul 24 14:23:33.153739 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.153649    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:33.154379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.154364    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:33.154444 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.154392    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:33.154444 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.154402    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:33.154605 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:33.154592    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:33.886658 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:33.886623    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:33.956458 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:33.956423    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:23:34.884801 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:34.884768    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:35.885534 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:35.885425    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:36.664198 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:36.664159    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:36.885737 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:36.885706    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:37.006636 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:37.006595    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:37.008438 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:37.008420    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:37.008539 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:37.008451    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:37.008539 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:37.008465    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:37.008539 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:37.008498    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:37.030654 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:37.030623    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:37.884177 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:37.884140    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:38.885801 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:38.885765    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:39.898520 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:39.898486    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:40.886822 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:40.886793    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:41.013121 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:41.013089    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:41.017577 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:41.017559    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:41.017677 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:41.017594    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:41.017677 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:41.017608    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:41.017853 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:41.017839    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:41.885980 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:41.885949    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:42.327022 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:42.326984    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:23:42.884094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:42.884063    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:43.674717 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:43.674680    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:43.887409 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:43.887377    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:43.956896 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:43.956801    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:23:44.031098 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.031065    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:44.042655 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.041099    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:44.042655 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.041149    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:44.042655 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.041184    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:44.042655 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.041230    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:44.063148 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:44.063112    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:44.171807 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.171783    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/3.log"
Jul 24 14:23:44.172154 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.172135    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/2.log"
Jul 24 14:23:44.172260 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.172174    2574 generic.go:356] "Generic (PLEG): container finished" podID="675a7bee8955409b744ccede8cdbf52a" containerID="cdd2d519dc5e210d573e96c5600876f8303c9e207060fd717fc7a61d4bee9234" exitCode=1
Jul 24 14:23:44.172260 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.172207    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerDied","Data":"cdd2d519dc5e210d573e96c5600876f8303c9e207060fd717fc7a61d4bee9234"}
Jul 24 14:23:44.172368 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.172297    2574 scope.go:117] "RemoveContainer" containerID="c8c7d43d0934fc8d0405b4d4e8bfbafab4c68b8d49b2dec3c24418196cafb726"
Jul 24 14:23:44.172417 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.172409    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:44.173465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.173237    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:44.173465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.173270    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:44.173465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.173283    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:44.173575 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:44.173476    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:44.173575 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.173523    2574 scope.go:117] "RemoveContainer" containerID="c8c7d43d0934fc8d0405b4d4e8bfbafab4c68b8d49b2dec3c24418196cafb726"
Jul 24 14:23:44.181782 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:44.181750    2574 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_2 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: 'c8c7d43d0934fc8d0405b4d4e8bfbafab4c68b8d49b2dec3c24418196cafb726'" containerID="c8c7d43d0934fc8d0405b4d4e8bfbafab4c68b8d49b2dec3c24418196cafb726"
Jul 24 14:23:44.181862 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:44.181796    2574 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_2 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: 'c8c7d43d0934fc8d0405b4d4e8bfbafab4c68b8d49b2dec3c24418196cafb726'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" logger="UnhandledError"
Jul 24 14:23:44.181956 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:44.181939    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:23:44.192942 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:44.192865    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:23:44.181894587 +0000 UTC m=+90.623645088,Count:4,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:23:44.884941 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:44.884907    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:45.175008 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:45.174984    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/3.log"
Jul 24 14:23:45.885784 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:45.885754    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:46.888197 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:46.888163    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:47.885567 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:47.885535    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:48.885517 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:48.885480    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:49.886485 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:49.886453    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:50.687132 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:50.687097    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:50.884952 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:50.884921    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:51.064257 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:51.064184    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:51.065225 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:51.065207    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:51.065225 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:51.065239    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:51.065395 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:51.065260    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:51.065395 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:51.065288    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:51.083353 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:51.083323    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:51.884186 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:51.884155    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:52.885944 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:52.885915    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:53.886503 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:53.886467    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:53.957327 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:53.957284    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:23:54.886654 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:54.886621    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:55.888325 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:55.888292    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:56.012662 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:56.012624    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:56.013624 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:56.013605    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:56.013732 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:56.013640    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:56.013732 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:56.013655    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:56.013879 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:56.013864    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:56.014077 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:56.014053    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:23:56.022572 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:56.022501    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:23:56.014001745 +0000 UTC m=+102.455752242,Count:5,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:23:56.884422 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:56.884389    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:57.562167 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:57.562130    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:23:57.696897 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:57.696860    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:57.886851 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:57.886779    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:58.083468 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:58.083442    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:58.089903 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:58.089881    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:58.089994 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:58.089915    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:58.089994 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:58.089927    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:58.089994 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:58.089953    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:58.110459 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:23:58.110423    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:23:58.886520 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:58.886487    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:59.885542 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:23:59.885514    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:00.885995 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:00.885965    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:01.888608 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:01.888577    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:02.885974 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:02.885942    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:03.756465 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:03.756432    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:24:03.886049 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:03.886002    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:03.957626 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:03.957596    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:24:04.706907 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:04.706873    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:04.885210 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:04.885180    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:05.110708 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:05.110614    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:05.111572 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:05.111555    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:05.111676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:05.111588    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:05.111676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:05.111602    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:05.111676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:05.111635    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:05.132781 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:05.132748    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:05.889542 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:05.889510    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:06.889719 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:06.889689    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:07.887986 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:07.887956    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:08.012934 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:08.012908    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:08.014121 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:08.014094    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:08.014221 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:08.014128    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:08.014221 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:08.014143    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:08.014412 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:08.014398    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:08.014576 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:08.014557    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:24:08.026398 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:08.026327    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:24:08.014527719 +0000 UTC m=+114.456278228,Count:6,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:24:08.885020 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:08.884988    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:09.888651 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:09.888619    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:10.894937 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:10.894902    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:11.715752 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:11.715713    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:11.887527 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:11.887498    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:12.133925 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:12.133830    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:12.134788 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:12.134770    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:12.134876 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:12.134802    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:12.134876 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:12.134817    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:12.134876 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:12.134846    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:12.154648 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:12.154621    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:12.886874 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:12.886842    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:13.885233 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:13.885202    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:13.958150 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:13.958111    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:24:14.886958 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:14.886926    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:15.622816 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:15.622779    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:24:15.892848 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:15.892772    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:16.884225 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:16.884195    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:17.887393 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:17.887361    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:18.731557 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:18.731528    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:18.886638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:18.886607    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:19.155222 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:19.155134    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:19.157511 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:19.157494    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:19.157608 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:19.157526    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:19.157608 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:19.157536    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:19.157608 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:19.157561    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:19.175692 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:19.175670    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:19.891179 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:19.891150    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:20.886830 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:20.886797    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:21.885692 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:21.885660    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:22.012613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:22.012576    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:22.013506 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:22.013486    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:22.013599 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:22.013518    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:22.013599 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:22.013528    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:22.013767 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:22.013755    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:22.013921 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:22.013904    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:24:22.027439 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:22.027363    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:24:22.01387268 +0000 UTC m=+128.455623198,Count:7,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:24:22.885690 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:22.885661    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:23.890605 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:23.890574    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:23.959147 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:23.959120    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:24:24.885138 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:24.885110    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:25.742972 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:25.742939    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:25.886227 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:25.886194    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:26.036598 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:26.036533    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:24:26.176137 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:26.176096    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:26.177052 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:26.177018    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:26.177123 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:26.177069    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:26.177123 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:26.177079    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:26.177123 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:26.177107    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:26.204838 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:26.204803    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:26.888269 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:26.888020    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:27.887054 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:27.887006    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:28.887133 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:28.887101    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:29.885314 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:29.885287    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:30.884542 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:30.884511    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:31.886241 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:31.886212    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:32.022249 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:32.022204    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:32.023277 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:32.023260    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:32.023356 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:32.023288    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:32.023356 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:32.023298    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:32.755682 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:32.755644    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:32.887564 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:32.887538    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:33.205445 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:33.205417    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:33.206577 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:33.206558    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:33.206687 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:33.206593    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:33.206687 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:33.206607    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:33.206687 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:33.206641    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:33.225359 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:33.225333    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:33.887908 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:33.887878    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:33.959382 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:33.959350    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:24:34.890212 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:34.890179    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:35.884771 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:35.884737    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:36.013153 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.013110    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:36.014081 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.014064    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:36.014158 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.014092    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:36.014158 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.014103    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:36.014327 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:36.014316    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:36.028966 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:36.028860    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc67cabab03\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc67cabab03  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:29.049969411 +0000 UTC m=+15.491719908,LastTimestamp:2026-07-24 14:24:36.015138659 +0000 UTC m=+142.456889160,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:24:36.094041 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:36.093949    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c71f48f4  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.41415858 +0000 UTC m=+3.855909079,LastTimestamp:2026-07-24 14:24:36.083134753 +0000 UTC m=+142.524885250,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:24:36.105141 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:36.105075    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc3c7c1c04d  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.424805965 +0000 UTC m=+3.866556481,LastTimestamp:2026-07-24 14:24:36.091059538 +0000 UTC m=+142.532810040,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:24:36.247260 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.247236    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/3.log"
Jul 24 14:24:36.247385 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.247285    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerStarted","Data":"057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026"}
Jul 24 14:24:36.247428 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.247399    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:36.248231 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.248216    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:36.248310 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.248246    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:36.248310 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.248259    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:36.248485 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:36.248470    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:36.886560 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:36.886528    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:37.886224 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:37.886191    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:38.884601 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:38.884571    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:39.765563 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:39.765530    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:39.892068 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:39.892041    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:40.225978 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:40.225939    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:40.226943 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:40.226922    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:40.227076 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:40.226954    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:40.227076 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:40.226968    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:40.227076 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:40.226999    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:40.268071 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:40.268041    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:40.889499 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:40.889468    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:41.738645 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:41.738612    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:24:41.887932 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:41.887908    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:42.890415 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:42.890381    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:43.887344 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:43.887313    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:43.959735 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:43.959686    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:24:44.885580 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:44.885548    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:45.887676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:45.887647    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:46.777299 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:46.777262    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:46.891867 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:46.891833    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:47.264399 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.264368    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/4.log"
Jul 24 14:24:47.264773 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.264757    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/3.log"
Jul 24 14:24:47.264824 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.264793    2574 generic.go:356] "Generic (PLEG): container finished" podID="675a7bee8955409b744ccede8cdbf52a" containerID="057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026" exitCode=1
Jul 24 14:24:47.264858 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.264819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerDied","Data":"057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026"}
Jul 24 14:24:47.264894 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.264863    2574 scope.go:117] "RemoveContainer" containerID="cdd2d519dc5e210d573e96c5600876f8303c9e207060fd717fc7a61d4bee9234"
Jul 24 14:24:47.264963 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.264950    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:47.266246 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.266229    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:47.266325 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.266260    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:47.266325 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.266271    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:47.266467 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:47.266456    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:47.266526 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.266516    2574 scope.go:117] "RemoveContainer" containerID="cdd2d519dc5e210d573e96c5600876f8303c9e207060fd717fc7a61d4bee9234"
Jul 24 14:24:47.268316 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.268302    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:47.269012 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.268996    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:47.269120 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.269022    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:47.269120 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.269046    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:47.269120 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.269076    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:47.274689 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:47.274662    2574 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_3 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: 'cdd2d519dc5e210d573e96c5600876f8303c9e207060fd717fc7a61d4bee9234'" containerID="cdd2d519dc5e210d573e96c5600876f8303c9e207060fd717fc7a61d4bee9234"
Jul 24 14:24:47.274751 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:47.274711    2574 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_3 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: 'cdd2d519dc5e210d573e96c5600876f8303c9e207060fd717fc7a61d4bee9234'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" logger="UnhandledError"
Jul 24 14:24:47.275294 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:47.275261    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:24:47.281335 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:47.281259    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:24:47.274803124 +0000 UTC m=+153.716553620,Count:8,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:24:47.288937 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:47.288915    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:47.889593 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:47.889566    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:48.267623 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:48.267598    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/4.log"
Jul 24 14:24:48.885858 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:48.885834    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:49.887135 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:49.887107    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:50.887978 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:50.887949    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:51.884660 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:51.884633    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:52.888151 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:52.888117    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:53.297042 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:53.296995    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:24:53.789147 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:53.789115    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:53.886643 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:53.886614    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:53.960152 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:53.960105    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:24:54.288991 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:54.288965    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:54.289856 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:54.289835    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:54.289935 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:54.289871    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:54.289935 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:54.289884    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:54.289935 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:54.289919    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:54.325447 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:54.325423    2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:54.888947 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:54.888920    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:55.886133 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:55.886104    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:55.927708 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:55.927680    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:24:56.886245 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:56.886215    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:57.890724 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:57.890692    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:58.012583 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:58.012540    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:58.013547 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:58.013527    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:58.013661 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:58.013563    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:58.013661 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:58.013577    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:58.013817 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:58.013802    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:24:58.013983 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:58.013964    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:24:58.024471 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:58.024390    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal.18c53fc9499d1d81  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal,UID:675a7bee8955409b744ccede8cdbf52a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a),Source:EventSource{Component:kubelet,Host:ip-10-0-134-104.ec2.internal,},FirstTimestamp:2026-07-24 14:22:41.078279553 +0000 UTC m=+27.520030050,LastTimestamp:2026-07-24 14:24:58.013933721 +0000 UTC m=+164.455684234,Count:9,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-104.ec2.internal,}"
Jul 24 14:24:58.825909 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:58.825876    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lrsvg"
Jul 24 14:24:59.047637 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.047602    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.103138 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.103068    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.168959 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.168938    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.437073 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.437044    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.437073 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:59.437074    2574 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.484388 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.484363    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.506039 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.506006    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.571530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.571503    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.822754 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.822671    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 14:24:59.829994 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.829960    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 14:19:58 +0000 UTC" deadline="2028-01-31 16:02:36.745742057 +0000 UTC"
Jul 24 14:24:59.829994 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.829992    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13345h37m36.91575399s"
Jul 24 14:24:59.859148 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:24:59.859122    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:24:59.859148 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:24:59.859148    2574 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:25:00.123159 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:00.123091    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:25:00.169878 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:00.169850    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:25:00.238561 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:00.238532    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:25:00.520882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:00.520850    2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:25:00.520882 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:00.520877    2574 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-104.ec2.internal" not found
Jul 24 14:25:00.805981 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:00.805905    2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:25:01.326414 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:01.326372    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:25:01.327367 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:01.327352    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:25:01.327419 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:01.327384    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:25:01.327419 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:01.327400    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:25:01.327486 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:01.327429    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:25:01.339717 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:01.339701    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:25:01.339777 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:01.339723    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-104.ec2.internal\": node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:25:01.384654 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:01.384633    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:25:01.485461 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:01.485442    2574 kubelet_node_status.go:448] "Node not becoming ready in time after startup"
Jul 24 14:25:03.960801 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:03.960758    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:25:03.978101 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:03.978070    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:05.514048 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:05.513944    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:25:08.979499 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:08.979466    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:09.013016 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:09.012983    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:25:09.014053 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:09.014022    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:25:09.014141 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:09.014067    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:25:09.014141 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:09.014077    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:25:09.014266 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:09.014253    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:25:11.013040 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:11.012991    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:25:11.026117 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:11.026093    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:25:11.026258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:11.026133    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:25:11.026258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:11.026146    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:25:11.026421 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:11.026406    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:25:11.026587 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:11.026569    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:25:11.612595 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:11.612554    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-104.ec2.internal\": node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:25:13.961434 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:13.961385    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:25:13.979881 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:13.979840    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:18.981153 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:18.981113    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:21.896574 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:21.896521    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-104.ec2.internal\": node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:25:23.962220 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:23.962168    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-104.ec2.internal\" not found"
Jul 24 14:25:23.982449 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:23.982420    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:26.013246 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:26.013199    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:25:26.015321 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:26.015305    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:25:26.015388 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:26.015333    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:25:26.015388 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:26.015345    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:25:26.015551 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:26.015540    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-104.ec2.internal\" not found" node="ip-10-0-134-104.ec2.internal"
Jul 24 14:25:26.015695 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:26.015677    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:25:28.983357 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:28.983324    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:30.883284 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.883258    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:25:30.885715 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.885698    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal"
Jul 24 14:25:30.908943 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.908922    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 14:25:30.910320 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.910305    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal"
Jul 24 14:25:30.929060 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.929038    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:25:30.935838 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.935821    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 14:25:30.964981 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.964944    2574 apiserver.go:52] "Watching apiserver"
Jul 24 14:25:30.973919 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.973898    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 14:25:30.974782 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.974761    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs","openshift-cluster-node-tuning-operator/tuned-j6nm7","openshift-dns/node-resolver-vj9jm","openshift-image-registry/node-ca-74lxm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal","openshift-multus/multus-additional-cni-plugins-cxqzw","openshift-multus/network-metrics-daemon-k5csg","kube-system/global-pull-secret-syncer-zkd8c","kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal","openshift-multus/multus-95dfl","openshift-network-diagnostics/network-check-target-v7bz6","openshift-network-operator/iptables-alerter-klrtm","openshift-ovn-kubernetes/ovnkube-node-kj6wn","kube-system/konnectivity-agent-pwqxh"]
Jul 24 14:25:30.977236 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.977215    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:30.977384 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:30.977314    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:30.979265 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.979248    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:30.979321 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:30.979305    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:30.981361 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.981345    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:30.983439 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.983423    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:30.985128 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.985105    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 14:25:30.985425 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.985411    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:30.985736 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.985719    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 14:25:30.986922 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.986904    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 14:25:30.987050 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.986947    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 14:25:30.987050 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.986969    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 14:25:30.987982 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.987607    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:30.989762 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.989740    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:30.990440 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:30.990099    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:30.993722 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.993702    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:30.995888 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.995867    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:30.998067 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.998048    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 14:25:30.998214 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:30.998200    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.000381 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.000361    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.002470 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.002450    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.002711 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.002689    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:25:31.004319 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.004301    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007706    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007721    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007749    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007779    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007782    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9295s\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007861    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007880    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007889    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kwpgn\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007908    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.007960    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 14:25:31.008003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008010    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 14:25:31.008590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008060    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 14:25:31.008590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008089    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 14:25:31.008590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008102    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:25:31.008590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008160    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 14:25:31.008590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008255    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bnq4\""
Jul 24 14:25:31.008590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008584    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 14:25:31.008882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008683    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 14:25:31.008882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008693    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 14:25:31.008882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008716    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 14:25:31.008882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008735    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 14:25:31.008882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008752    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:25:31.008882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.008698    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lrqwn\""
Jul 24 14:25:31.009156 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.009016    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2q5gx\""
Jul 24 14:25:31.009156 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.009044    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 14:25:31.009156 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.009082    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4w69v\""
Jul 24 14:25:31.009156 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.009094    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-747zc\""
Jul 24 14:25:31.009156 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.009142    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 14:25:31.009156 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.009146    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jpbs5\""
Jul 24 14:25:31.011650 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.011631    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dbl6n\""
Jul 24 14:25:31.030618 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.030594    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 14:25:31.066154 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.066115    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jrhjr"
Jul 24 14:25:31.076296 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076274    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7370b028-13f9-4584-bc28-3dc77abfa88e-host\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.076391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076304    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7370b028-13f9-4584-bc28-3dc77abfa88e-serviceca\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.076391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqsfx\" (UniqueName: \"kubernetes.io/projected/7370b028-13f9-4584-bc28-3dc77abfa88e-kube-api-access-pqsfx\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.076391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2386794d-566b-4007-9d3d-d7123abd6cd8-hosts-file\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.076391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076357    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.076391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8frz\" (UniqueName: \"kubernetes.io/projected/bfdef066-3d24-4732-8e6c-ef99788f6c97-kube-api-access-m8frz\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.076592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076422    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:31.076592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076445    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:31.076592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076473    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2386794d-566b-4007-9d3d-d7123abd6cd8-tmp-dir\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.076592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076495    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtpcl\" (UniqueName: \"kubernetes.io/projected/2386794d-566b-4007-9d3d-d7123abd6cd8-kube-api-access-jtpcl\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.076592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076509    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57f4836a-b235-4ff7-bbf7-03cd41122d70-agent-certs\") pod \"konnectivity-agent-pwqxh\" (UID: \"57f4836a-b235-4ff7-bbf7-03cd41122d70\") " pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:31.076592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-system-cni-dir\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.076592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076545    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.076592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.076855 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076629    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmhpv\" (UniqueName: \"kubernetes.io/projected/2375495c-6984-4770-bf48-5acc20cc4e7e-kube-api-access-hmhpv\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:31.076855 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076679    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57f4836a-b235-4ff7-bbf7-03cd41122d70-konnectivity-ca\") pod \"konnectivity-agent-pwqxh\" (UID: \"57f4836a-b235-4ff7-bbf7-03cd41122d70\") " pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:31.076855 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-cnibin\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.076855 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076713    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-os-release\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.076855 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.076729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.086536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.086508    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 14:25:31.100072 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.100048    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jrhjr"
Jul 24 14:25:31.176925 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.176896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2386794d-566b-4007-9d3d-d7123abd6cd8-tmp-dir\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.177045 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.176933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.177045 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.176950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-netns\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.177045 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.176966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-ovn\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177045 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.176998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-node-log\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177045 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177015    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-cni-bin\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-env-overrides\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177080    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-ovnkube-script-lib\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177096    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-modprobe-d\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177109    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-tuned\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-kubelet\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqsfx\" (UniqueName: \"kubernetes.io/projected/7370b028-13f9-4584-bc28-3dc77abfa88e-kube-api-access-pqsfx\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-systemd\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-var-lib-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-run-ovn-kubernetes\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-systemd\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.177305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177295    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-cni-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-k8s-cni-cncf-io\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8frz\" (UniqueName: \"kubernetes.io/projected/bfdef066-3d24-4732-8e6c-ef99788f6c97-kube-api-access-m8frz\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177376    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-slash\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-cni-bin\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177390    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2386794d-566b-4007-9d3d-d7123abd6cd8-tmp-dir\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-etc-kubernetes\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4kqc\" (UniqueName: \"kubernetes.io/projected/6384e7ff-942c-4e00-a8e2-68b1925e859f-kube-api-access-n4kqc\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177462    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177476    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtpcl\" (UniqueName: \"kubernetes.io/projected/2386794d-566b-4007-9d3d-d7123abd6cd8-kube-api-access-jtpcl\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177492    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177510    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-registration-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86pvw\" (UniqueName: \"kubernetes.io/projected/38185898-f1c1-4d7c-aa21-48dca639df02-kube-api-access-86pvw\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.177555    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177618    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd502c5d-789c-496f-b8ca-60ba09a144c5-tmp\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.177821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-daemon-config\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.177683    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs podName:2375495c-6984-4770-bf48-5acc20cc4e7e nodeName:}" failed. No retries permitted until 2026-07-24 14:25:31.677661139 +0000 UTC m=+198.119411659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs") pod "network-metrics-daemon-k5csg" (UID: "2375495c-6984-4770-bf48-5acc20cc4e7e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmhpv\" (UniqueName: \"kubernetes.io/projected/2375495c-6984-4770-bf48-5acc20cc4e7e-kube-api-access-hmhpv\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177737    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57f4836a-b235-4ff7-bbf7-03cd41122d70-konnectivity-ca\") pod \"konnectivity-agent-pwqxh\" (UID: \"57f4836a-b235-4ff7-bbf7-03cd41122d70\") " pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-socket-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177793    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-log-socket\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177842    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-lib-modules\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177891    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc69n\" (UniqueName: \"kubernetes.io/projected/ead77374-b5ea-42c9-b373-2a0b95462c09-kube-api-access-xc69n\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7370b028-13f9-4584-bc28-3dc77abfa88e-host\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e41c23ed-ecd6-48df-a1dd-04e32365c908-dbus\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-etc-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.177987    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7370b028-13f9-4584-bc28-3dc77abfa88e-host\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178008    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysctl-conf\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-sys\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178057    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2xcm\" (UniqueName: \"kubernetes.io/projected/bd502c5d-789c-496f-b8ca-60ba09a144c5-kube-api-access-c2xcm\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38185898-f1c1-4d7c-aa21-48dca639df02-ovn-node-metrics-cert\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.178467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysctl-d\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-var-lib-kubelet\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178116    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6384e7ff-942c-4e00-a8e2-68b1925e859f-cni-binary-copy\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ead77374-b5ea-42c9-b373-2a0b95462c09-iptables-alerter-script\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57f4836a-b235-4ff7-bbf7-03cd41122d70-agent-certs\") pod \"konnectivity-agent-pwqxh\" (UID: \"57f4836a-b235-4ff7-bbf7-03cd41122d70\") " pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178217    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178268    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-system-cni-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57f4836a-b235-4ff7-bbf7-03cd41122d70-konnectivity-ca\") pod \"konnectivity-agent-pwqxh\" (UID: \"57f4836a-b235-4ff7-bbf7-03cd41122d70\") " pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178323    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-cnibin\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-os-release\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-kubelet\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysconfig\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178460    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-os-release\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178466    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-host\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-socket-dir-parent\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178531    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-multus-certs\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.179140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7370b028-13f9-4584-bc28-3dc77abfa88e-serviceca\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-device-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178604    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2386794d-566b-4007-9d3d-d7123abd6cd8-hosts-file\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178662    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2386794d-566b-4007-9d3d-d7123abd6cd8-hosts-file\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178687    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-systemd-units\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-kubernetes\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-cni-multus\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178733    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-system-cni-dir\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-system-cni-dir\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178818    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178841    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e41c23ed-ecd6-48df-a1dd-04e32365c908-kubelet-config\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-sys-fs\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.179685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178905    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-cni-netd\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178915    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7370b028-13f9-4584-bc28-3dc77abfa88e-serviceca\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-ovnkube-config\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.178976    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-cnibin\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqb2k\" (UniqueName: \"kubernetes.io/projected/138c720a-a50f-468b-aeb8-3dbf03d82fb6-kube-api-access-gqb2k\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-run-netns\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179071    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfdef066-3d24-4732-8e6c-ef99788f6c97-cnibin\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179108    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-run\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179131    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-hostroot\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179167    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-conf-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ead77374-b5ea-42c9-b373-2a0b95462c09-host-slash\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-os-release\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179208    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.180217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.179247    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bfdef066-3d24-4732-8e6c-ef99788f6c97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.182588 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.182564    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57f4836a-b235-4ff7-bbf7-03cd41122d70-agent-certs\") pod \"konnectivity-agent-pwqxh\" (UID: \"57f4836a-b235-4ff7-bbf7-03cd41122d70\") " pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:31.196142 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.196111    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8frz\" (UniqueName: \"kubernetes.io/projected/bfdef066-3d24-4732-8e6c-ef99788f6c97-kube-api-access-m8frz\") pod \"multus-additional-cni-plugins-cxqzw\" (UID: \"bfdef066-3d24-4732-8e6c-ef99788f6c97\") " pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.205732 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.205697    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:31.205732 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.205730    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:31.205889 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.205744    2574 projected.go:196] Error preparing data for projected volume kube-api-access-v78rf for pod openshift-network-diagnostics/network-check-target-v7bz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:31.205889 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.205820    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf podName:7f521e46-6b63-47b9-8b9d-2e1b780cdba1 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:31.70579643 +0000 UTC m=+198.147546941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v78rf" (UniqueName: "kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf") pod "network-check-target-v7bz6" (UID: "7f521e46-6b63-47b9-8b9d-2e1b780cdba1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:31.207706 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.207686    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtpcl\" (UniqueName: \"kubernetes.io/projected/2386794d-566b-4007-9d3d-d7123abd6cd8-kube-api-access-jtpcl\") pod \"node-resolver-vj9jm\" (UID: \"2386794d-566b-4007-9d3d-d7123abd6cd8\") " pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.208153 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.208137    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmhpv\" (UniqueName: \"kubernetes.io/projected/2375495c-6984-4770-bf48-5acc20cc4e7e-kube-api-access-hmhpv\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:31.208251 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.208229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqsfx\" (UniqueName: \"kubernetes.io/projected/7370b028-13f9-4584-bc28-3dc77abfa88e-kube-api-access-pqsfx\") pod \"node-ca-74lxm\" (UID: \"7370b028-13f9-4584-bc28-3dc77abfa88e\") " pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.279546 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-var-lib-kubelet\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.279546 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279543    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6384e7ff-942c-4e00-a8e2-68b1925e859f-cni-binary-copy\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279566    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ead77374-b5ea-42c9-b373-2a0b95462c09-iptables-alerter-script\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-system-cni-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-cnibin\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279633    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-var-lib-kubelet\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279672    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-cnibin\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-system-cni-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-kubelet\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279774    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279781    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysconfig\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279789    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-kubelet\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.279799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-host\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-socket-dir-parent\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279834    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysconfig\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279859    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-multus-certs\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279866    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-host\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279894    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-device-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279901    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-socket-dir-parent\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279912    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-multus-certs\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-device-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-systemd-units\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-systemd-units\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.279986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-kubernetes\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280041    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-kubernetes\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-cni-multus\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280064    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-cni-multus\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e41c23ed-ecd6-48df-a1dd-04e32365c908-kubelet-config\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.280389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280128    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-sys-fs\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280128    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e41c23ed-ecd6-48df-a1dd-04e32365c908-kubelet-config\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-cni-netd\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280192    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-cni-netd\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280197    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6384e7ff-942c-4e00-a8e2-68b1925e859f-cni-binary-copy\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280215    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-sys-fs\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280178    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280258    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-ovnkube-config\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqb2k\" (UniqueName: \"kubernetes.io/projected/138c720a-a50f-468b-aeb8-3dbf03d82fb6-kube-api-access-gqb2k\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-run-netns\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-run-netns\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-run\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-hostroot\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-conf-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.281059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280468    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-run\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280493    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-hostroot\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280494    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ead77374-b5ea-42c9-b373-2a0b95462c09-host-slash\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-conf-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280522    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ead77374-b5ea-42c9-b373-2a0b95462c09-host-slash\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-os-release\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-netns\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-ovn\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-node-log\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.280640    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280645    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-os-release\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280643    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-cni-bin\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280678    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-cni-bin\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.280695    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret podName:e41c23ed-ecd6-48df-a1dd-04e32365c908 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:31.780677967 +0000 UTC m=+198.222428478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret") pod "global-pull-secret-syncer-zkd8c" (UID: "e41c23ed-ecd6-48df-a1dd-04e32365c908") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280708    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-node-log\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280708    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ead77374-b5ea-42c9-b373-2a0b95462c09-iptables-alerter-script\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.281741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-ovn\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280738    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-netns\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280769    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-env-overrides\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-ovnkube-script-lib\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280898    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-modprobe-d\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280924    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-tuned\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-kubelet\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.280977    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-systemd\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-var-lib-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281015    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-kubelet\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-run-ovn-kubernetes\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281052    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-run-systemd\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-systemd\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-cni-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281096    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-var-lib-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281078    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-run-ovn-kubernetes\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281002    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-modprobe-d\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281139    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-k8s-cni-cncf-io\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281165    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-env-overrides\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281173    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-slash\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-systemd\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281197    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-cni-bin\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281204    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-run-k8s-cni-cncf-io\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281221    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-etc-kubernetes\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281225    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-ovnkube-config\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-host-slash\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281261    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-cni-dir\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281291    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4kqc\" (UniqueName: \"kubernetes.io/projected/6384e7ff-942c-4e00-a8e2-68b1925e859f-kube-api-access-n4kqc\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281312    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-etc-kubernetes\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6384e7ff-942c-4e00-a8e2-68b1925e859f-host-var-lib-cni-bin\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-registration-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86pvw\" (UniqueName: \"kubernetes.io/projected/38185898-f1c1-4d7c-aa21-48dca639df02-kube-api-access-86pvw\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd502c5d-789c-496f-b8ca-60ba09a144c5-tmp\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-daemon-config\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-socket-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281507    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-log-socket\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.282860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281510    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-registration-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281522    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-lib-modules\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281557    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-log-socket\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc69n\" (UniqueName: \"kubernetes.io/projected/ead77374-b5ea-42c9-b373-2a0b95462c09-kube-api-access-xc69n\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281604    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e41c23ed-ecd6-48df-a1dd-04e32365c908-dbus\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281626    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-etc-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/138c720a-a50f-468b-aeb8-3dbf03d82fb6-socket-dir\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281658    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysctl-conf\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-sys\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281722    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-lib-modules\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2xcm\" (UniqueName: \"kubernetes.io/projected/bd502c5d-789c-496f-b8ca-60ba09a144c5-kube-api-access-c2xcm\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38185898-f1c1-4d7c-aa21-48dca639df02-ovn-node-metrics-cert\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281775    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-sys\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281781    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e41c23ed-ecd6-48df-a1dd-04e32365c908-dbus\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysctl-d\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38185898-f1c1-4d7c-aa21-48dca639df02-etc-openvswitch\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281921    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysctl-d\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.281940    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6384e7ff-942c-4e00-a8e2-68b1925e859f-multus-daemon-config\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.283379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.282045    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-sysctl-conf\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.282057    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38185898-f1c1-4d7c-aa21-48dca639df02-ovnkube-script-lib\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.283898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.283613    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd502c5d-789c-496f-b8ca-60ba09a144c5-etc-tuned\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.283898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.283844    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38185898-f1c1-4d7c-aa21-48dca639df02-ovn-node-metrics-cert\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.283989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.283901    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd502c5d-789c-496f-b8ca-60ba09a144c5-tmp\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.291461 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.291439    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vj9jm"
Jul 24 14:25:31.297456 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.297435    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-74lxm"
Jul 24 14:25:31.301360 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.301340    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2386794d_566b_4007_9d3d_d7123abd6cd8.slice/crio-4bc698e9f96553a587c02c729aa26dd84ce0e6bfd6d14611c8542f0a0344950d WatchSource:0}: Error finding container 4bc698e9f96553a587c02c729aa26dd84ce0e6bfd6d14611c8542f0a0344950d: Status 404 returned error can't find the container with id 4bc698e9f96553a587c02c729aa26dd84ce0e6bfd6d14611c8542f0a0344950d
Jul 24 14:25:31.302347 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.302279    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:31.304963 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.304939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqb2k\" (UniqueName: \"kubernetes.io/projected/138c720a-a50f-468b-aeb8-3dbf03d82fb6-kube-api-access-gqb2k\") pod \"aws-ebs-csi-driver-node-6kpxs\" (UID: \"138c720a-a50f-468b-aeb8-3dbf03d82fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.306117 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.306092    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7370b028_13f9_4584_bc28_3dc77abfa88e.slice/crio-87f9eebdca8a778bc9b66e8ca334e4db2977719ad68fe29dcdf810a42bd85bd6 WatchSource:0}: Error finding container 87f9eebdca8a778bc9b66e8ca334e4db2977719ad68fe29dcdf810a42bd85bd6: Status 404 returned error can't find the container with id 87f9eebdca8a778bc9b66e8ca334e4db2977719ad68fe29dcdf810a42bd85bd6
Jul 24 14:25:31.308181 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.308165    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxqzw"
Jul 24 14:25:31.325085 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.325060    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4kqc\" (UniqueName: \"kubernetes.io/projected/6384e7ff-942c-4e00-a8e2-68b1925e859f-kube-api-access-n4kqc\") pod \"multus-95dfl\" (UID: \"6384e7ff-942c-4e00-a8e2-68b1925e859f\") " pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.325412 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.325391    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc69n\" (UniqueName: \"kubernetes.io/projected/ead77374-b5ea-42c9-b373-2a0b95462c09-kube-api-access-xc69n\") pod \"iptables-alerter-klrtm\" (UID: \"ead77374-b5ea-42c9-b373-2a0b95462c09\") " pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.325495 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.325412    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2xcm\" (UniqueName: \"kubernetes.io/projected/bd502c5d-789c-496f-b8ca-60ba09a144c5-kube-api-access-c2xcm\") pod \"tuned-j6nm7\" (UID: \"bd502c5d-789c-496f-b8ca-60ba09a144c5\") " pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.327079 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.327053    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vj9jm" event={"ID":"2386794d-566b-4007-9d3d-d7123abd6cd8","Type":"ContainerStarted","Data":"4bc698e9f96553a587c02c729aa26dd84ce0e6bfd6d14611c8542f0a0344950d"}
Jul 24 14:25:31.328333 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.328309    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-74lxm" event={"ID":"7370b028-13f9-4584-bc28-3dc77abfa88e","Type":"ContainerStarted","Data":"87f9eebdca8a778bc9b66e8ca334e4db2977719ad68fe29dcdf810a42bd85bd6"}
Jul 24 14:25:31.328859 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.328840    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs"
Jul 24 14:25:31.329170 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.329146    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f4836a_b235_4ff7_bbf7_03cd41122d70.slice/crio-f7063830706bc34aa505997b619ff5c4961b4793a4dc9dbbaff53b61c48e3754 WatchSource:0}: Error finding container f7063830706bc34aa505997b619ff5c4961b4793a4dc9dbbaff53b61c48e3754: Status 404 returned error can't find the container with id f7063830706bc34aa505997b619ff5c4961b4793a4dc9dbbaff53b61c48e3754
Jul 24 14:25:31.329563 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.329544    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86pvw\" (UniqueName: \"kubernetes.io/projected/38185898-f1c1-4d7c-aa21-48dca639df02-kube-api-access-86pvw\") pod \"ovnkube-node-kj6wn\" (UID: \"38185898-f1c1-4d7c-aa21-48dca639df02\") " pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.330308 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.330287    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfdef066_3d24_4732_8e6c_ef99788f6c97.slice/crio-b27392ddf17e8cdeee004ab09ca20b041017ace446b61227788ddf010603ac13 WatchSource:0}: Error finding container b27392ddf17e8cdeee004ab09ca20b041017ace446b61227788ddf010603ac13: Status 404 returned error can't find the container with id b27392ddf17e8cdeee004ab09ca20b041017ace446b61227788ddf010603ac13
Jul 24 14:25:31.334850 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.333873    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klrtm"
Jul 24 14:25:31.341808 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.341787    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138c720a_a50f_468b_aeb8_3dbf03d82fb6.slice/crio-24f712a2e48cff31e5b7bb8a6e3e716628d16046875bca4d061c3de6622ce89f WatchSource:0}: Error finding container 24f712a2e48cff31e5b7bb8a6e3e716628d16046875bca4d061c3de6622ce89f: Status 404 returned error can't find the container with id 24f712a2e48cff31e5b7bb8a6e3e716628d16046875bca4d061c3de6622ce89f
Jul 24 14:25:31.343972 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.343845    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-104.ec2.internal" podStartSLOduration=1.3438322440000001 podStartE2EDuration="1.343832244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:31.306128334 +0000 UTC m=+197.747878855" watchObservedRunningTime="2026-07-24 14:25:31.343832244 +0000 UTC m=+197.785582763"
Jul 24 14:25:31.344383 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.344363    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead77374_b5ea_42c9_b373_2a0b95462c09.slice/crio-cdd282e7b7e716f8a5ef4a55fc14a115e3794587ded749fb78c1d0b90bdbc30a WatchSource:0}: Error finding container cdd282e7b7e716f8a5ef4a55fc14a115e3794587ded749fb78c1d0b90bdbc30a: Status 404 returned error can't find the container with id cdd282e7b7e716f8a5ef4a55fc14a115e3794587ded749fb78c1d0b90bdbc30a
Jul 24 14:25:31.614003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.613921    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:31.618876 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.618861    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6nm7"
Jul 24 14:25:31.623627 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.623604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95dfl"
Jul 24 14:25:31.625423 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.625403    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38185898_f1c1_4d7c_aa21_48dca639df02.slice/crio-9170f667d90b4aff67d330f1e0868e3b158634b3d0c3e4be68275d4998f397f7 WatchSource:0}: Error finding container 9170f667d90b4aff67d330f1e0868e3b158634b3d0c3e4be68275d4998f397f7: Status 404 returned error can't find the container with id 9170f667d90b4aff67d330f1e0868e3b158634b3d0c3e4be68275d4998f397f7
Jul 24 14:25:31.628874 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.628843    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd502c5d_789c_496f_b8ca_60ba09a144c5.slice/crio-0d4ca68875ffb0b93597f276aae0cfb21d581ddf1f6cde141401213c176e7734 WatchSource:0}: Error finding container 0d4ca68875ffb0b93597f276aae0cfb21d581ddf1f6cde141401213c176e7734: Status 404 returned error can't find the container with id 0d4ca68875ffb0b93597f276aae0cfb21d581ddf1f6cde141401213c176e7734
Jul 24 14:25:31.634459 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:25:31.634439    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6384e7ff_942c_4e00_a8e2_68b1925e859f.slice/crio-7329a894b11579ef70acf28f6f3e4d9eb986603a3aea154b95a4d320f647209b WatchSource:0}: Error finding container 7329a894b11579ef70acf28f6f3e4d9eb986603a3aea154b95a4d320f647209b: Status 404 returned error can't find the container with id 7329a894b11579ef70acf28f6f3e4d9eb986603a3aea154b95a4d320f647209b
Jul 24 14:25:31.684942 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.684904    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:31.685129 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.685069    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:31.685191 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.685137    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs podName:2375495c-6984-4770-bf48-5acc20cc4e7e nodeName:}" failed. No retries permitted until 2026-07-24 14:25:32.685117561 +0000 UTC m=+199.126868064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs") pod "network-metrics-daemon-k5csg" (UID: "2375495c-6984-4770-bf48-5acc20cc4e7e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:31.785748 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.785712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:31.785913 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:31.785791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:31.785995 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.785913    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:31.785995 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.785974    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret podName:e41c23ed-ecd6-48df-a1dd-04e32365c908 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:32.785954723 +0000 UTC m=+199.227705224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret") pod "global-pull-secret-syncer-zkd8c" (UID: "e41c23ed-ecd6-48df-a1dd-04e32365c908") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:31.786425 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.786397    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:31.786485 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.786427    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:31.786485 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.786440    2574 projected.go:196] Error preparing data for projected volume kube-api-access-v78rf for pod openshift-network-diagnostics/network-check-target-v7bz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:31.786588 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:31.786489    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf podName:7f521e46-6b63-47b9-8b9d-2e1b780cdba1 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:32.786472481 +0000 UTC m=+199.228222993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v78rf" (UniqueName: "kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf") pod "network-check-target-v7bz6" (UID: "7f521e46-6b63-47b9-8b9d-2e1b780cdba1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:32.103969 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.103873    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:20:31 +0000 UTC" deadline="2028-01-25 14:08:49.575708863 +0000 UTC"
Jul 24 14:25:32.103969 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.103914    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13199h43m17.471799386s"
Jul 24 14:25:32.348702 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.348541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"9170f667d90b4aff67d330f1e0868e3b158634b3d0c3e4be68275d4998f397f7"}
Jul 24 14:25:32.363449 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.363357    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs" event={"ID":"138c720a-a50f-468b-aeb8-3dbf03d82fb6","Type":"ContainerStarted","Data":"24f712a2e48cff31e5b7bb8a6e3e716628d16046875bca4d061c3de6622ce89f"}
Jul 24 14:25:32.373221 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.373079    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerStarted","Data":"b27392ddf17e8cdeee004ab09ca20b041017ace446b61227788ddf010603ac13"}
Jul 24 14:25:32.386578 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.386548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pwqxh" event={"ID":"57f4836a-b235-4ff7-bbf7-03cd41122d70","Type":"ContainerStarted","Data":"f7063830706bc34aa505997b619ff5c4961b4793a4dc9dbbaff53b61c48e3754"}
Jul 24 14:25:32.393817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.393784    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95dfl" event={"ID":"6384e7ff-942c-4e00-a8e2-68b1925e859f","Type":"ContainerStarted","Data":"7329a894b11579ef70acf28f6f3e4d9eb986603a3aea154b95a4d320f647209b"}
Jul 24 14:25:32.399912 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.399883    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klrtm" event={"ID":"ead77374-b5ea-42c9-b373-2a0b95462c09","Type":"ContainerStarted","Data":"cdd282e7b7e716f8a5ef4a55fc14a115e3794587ded749fb78c1d0b90bdbc30a"}
Jul 24 14:25:32.410638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.410608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6nm7" event={"ID":"bd502c5d-789c-496f-b8ca-60ba09a144c5","Type":"ContainerStarted","Data":"0d4ca68875ffb0b93597f276aae0cfb21d581ddf1f6cde141401213c176e7734"}
Jul 24 14:25:32.692426 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.692387    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:32.692622 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:32.692562    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:32.692689 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:32.692627    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs podName:2375495c-6984-4770-bf48-5acc20cc4e7e nodeName:}" failed. No retries permitted until 2026-07-24 14:25:34.692607354 +0000 UTC m=+201.134357854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs") pod "network-metrics-daemon-k5csg" (UID: "2375495c-6984-4770-bf48-5acc20cc4e7e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:32.793858 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.793819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:32.794063 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:32.793916    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:32.794063 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:32.794046    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:32.794185 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:32.794058    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:32.794185 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:32.794082    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:32.794185 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:32.794096    2574 projected.go:196] Error preparing data for projected volume kube-api-access-v78rf for pod openshift-network-diagnostics/network-check-target-v7bz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:32.794185 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:32.794131    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret podName:e41c23ed-ecd6-48df-a1dd-04e32365c908 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:34.794109676 +0000 UTC m=+201.235860199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret") pod "global-pull-secret-syncer-zkd8c" (UID: "e41c23ed-ecd6-48df-a1dd-04e32365c908") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:32.794185 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:32.794151    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf podName:7f521e46-6b63-47b9-8b9d-2e1b780cdba1 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:34.794141585 +0000 UTC m=+201.235892093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v78rf" (UniqueName: "kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf") pod "network-check-target-v7bz6" (UID: "7f521e46-6b63-47b9-8b9d-2e1b780cdba1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:33.013517 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:33.013105    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:33.013517 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:33.013252    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:33.013748 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:33.013655    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:33.013799 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:33.013744    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:33.013852 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:33.013801    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:33.013896 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:33.013869    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:33.104358 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:33.104293    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:20:31 +0000 UTC" deadline="2028-01-30 22:16:43.53916144 +0000 UTC"
Jul 24 14:25:33.104358 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:33.104355    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13327h51m10.434809867s"
Jul 24 14:25:33.984832 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:33.984766    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:34.646404 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:34.646221    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:25:34.713103 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:34.712450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:34.713103 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:34.712635    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:34.713103 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:34.712706    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs podName:2375495c-6984-4770-bf48-5acc20cc4e7e nodeName:}" failed. No retries permitted until 2026-07-24 14:25:38.712686414 +0000 UTC m=+205.154436914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs") pod "network-metrics-daemon-k5csg" (UID: "2375495c-6984-4770-bf48-5acc20cc4e7e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:34.812847 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:34.812808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:34.813023 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:34.812880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:34.813023 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:34.812975    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:34.813023 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:34.813006    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:34.813023 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:34.813041    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:34.813326 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:34.813055    2574 projected.go:196] Error preparing data for projected volume kube-api-access-v78rf for pod openshift-network-diagnostics/network-check-target-v7bz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:34.813326 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:34.813072    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret podName:e41c23ed-ecd6-48df-a1dd-04e32365c908 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:38.813050703 +0000 UTC m=+205.254801216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret") pod "global-pull-secret-syncer-zkd8c" (UID: "e41c23ed-ecd6-48df-a1dd-04e32365c908") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:34.813326 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:34.813105    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf podName:7f521e46-6b63-47b9-8b9d-2e1b780cdba1 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:38.813088839 +0000 UTC m=+205.254839339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v78rf" (UniqueName: "kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf") pod "network-check-target-v7bz6" (UID: "7f521e46-6b63-47b9-8b9d-2e1b780cdba1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:35.013707 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:35.013636    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:35.013886 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:35.013771    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:35.014513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:35.014107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:35.014513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:35.014213    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:35.014513 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:35.014221    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:35.014513 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:35.014283    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:37.013108 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:37.013067    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:37.013575 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:37.013205    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:37.013575 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:37.013513    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:37.013575 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:37.013547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:37.013740 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:37.013657    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:37.013795 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:37.013773    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:38.743215 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:38.743134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:38.743687 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.743299    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:38.743687 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.743381    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs podName:2375495c-6984-4770-bf48-5acc20cc4e7e nodeName:}" failed. No retries permitted until 2026-07-24 14:25:46.743357338 +0000 UTC m=+213.185107843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs") pod "network-metrics-daemon-k5csg" (UID: "2375495c-6984-4770-bf48-5acc20cc4e7e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:38.844216 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:38.844104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:38.844216 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:38.844215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:38.844461 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.844370    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:38.844461 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.844441    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret podName:e41c23ed-ecd6-48df-a1dd-04e32365c908 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:46.84442189 +0000 UTC m=+213.286172388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret") pod "global-pull-secret-syncer-zkd8c" (UID: "e41c23ed-ecd6-48df-a1dd-04e32365c908") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:38.844836 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.844702    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:38.844836 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.844731    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:38.844836 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.844748    2574 projected.go:196] Error preparing data for projected volume kube-api-access-v78rf for pod openshift-network-diagnostics/network-check-target-v7bz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:38.844836 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.844815    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf podName:7f521e46-6b63-47b9-8b9d-2e1b780cdba1 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:46.844798396 +0000 UTC m=+213.286548909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v78rf" (UniqueName: "kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf") pod "network-check-target-v7bz6" (UID: "7f521e46-6b63-47b9-8b9d-2e1b780cdba1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:38.986427 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:38.986387    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:39.012858 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:39.012760    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:39.013012 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:39.012895    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:39.013012 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:39.012764    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:39.013012 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:39.012982    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:39.013012 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:39.012763    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:39.013257 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:39.013072    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:41.013370 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:41.013324    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:41.013370 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:41.013353    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:41.013953 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:41.013349    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:41.013953 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:41.013472    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:41.013953 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:41.013569    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:41.013953 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:41.013675    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:43.012717 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:43.012675    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:43.013177 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:43.012731    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:43.013177 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:43.012842    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:43.013177 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:43.012895    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:43.013177 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:43.012922    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:43.013177 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:43.013041    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:43.986857 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:43.986812    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:45.013394 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:45.013355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:45.013394 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:45.013387    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:45.013889 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:45.013355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:45.013889 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:45.013500    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:45.013889 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:45.013592    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:45.013889 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:45.013682    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:46.013162 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.013115    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:25:46.800090 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:46.800054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:46.800571 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.800220    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:46.800571 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.800294    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs podName:2375495c-6984-4770-bf48-5acc20cc4e7e nodeName:}" failed. No retries permitted until 2026-07-24 14:26:02.800279254 +0000 UTC m=+229.242029751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs") pod "network-metrics-daemon-k5csg" (UID: "2375495c-6984-4770-bf48-5acc20cc4e7e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:46.900743 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:46.900707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:46.900923 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:46.900763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:46.900923 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.900864    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:46.900923 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.900874    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:46.900923 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.900887    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:46.900923 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.900897    2574 projected.go:196] Error preparing data for projected volume kube-api-access-v78rf for pod openshift-network-diagnostics/network-check-target-v7bz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:46.900923 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.900927    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret podName:e41c23ed-ecd6-48df-a1dd-04e32365c908 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:02.900909051 +0000 UTC m=+229.342659564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret") pod "global-pull-secret-syncer-zkd8c" (UID: "e41c23ed-ecd6-48df-a1dd-04e32365c908") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:46.901209 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:46.900942    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf podName:7f521e46-6b63-47b9-8b9d-2e1b780cdba1 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:02.900935888 +0000 UTC m=+229.342686384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v78rf" (UniqueName: "kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf") pod "network-check-target-v7bz6" (UID: "7f521e46-6b63-47b9-8b9d-2e1b780cdba1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:47.013337 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:47.013298    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:47.013337 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:47.013332    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:47.013573 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:47.013339    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:47.013573 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:47.013435    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:47.013573 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:47.013556    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:47.013703 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:47.013629    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:48.987626 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:48.987588    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:49.013095 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.013059    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:49.013232 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.013059    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:49.013232 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:49.013172    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:49.013326 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.013066    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:49.013326 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:49.013255    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:49.013409 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:49.013390    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:49.453322 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.453274    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vj9jm" event={"ID":"2386794d-566b-4007-9d3d-d7123abd6cd8","Type":"ContainerStarted","Data":"0bf66633fc050f6104a6d7d756efb42266b52bd52ced37bcbc0b73f68c1f30d3"}
Jul 24 14:25:49.455952 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.455848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs" event={"ID":"138c720a-a50f-468b-aeb8-3dbf03d82fb6","Type":"ContainerStarted","Data":"795a64b47253452ae24d907a5b844a08b64e85f1bbe35134207556b1f75a6156"}
Jul 24 14:25:49.458571 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.458100    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerStarted","Data":"2a08f87f667ae446d5b29ee52cb1897ec6ebe1241a18574fd4b01631e92dcb82"}
Jul 24 14:25:49.464537 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.464479    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pwqxh" event={"ID":"57f4836a-b235-4ff7-bbf7-03cd41122d70","Type":"ContainerStarted","Data":"aa7eaeaf5051784e561d1a52efc225d315f8598bb3f3875ee39b435df60ce60c"}
Jul 24 14:25:49.483420 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.483144    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vj9jm" podStartSLOduration=30.587069628 podStartE2EDuration="48.483123634s" totalImagesPullingTime="17.896054006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:49.48214077 +0000 UTC m=+215.923891292" watchObservedRunningTime="2026-07-24 14:25:49.483123634 +0000 UTC m=+215.924874153"
Jul 24 14:25:49.503635 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:49.503567    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pwqxh" podStartSLOduration=35.052000982 podStartE2EDuration="48.503545145s" totalImagesPullingTime="13.451544163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:49.502834297 +0000 UTC m=+215.944584815" watchObservedRunningTime="2026-07-24 14:25:49.503545145 +0000 UTC m=+215.945295665"
Jul 24 14:25:50.366560 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.366532    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 14:25:50.467503 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.467471    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-74lxm" event={"ID":"7370b028-13f9-4584-bc28-3dc77abfa88e","Type":"ContainerStarted","Data":"dd53930a0a5e576a390fb0f08f1ec26e7feab72280dd2708b9f95c7fc004829e"}
Jul 24 14:25:50.468867 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.468839    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95dfl" event={"ID":"6384e7ff-942c-4e00-a8e2-68b1925e859f","Type":"ContainerStarted","Data":"94d879f7df9ff85442ec020467a8f7f245b013e35ef0f44cb37a520c891da51a"}
Jul 24 14:25:50.470159 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.470141    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6nm7" event={"ID":"bd502c5d-789c-496f-b8ca-60ba09a144c5","Type":"ContainerStarted","Data":"f2eb02fa7b7a7c861ca12efe9c79a9b04341b4cb40e849071269dca39e7c592e"}
Jul 24 14:25:50.472753 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.472732    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"fc64aa6cf431674db084e96f923c093b9937fa228caef8972d93aaad6262236e"}
Jul 24 14:25:50.472821 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.472799    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"cff73e5c59e63ae3ae544cd5a0b227b34d83004c8ae9b0e30cb3a8604e8e42bc"}
Jul 24 14:25:50.472878 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.472851    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"ab80a32052fa45fded3e860784007eda91edc2bdb27df6b82ef83f5eda1d13f4"}
Jul 24 14:25:50.472916 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.472899    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"22e65feb006999b620ef74c5fcf18f75493bcee913bfcce11ec6ee77157fb229"}
Jul 24 14:25:50.472958 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.472945    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"3a5caf598ffa9ca66ee3f55105703f9b99ed32e1797c0ffb2c0d39d3c4efb46d"}
Jul 24 14:25:50.473001 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.472988    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"0a596a859ab350a5c5b6288588b016ae82f9901136d536077fe8bdf061c1ba76"}
Jul 24 14:25:50.474278 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.474260    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs" event={"ID":"138c720a-a50f-468b-aeb8-3dbf03d82fb6","Type":"ContainerStarted","Data":"c84c1c4022dbc8ff6ce30c664b7a64849b942d8a9201720adc936f4416786186"}
Jul 24 14:25:50.475506 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.475485    2574 generic.go:356] "Generic (PLEG): container finished" podID="bfdef066-3d24-4732-8e6c-ef99788f6c97" containerID="2a08f87f667ae446d5b29ee52cb1897ec6ebe1241a18574fd4b01631e92dcb82" exitCode=0
Jul 24 14:25:50.475585 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.475507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerDied","Data":"2a08f87f667ae446d5b29ee52cb1897ec6ebe1241a18574fd4b01631e92dcb82"}
Jul 24 14:25:50.526895 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.526686    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-74lxm" podStartSLOduration=31.626968391 podStartE2EDuration="49.526670674s" totalImagesPullingTime="17.899702283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:50.494141432 +0000 UTC m=+216.935891950" watchObservedRunningTime="2026-07-24 14:25:50.526670674 +0000 UTC m=+216.968421195"
Jul 24 14:25:50.553147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:50.553106    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j6nm7" podStartSLOduration=31.96050074 podStartE2EDuration="49.55308769s" totalImagesPullingTime="17.59258695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:50.552961271 +0000 UTC m=+216.994711790" watchObservedRunningTime="2026-07-24 14:25:50.55308769 +0000 UTC m=+216.994838209"
Jul 24 14:25:51.013070 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.013018    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:51.013266 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.013018    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:51.013266 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:51.013164    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:51.013266 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.013018    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:51.013266 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:51.013223    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:51.013467 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:51.013284    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:51.075829 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.075739    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T14:25:50.36655164Z","UUID":"3564aa4b-8d30-4290-8aa5-56e5f8f9d255","Handler":null,"Name":"","Endpoint":""}
Jul 24 14:25:51.077144 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.077124    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 14:25:51.077261 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.077159    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 14:25:51.303323 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.303238    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:51.304015 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.303983    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:51.340683 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.340633    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-95dfl" podStartSLOduration=32.734705484 podStartE2EDuration="50.340615951s" totalImagesPullingTime="17.605910467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:50.584791952 +0000 UTC m=+217.026542471" watchObservedRunningTime="2026-07-24 14:25:51.340615951 +0000 UTC m=+217.782366469"
Jul 24 14:25:51.479666 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.479622    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klrtm" event={"ID":"ead77374-b5ea-42c9-b373-2a0b95462c09","Type":"ContainerStarted","Data":"22f2766039a43168487b68ec0d35ecad478e667954caf09894910a708c55d1f5"}
Jul 24 14:25:51.480190 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.480170    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:51.480606 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.480585    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pwqxh"
Jul 24 14:25:51.514415 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:51.514366    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-klrtm" podStartSLOduration=32.661340332 podStartE2EDuration="50.514351378s" totalImagesPullingTime="17.853011046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:51.512816266 +0000 UTC m=+217.954566784" watchObservedRunningTime="2026-07-24 14:25:51.514351378 +0000 UTC m=+217.956101930"
Jul 24 14:25:52.485850 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:52.485808    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"57ab61e5a1f2f487279f00e9a0f3cdf319cea5c9550c774e333047018c9c29f6"}
Jul 24 14:25:52.487916 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:52.487886    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs" event={"ID":"138c720a-a50f-468b-aeb8-3dbf03d82fb6","Type":"ContainerStarted","Data":"33a4bd3b58eb6756524bd8670af0cd4a68bfa14211c0235264e12ecdd29eb3ca"}
Jul 24 14:25:53.012475 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:53.012439    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:53.012653 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:53.012439    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:53.012653 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:53.012546    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:53.012746 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:53.012661    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:53.012746 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:53.012439    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:53.012825 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:53.012755    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:53.988077 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:53.988048    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:55.012867 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.012828    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:55.013399 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.012829    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:55.013399 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:55.012944    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:55.013399 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:55.013059    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:55.013399 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.012849    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:55.013399 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:55.013155    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:55.497339 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.497143    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" event={"ID":"38185898-f1c1-4d7c-aa21-48dca639df02","Type":"ContainerStarted","Data":"09eb7fcee182d0ef1f01b835467619afac26c92ea5a474542af2b795fcdb7e9a"}
Jul 24 14:25:55.497520 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.497391    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:55.497520 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.497444    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:55.512349 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.512330    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:55.536675 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.536630    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn" podStartSLOduration=36.882860799 podStartE2EDuration="54.536612758s" totalImagesPullingTime="17.653751959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:55.534603231 +0000 UTC m=+221.976353753" watchObservedRunningTime="2026-07-24 14:25:55.536612758 +0000 UTC m=+221.978363276"
Jul 24 14:25:55.536835 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:55.536814    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kpxs" podStartSLOduration=34.751050378 podStartE2EDuration="54.536808699s" totalImagesPullingTime="19.785758321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:52.519179436 +0000 UTC m=+218.960929955" watchObservedRunningTime="2026-07-24 14:25:55.536808699 +0000 UTC m=+221.978559246"
Jul 24 14:25:56.501547 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:56.501512    2574 generic.go:356] "Generic (PLEG): container finished" podID="bfdef066-3d24-4732-8e6c-ef99788f6c97" containerID="fcf96096043c4033ee3ac14f1599b29a60a0a18ce354feabe322c9dd192768fe" exitCode=0
Jul 24 14:25:56.502099 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:56.501610    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerDied","Data":"fcf96096043c4033ee3ac14f1599b29a60a0a18ce354feabe322c9dd192768fe"}
Jul 24 14:25:56.502099 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:56.502079    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:56.517947 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:56.517924    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:25:57.012677 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.012643    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:57.012677 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.012680    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:57.013039 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.012680    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:57.013039 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:57.012750    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:57.013039 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:57.012844    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:57.013039 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:57.012893    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:57.690790 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.690580    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v7bz6"]
Jul 24 14:25:57.691184 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.690913    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:57.691184 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:57.691003    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:25:57.692759 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.692734    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k5csg"]
Jul 24 14:25:57.692921 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.692837    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:25:57.692995 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:57.692932    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:25:57.693258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.693217    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zkd8c"]
Jul 24 14:25:57.693344 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:57.693305    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:57.693397 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:57.693381    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:58.015997 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:58.015926    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator(675a7bee8955409b744ccede8cdbf52a)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podUID="675a7bee8955409b744ccede8cdbf52a"
Jul 24 14:25:58.508235 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:58.508196    2574 generic.go:356] "Generic (PLEG): container finished" podID="bfdef066-3d24-4732-8e6c-ef99788f6c97" containerID="41c5577c4d2e82abfa9a493ed4c886116b5aac64c7d5f844ef18dffd35880b9a" exitCode=0
Jul 24 14:25:58.508373 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:58.508273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerDied","Data":"41c5577c4d2e82abfa9a493ed4c886116b5aac64c7d5f844ef18dffd35880b9a"}
Jul 24 14:25:58.989330 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:58.989286    2574 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:59.012724 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:59.012691    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:25:59.012877 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:59.012821    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:25:59.012877 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:25:59.012849    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:25:59.012950 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:25:59.012927    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:26:00.013047 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:00.012952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:26:00.013517 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:00.013088    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:26:00.515337 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:00.515300    2574 generic.go:356] "Generic (PLEG): container finished" podID="bfdef066-3d24-4732-8e6c-ef99788f6c97" containerID="24bce70d2cfef39bb63914ab5f4ca0281c94d09b4fe09bd817a4e391eae6b9c3" exitCode=0
Jul 24 14:26:00.515497 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:00.515342    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerDied","Data":"24bce70d2cfef39bb63914ab5f4ca0281c94d09b4fe09bd817a4e391eae6b9c3"}
Jul 24 14:26:01.012927 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:01.012895    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:26:01.013115 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:01.012896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:26:01.013115 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:01.013004    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:26:01.013115 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:01.013100    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:26:01.233734 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:01.233708    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vj9jm_2386794d-566b-4007-9d3d-d7123abd6cd8/dns-node-resolver/0.log"
Jul 24 14:26:01.826831 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:01.826794    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-74lxm_7370b028-13f9-4584-bc28-3dc77abfa88e/node-ca/0.log"
Jul 24 14:26:02.012848 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:02.012818    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:26:02.013050 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.012949    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5csg" podUID="2375495c-6984-4770-bf48-5acc20cc4e7e"
Jul 24 14:26:02.815932 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:02.815846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:26:02.816363 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.815996    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:26:02.816363 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.816091    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs podName:2375495c-6984-4770-bf48-5acc20cc4e7e nodeName:}" failed. No retries permitted until 2026-07-24 14:26:34.816071071 +0000 UTC m=+261.257821572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs") pod "network-metrics-daemon-k5csg" (UID: "2375495c-6984-4770-bf48-5acc20cc4e7e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:26:02.916745 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:02.916709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:26:02.916921 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:02.916779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:26:02.916921 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.916849    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:26:02.916921 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.916911    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret podName:e41c23ed-ecd6-48df-a1dd-04e32365c908 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:34.916893356 +0000 UTC m=+261.358643866 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret") pod "global-pull-secret-syncer-zkd8c" (UID: "e41c23ed-ecd6-48df-a1dd-04e32365c908") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:26:02.917098 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.916928    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:26:02.917098 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.916958    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:26:02.917098 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.916972    2574 projected.go:196] Error preparing data for projected volume kube-api-access-v78rf for pod openshift-network-diagnostics/network-check-target-v7bz6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:26:02.917098 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:02.917041    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf podName:7f521e46-6b63-47b9-8b9d-2e1b780cdba1 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:34.91701126 +0000 UTC m=+261.358761774 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v78rf" (UniqueName: "kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf") pod "network-check-target-v7bz6" (UID: "7f521e46-6b63-47b9-8b9d-2e1b780cdba1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:26:03.012560 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:03.012525    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:26:03.012752 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:03.012644    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7bz6" podUID="7f521e46-6b63-47b9-8b9d-2e1b780cdba1"
Jul 24 14:26:03.012752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:03.012729    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:26:03.012879 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:03.012844    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkd8c" podUID="e41c23ed-ecd6-48df-a1dd-04e32365c908"
Jul 24 14:26:04.013662 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:04.013629    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:26:04.021212 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:04.021137    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 14:26:04.021391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:04.021316    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbcqt\""
Jul 24 14:26:05.012834 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:05.012808    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:26:05.012974 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:05.012804    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:26:05.018418 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:05.018397    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 14:26:05.019454 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:05.019430    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xh5fm\""
Jul 24 14:26:05.019454 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:05.019446    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 14:26:05.019974 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:05.019948    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 14:26:05.529172 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:05.529135    2574 generic.go:356] "Generic (PLEG): container finished" podID="bfdef066-3d24-4732-8e6c-ef99788f6c97" containerID="3b06ce44dc9a1f35ae55c10c866e22c0e51c98839fc0b8e40b02243f98375d89" exitCode=0
Jul 24 14:26:05.529347 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:05.529212    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerDied","Data":"3b06ce44dc9a1f35ae55c10c866e22c0e51c98839fc0b8e40b02243f98375d89"}
Jul 24 14:26:06.534590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:06.534555    2574 generic.go:356] "Generic (PLEG): container finished" podID="bfdef066-3d24-4732-8e6c-ef99788f6c97" containerID="f710de2819edf0f7ef4795b5fcc02ad6e029e0fadca1cfbfd44c0a50aa2cd6ea" exitCode=0
Jul 24 14:26:06.534961 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:06.534610    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerDied","Data":"f710de2819edf0f7ef4795b5fcc02ad6e029e0fadca1cfbfd44c0a50aa2cd6ea"}
Jul 24 14:26:07.540233 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:07.540198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" event={"ID":"bfdef066-3d24-4732-8e6c-ef99788f6c97","Type":"ContainerStarted","Data":"b4fb3b614dbe6f20617183cf46d9552d68e92d09a7283d76787e338b3999afed"}
Jul 24 14:26:07.579981 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:07.579924    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cxqzw" podStartSLOduration=36.933425223 podStartE2EDuration="1m6.579908905s" totalImagesPullingTime="29.646483682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:07.579348192 +0000 UTC m=+234.021098722" watchObservedRunningTime="2026-07-24 14:26:07.579908905 +0000 UTC m=+234.021659423"
Jul 24 14:26:11.550950 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:11.550922    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_675a7bee8955409b744ccede8cdbf52a/setup/4.log"
Jul 24 14:26:11.551353 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:11.550958    2574 generic.go:356] "Generic (PLEG): container finished" podID="675a7bee8955409b744ccede8cdbf52a" containerID="f9b5c72aa27773ad7b26584cbc1286ead892e45c2880af4cd8aca29463fa2bc5" exitCode=0
Jul 24 14:26:11.551353 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:11.551011    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerDied","Data":"f9b5c72aa27773ad7b26584cbc1286ead892e45c2880af4cd8aca29463fa2bc5"}
Jul 24 14:26:11.551353 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:11.551072    2574 scope.go:117] "RemoveContainer" containerID="057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026"
Jul 24 14:26:11.551353 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:11.551336    2574 scope.go:117] "RemoveContainer" containerID="057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026"
Jul 24 14:26:11.580933 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:11.580900    2574 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_4 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: '057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026'" containerID="057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026"
Jul 24 14:26:11.581023 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:11.580943    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026"} err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal_openshift-machine-config-operator_675a7bee8955409b744ccede8cdbf52a_4 in pod sandbox 29aae4da28d0c92ab846e3ba9afc9fd40ef1a3e1793db6a7cde6b4bc0285bd83 from index: no such id: '057d0a30c5e63dd3d28a95e49591714afab153d52ab9b37d3b23fd20bae97026'"
Jul 24 14:26:12.554673 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:12.554644    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" event={"ID":"675a7bee8955409b744ccede8cdbf52a","Type":"ContainerStarted","Data":"517231aa64325cd788c9d77751f1e7b2840420945c8578895989bc64e0f964f1"}
Jul 24 14:26:13.151251 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:13.151218    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-104.ec2.internal" event="NodeReady"
Jul 24 14:26:28.518603 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:28.518577    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kj6wn"
Jul 24 14:26:28.554944 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:28.554885    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-104.ec2.internal" podStartSLOduration=58.554869422 podStartE2EDuration="58.554869422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:12.579465823 +0000 UTC m=+239.021216346" watchObservedRunningTime="2026-07-24 14:26:28.554869422 +0000 UTC m=+254.996619942"
Jul 24 14:26:34.845140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.845101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:26:34.848708 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.848690    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 14:26:34.859709 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.859682    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2375495c-6984-4770-bf48-5acc20cc4e7e-metrics-certs\") pod \"network-metrics-daemon-k5csg\" (UID: \"2375495c-6984-4770-bf48-5acc20cc4e7e\") " pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:26:34.930308 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.930274    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbcqt\""
Jul 24 14:26:34.937639 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.937617    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5csg"
Jul 24 14:26:34.945689 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.945662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:26:34.945811 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.945713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:26:34.950212 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.950186    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 14:26:34.950212 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.950197    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 14:26:34.958817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.958783    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e41c23ed-ecd6-48df-a1dd-04e32365c908-original-pull-secret\") pod \"global-pull-secret-syncer-zkd8c\" (UID: \"e41c23ed-ecd6-48df-a1dd-04e32365c908\") " pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:26:34.959530 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.959499    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 14:26:34.969562 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:34.969531    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v78rf\" (UniqueName: \"kubernetes.io/projected/7f521e46-6b63-47b9-8b9d-2e1b780cdba1-kube-api-access-v78rf\") pod \"network-check-target-v7bz6\" (UID: \"7f521e46-6b63-47b9-8b9d-2e1b780cdba1\") " pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:26:35.026586 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.026557    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkd8c"
Jul 24 14:26:35.026999 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.026956    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xh5fm\""
Jul 24 14:26:35.032643 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.032586    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:26:35.091236 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.091196    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k5csg"]
Jul 24 14:26:35.096051 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:35.095967    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2375495c_6984_4770_bf48_5acc20cc4e7e.slice/crio-be067aac8ac50606a34f5d30c375bec02332fea3f8eb1a5da51e8e495f2a14bc WatchSource:0}: Error finding container be067aac8ac50606a34f5d30c375bec02332fea3f8eb1a5da51e8e495f2a14bc: Status 404 returned error can't find the container with id be067aac8ac50606a34f5d30c375bec02332fea3f8eb1a5da51e8e495f2a14bc
Jul 24 14:26:35.163904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.163871    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zkd8c"]
Jul 24 14:26:35.168509 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:35.168480    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41c23ed_ecd6_48df_a1dd_04e32365c908.slice/crio-b37254ffb3fd0ba5c00bb023a731b545ad6746185d3c69adace547379f4d4d2e WatchSource:0}: Error finding container b37254ffb3fd0ba5c00bb023a731b545ad6746185d3c69adace547379f4d4d2e: Status 404 returned error can't find the container with id b37254ffb3fd0ba5c00bb023a731b545ad6746185d3c69adace547379f4d4d2e
Jul 24 14:26:35.183051 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.183014    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v7bz6"]
Jul 24 14:26:35.185753 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:35.185714    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f521e46_6b63_47b9_8b9d_2e1b780cdba1.slice/crio-90b813b556ef197b5bf1c2510f011603e31bc38b28fee32f26752bdb0a6f3acf WatchSource:0}: Error finding container 90b813b556ef197b5bf1c2510f011603e31bc38b28fee32f26752bdb0a6f3acf: Status 404 returned error can't find the container with id 90b813b556ef197b5bf1c2510f011603e31bc38b28fee32f26752bdb0a6f3acf
Jul 24 14:26:35.609656 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.609545    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v7bz6" event={"ID":"7f521e46-6b63-47b9-8b9d-2e1b780cdba1","Type":"ContainerStarted","Data":"90b813b556ef197b5bf1c2510f011603e31bc38b28fee32f26752bdb0a6f3acf"}
Jul 24 14:26:35.610589 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.610565    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zkd8c" event={"ID":"e41c23ed-ecd6-48df-a1dd-04e32365c908","Type":"ContainerStarted","Data":"b37254ffb3fd0ba5c00bb023a731b545ad6746185d3c69adace547379f4d4d2e"}
Jul 24 14:26:35.611563 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:35.611541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5csg" event={"ID":"2375495c-6984-4770-bf48-5acc20cc4e7e","Type":"ContainerStarted","Data":"be067aac8ac50606a34f5d30c375bec02332fea3f8eb1a5da51e8e495f2a14bc"}
Jul 24 14:26:36.617007 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:36.616871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5csg" event={"ID":"2375495c-6984-4770-bf48-5acc20cc4e7e","Type":"ContainerStarted","Data":"35843a856b2d0ddbd10d737669b7211fa70f491400d30f317535060e384358dc"}
Jul 24 14:26:36.617007 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:36.616938    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5csg" event={"ID":"2375495c-6984-4770-bf48-5acc20cc4e7e","Type":"ContainerStarted","Data":"5ff891d997ad12c581089682b0c50db2a285d4e7cc5844823bd268f06c52be58"}
Jul 24 14:26:36.648449 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:36.648388    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k5csg" podStartSLOduration=94.437240937 podStartE2EDuration="1m35.648369083s" totalImagesPullingTime="1.211128146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:36.648064289 +0000 UTC m=+263.089814809" watchObservedRunningTime="2026-07-24 14:26:36.648369083 +0000 UTC m=+263.090119617"
Jul 24 14:26:40.629594 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:40.629510    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v7bz6" event={"ID":"7f521e46-6b63-47b9-8b9d-2e1b780cdba1","Type":"ContainerStarted","Data":"28c33fa15f447f24b30d9688377ebfbe0591a9684e5e22148ed73a9de1610c56"}
Jul 24 14:26:40.630067 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:40.629602    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:26:40.630920 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:40.630901    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zkd8c" event={"ID":"e41c23ed-ecd6-48df-a1dd-04e32365c908","Type":"ContainerStarted","Data":"bcff61fc7ff21276f5867b6cfb1778d1504b9c5ccee412bb7b7099d0b30576b4"}
Jul 24 14:26:40.653564 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:40.653513    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v7bz6" podStartSLOduration=94.553791139 podStartE2EDuration="1m39.653496225s" totalImagesPullingTime="5.099705086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:40.653052203 +0000 UTC m=+267.094802722" watchObservedRunningTime="2026-07-24 14:26:40.653496225 +0000 UTC m=+267.095246744"
Jul 24 14:26:40.675988 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:40.675938    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zkd8c" podStartSLOduration=94.546204718 podStartE2EDuration="1m39.675922423s" totalImagesPullingTime="5.129717705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:40.675085785 +0000 UTC m=+267.116836304" watchObservedRunningTime="2026-07-24 14:26:40.675922423 +0000 UTC m=+267.117672943"
Jul 24 14:26:44.593938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.593900    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f68c46978-fvtrn"]
Jul 24 14:26:44.595766 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.595749    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.613221 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.613185    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 14:26:44.617930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.617909    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jc6f\""
Jul 24 14:26:44.618073 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.618058    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 14:26:44.618230 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.618212    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 14:26:44.627905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.627882    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 14:26:44.654274 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.654249    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f68c46978-fvtrn"]
Jul 24 14:26:44.654944 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.654925    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f68c46978-fvtrn"]
Jul 24 14:26:44.655119 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:44.655099    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-ddfgc registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5f68c46978-fvtrn" podUID="7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"
Jul 24 14:26:44.678162 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.678129    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-622k9"]
Jul 24 14:26:44.679911 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.679896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-622k9"
Jul 24 14:26:44.687758 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.687734    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 14:26:44.687861 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.687768    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 14:26:44.688089 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.688076    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jr75q\""
Jul 24 14:26:44.706361 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.706336    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-622k9"]
Jul 24 14:26:44.709741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.709720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-installation-pull-secrets\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.709845 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.709766    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddfgc\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-kube-api-access-ddfgc\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.709845 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.709792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-ca-trust-extracted\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.709962 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.709859    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-tls\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.709962 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.709895    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-certificates\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.709962 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.709929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-image-registry-private-configuration\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.709962 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.709955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-trusted-ca\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.710122 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.710007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-bound-sa-token\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.773888 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.773854    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qdmgz"]
Jul 24 14:26:44.775622 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.775560    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qdmgz"
Jul 24 14:26:44.799719 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.799690    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6vcpp\""
Jul 24 14:26:44.807877 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:44.807850    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-104.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-134-104.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 24 14:26:44.808138 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:44.808116    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-104.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-134-104.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 24 14:26:44.808219 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:26:44.808142    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"canary-serving-cert\" is forbidden: User \"system:node:ip-10-0-134-104.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-134-104.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret"
Jul 24 14:26:44.810260 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810243    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-tls\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.810326 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810268    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-certificates\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.810326 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810288    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-image-registry-private-configuration\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.810326 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810303    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-trusted-ca\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.810326 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-bound-sa-token\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.810454 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-installation-pull-secrets\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.810454 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810386    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqfm6\" (UniqueName: \"kubernetes.io/projected/12195fe5-614c-4140-b18a-10f0c231c632-kube-api-access-xqfm6\") pod \"downloads-7c97dc4555-622k9\" (UID: \"12195fe5-614c-4140-b18a-10f0c231c632\") " pod="openshift-console/downloads-7c97dc4555-622k9"
Jul 24 14:26:44.810526 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810507    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddfgc\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-kube-api-access-ddfgc\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.810576 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-ca-trust-extracted\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.810991 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.810966    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-ca-trust-extracted\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.811425 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.811401    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-certificates\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.811523 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.811428    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-trusted-ca\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.812870 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.812851    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-image-registry-private-configuration\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.813012 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.812996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-tls\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.813491 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.813474    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-installation-pull-secrets\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.848685 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.848611    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-bound-sa-token\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.850744 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.850715    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6drzf"]
Jul 24 14:26:44.853108 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.853088    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qdmgz"]
Jul 24 14:26:44.853237 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.853198    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:44.857422 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.857399    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 14:26:44.857959 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.857945    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 14:26:44.858525 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.858507    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 14:26:44.861854 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.861838    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w26gz\""
Jul 24 14:26:44.863209 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.863191    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 14:26:44.864119 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.864101    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddfgc\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-kube-api-access-ddfgc\") pod \"image-registry-5f68c46978-fvtrn\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") " pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:44.865808 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.865787    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6957cd85fd-vhn4q"]
Jul 24 14:26:44.867534 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.867516    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:44.874700 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.874676    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"]
Jul 24 14:26:44.876277 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.876260    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"
Jul 24 14:26:44.882282 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.882183    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6drzf"]
Jul 24 14:26:44.882282 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.882234    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 24 14:26:44.882410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.882383    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7k26w\""
Jul 24 14:26:44.911261 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.911233    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5975eb8-ba5f-41fb-8300-262a3d048566-cert\") pod \"ingress-canary-qdmgz\" (UID: \"b5975eb8-ba5f-41fb-8300-262a3d048566\") " pod="openshift-ingress-canary/ingress-canary-qdmgz"
Jul 24 14:26:44.911433 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.911276    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqfm6\" (UniqueName: \"kubernetes.io/projected/12195fe5-614c-4140-b18a-10f0c231c632-kube-api-access-xqfm6\") pod \"downloads-7c97dc4555-622k9\" (UID: \"12195fe5-614c-4140-b18a-10f0c231c632\") " pod="openshift-console/downloads-7c97dc4555-622k9"
Jul 24 14:26:44.911433 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.911299    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmj88\" (UniqueName: \"kubernetes.io/projected/b5975eb8-ba5f-41fb-8300-262a3d048566-kube-api-access-kmj88\") pod \"ingress-canary-qdmgz\" (UID: \"b5975eb8-ba5f-41fb-8300-262a3d048566\") " pod="openshift-ingress-canary/ingress-canary-qdmgz"
Jul 24 14:26:44.930769 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.930741    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"]
Jul 24 14:26:44.931361 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.931343    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z7ptl"]
Jul 24 14:26:44.933223 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.933199    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:44.938073 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.938053    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 14:26:44.938213 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.938179    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 14:26:44.942792 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.942774    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5jncb\""
Jul 24 14:26:44.945243 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.945219    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6957cd85fd-vhn4q"]
Jul 24 14:26:44.946660 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.946631    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqfm6\" (UniqueName: \"kubernetes.io/projected/12195fe5-614c-4140-b18a-10f0c231c632-kube-api-access-xqfm6\") pod \"downloads-7c97dc4555-622k9\" (UID: \"12195fe5-614c-4140-b18a-10f0c231c632\") " pod="openshift-console/downloads-7c97dc4555-622k9"
Jul 24 14:26:44.962462 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.962361    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7ptl"]
Jul 24 14:26:44.988707 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:44.988669    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-622k9"
Jul 24 14:26:45.012548 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012521    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/268b9c0e-6fb8-445f-adbc-c05406142a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.012697 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012555    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5975eb8-ba5f-41fb-8300-262a3d048566-cert\") pod \"ingress-canary-qdmgz\" (UID: \"b5975eb8-ba5f-41fb-8300-262a3d048566\") " pod="openshift-ingress-canary/ingress-canary-qdmgz"
Jul 24 14:26:45.012697 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012574    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2779c5d-d8b5-4912-9f61-978fe4efd932-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-lstzv\" (UID: \"d2779c5d-d8b5-4912-9f61-978fe4efd932\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"
Jul 24 14:26:45.012697 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5152dfbb-3c29-4c07-99b5-b15bd11277b7-installation-pull-secrets\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.012812 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn5r7\" (UniqueName: \"kubernetes.io/projected/268b9c0e-6fb8-445f-adbc-c05406142a25-kube-api-access-tn5r7\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.012812 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5152dfbb-3c29-4c07-99b5-b15bd11277b7-image-registry-private-configuration\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.012812 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012763    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5152dfbb-3c29-4c07-99b5-b15bd11277b7-trusted-ca\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.012921 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012842    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/268b9c0e-6fb8-445f-adbc-c05406142a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.012921 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012875    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-registry-tls\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.012983 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmj88\" (UniqueName: \"kubernetes.io/projected/b5975eb8-ba5f-41fb-8300-262a3d048566-kube-api-access-kmj88\") pod \"ingress-canary-qdmgz\" (UID: \"b5975eb8-ba5f-41fb-8300-262a3d048566\") " pod="openshift-ingress-canary/ingress-canary-qdmgz"
Jul 24 14:26:45.012983 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/268b9c0e-6fb8-445f-adbc-c05406142a25-data-volume\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.012983 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.012979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6h6q\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-kube-api-access-x6h6q\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.013131 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.013005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5152dfbb-3c29-4c07-99b5-b15bd11277b7-ca-trust-extracted\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.013131 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.013046    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5152dfbb-3c29-4c07-99b5-b15bd11277b7-registry-certificates\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.013199 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.013132    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-bound-sa-token\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.013199 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.013177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/268b9c0e-6fb8-445f-adbc-c05406142a25-crio-socket\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.114299 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ddd0013-4600-497f-ac52-502693253399-metrics-tls\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.114299 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114255    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/268b9c0e-6fb8-445f-adbc-c05406142a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.114481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5152dfbb-3c29-4c07-99b5-b15bd11277b7-registry-certificates\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.114481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114428    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w7pf\" (UniqueName: \"kubernetes.io/projected/2ddd0013-4600-497f-ac52-502693253399-kube-api-access-9w7pf\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.114481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114457    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/268b9c0e-6fb8-445f-adbc-c05406142a25-data-volume\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.114609 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ddd0013-4600-497f-ac52-502693253399-tmp-dir\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.114609 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114522    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5152dfbb-3c29-4c07-99b5-b15bd11277b7-ca-trust-extracted\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.114609 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/268b9c0e-6fb8-445f-adbc-c05406142a25-crio-socket\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.114752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/268b9c0e-6fb8-445f-adbc-c05406142a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.114752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddd0013-4600-497f-ac52-502693253399-config-volume\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.114752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2779c5d-d8b5-4912-9f61-978fe4efd932-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-lstzv\" (UID: \"d2779c5d-d8b5-4912-9f61-978fe4efd932\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"
Jul 24 14:26:45.114752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114672    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/268b9c0e-6fb8-445f-adbc-c05406142a25-crio-socket\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.114752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn5r7\" (UniqueName: \"kubernetes.io/projected/268b9c0e-6fb8-445f-adbc-c05406142a25-kube-api-access-tn5r7\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.114752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5152dfbb-3c29-4c07-99b5-b15bd11277b7-image-registry-private-configuration\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.114752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5152dfbb-3c29-4c07-99b5-b15bd11277b7-trusted-ca\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.115106 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-bound-sa-token\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.115106 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114797    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-registry-tls\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.115106 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114803    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/268b9c0e-6fb8-445f-adbc-c05406142a25-data-volume\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.115106 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6h6q\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-kube-api-access-x6h6q\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.115106 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5152dfbb-3c29-4c07-99b5-b15bd11277b7-installation-pull-secrets\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.115106 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114925    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5152dfbb-3c29-4c07-99b5-b15bd11277b7-ca-trust-extracted\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.115106 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.114987    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/268b9c0e-6fb8-445f-adbc-c05406142a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.115436 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.115314    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5152dfbb-3c29-4c07-99b5-b15bd11277b7-registry-certificates\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.115814 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.115789    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5152dfbb-3c29-4c07-99b5-b15bd11277b7-trusted-ca\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.117382 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.117343    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2779c5d-d8b5-4912-9f61-978fe4efd932-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-lstzv\" (UID: \"d2779c5d-d8b5-4912-9f61-978fe4efd932\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"
Jul 24 14:26:45.117702 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.117679    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/268b9c0e-6fb8-445f-adbc-c05406142a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.117744 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.117707    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5152dfbb-3c29-4c07-99b5-b15bd11277b7-installation-pull-secrets\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.117855 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.117832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5152dfbb-3c29-4c07-99b5-b15bd11277b7-image-registry-private-configuration\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.117890 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.117835    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-registry-tls\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.122311 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.122247    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-622k9"]
Jul 24 14:26:45.124454 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:45.124432    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12195fe5_614c_4140_b18a_10f0c231c632.slice/crio-f4f9193fae7b39a084653a00901030a014eb240b18ce32139d8071b3ff2b7e6d WatchSource:0}: Error finding container f4f9193fae7b39a084653a00901030a014eb240b18ce32139d8071b3ff2b7e6d: Status 404 returned error can't find the container with id f4f9193fae7b39a084653a00901030a014eb240b18ce32139d8071b3ff2b7e6d
Jul 24 14:26:45.135908 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.135888    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6h6q\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-kube-api-access-x6h6q\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.135993 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.135965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5152dfbb-3c29-4c07-99b5-b15bd11277b7-bound-sa-token\") pod \"image-registry-6957cd85fd-vhn4q\" (UID: \"5152dfbb-3c29-4c07-99b5-b15bd11277b7\") " pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.136749 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.136732    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn5r7\" (UniqueName: \"kubernetes.io/projected/268b9c0e-6fb8-445f-adbc-c05406142a25-kube-api-access-tn5r7\") pod \"insights-runtime-extractor-6drzf\" (UID: \"268b9c0e-6fb8-445f-adbc-c05406142a25\") " pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.161980 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.161953    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6drzf"
Jul 24 14:26:45.176287 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.176262    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.184454 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.184423    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"
Jul 24 14:26:45.216355 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.215444    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ddd0013-4600-497f-ac52-502693253399-metrics-tls\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.216355 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.215499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w7pf\" (UniqueName: \"kubernetes.io/projected/2ddd0013-4600-497f-ac52-502693253399-kube-api-access-9w7pf\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.216355 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.215531    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ddd0013-4600-497f-ac52-502693253399-tmp-dir\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.216355 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.215571    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddd0013-4600-497f-ac52-502693253399-config-volume\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.216355 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.216320    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddd0013-4600-497f-ac52-502693253399-config-volume\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.216753 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.216722    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ddd0013-4600-497f-ac52-502693253399-tmp-dir\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.221525 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.221467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ddd0013-4600-497f-ac52-502693253399-metrics-tls\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.233733 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.233411    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w7pf\" (UniqueName: \"kubernetes.io/projected/2ddd0013-4600-497f-ac52-502693253399-kube-api-access-9w7pf\") pod \"dns-default-z7ptl\" (UID: \"2ddd0013-4600-497f-ac52-502693253399\") " pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.242298 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.241988    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:45.323864 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.323830    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6drzf"]
Jul 24 14:26:45.328077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:45.328041    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268b9c0e_6fb8_445f_adbc_c05406142a25.slice/crio-d5b1e617f04759628192cb959456091553e4e8fcf82797249898364a3a44f280 WatchSource:0}: Error finding container d5b1e617f04759628192cb959456091553e4e8fcf82797249898364a3a44f280: Status 404 returned error can't find the container with id d5b1e617f04759628192cb959456091553e4e8fcf82797249898364a3a44f280
Jul 24 14:26:45.349302 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.349022    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6957cd85fd-vhn4q"]
Jul 24 14:26:45.354674 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:45.354647    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5152dfbb_3c29_4c07_99b5_b15bd11277b7.slice/crio-4b8a80af1631519da8e3ad81b14a564134978b6bc05deeb535ae2a04184f5d54 WatchSource:0}: Error finding container 4b8a80af1631519da8e3ad81b14a564134978b6bc05deeb535ae2a04184f5d54: Status 404 returned error can't find the container with id 4b8a80af1631519da8e3ad81b14a564134978b6bc05deeb535ae2a04184f5d54
Jul 24 14:26:45.365887 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.365828    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"]
Jul 24 14:26:45.369206 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:45.369181    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2779c5d_d8b5_4912_9f61_978fe4efd932.slice/crio-7597876f50b85b7267dc52021028b0d12bd9d1f717b3f76ab8d4d1fc5eedb38d WatchSource:0}: Error finding container 7597876f50b85b7267dc52021028b0d12bd9d1f717b3f76ab8d4d1fc5eedb38d: Status 404 returned error can't find the container with id 7597876f50b85b7267dc52021028b0d12bd9d1f717b3f76ab8d4d1fc5eedb38d
Jul 24 14:26:45.396447 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.396425    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7ptl"]
Jul 24 14:26:45.399196 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:45.399168    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddd0013_4600_497f_ac52_502693253399.slice/crio-89b09cf8630304979031fc948088f245cc737be6e43655f990544acc54279b10 WatchSource:0}: Error finding container 89b09cf8630304979031fc948088f245cc737be6e43655f990544acc54279b10: Status 404 returned error can't find the container with id 89b09cf8630304979031fc948088f245cc737be6e43655f990544acc54279b10
Jul 24 14:26:45.644594 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.644499    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q" event={"ID":"5152dfbb-3c29-4c07-99b5-b15bd11277b7","Type":"ContainerStarted","Data":"af87c38019d65243de5abf90630c3618190541bcd450f9c432d0d04b845be2d4"}
Jul 24 14:26:45.645005 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.644684    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:26:45.645005 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.644721    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q" event={"ID":"5152dfbb-3c29-4c07-99b5-b15bd11277b7","Type":"ContainerStarted","Data":"4b8a80af1631519da8e3ad81b14a564134978b6bc05deeb535ae2a04184f5d54"}
Jul 24 14:26:45.645757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.645732    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7ptl" event={"ID":"2ddd0013-4600-497f-ac52-502693253399","Type":"ContainerStarted","Data":"89b09cf8630304979031fc948088f245cc737be6e43655f990544acc54279b10"}
Jul 24 14:26:45.646847 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.646828    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv" event={"ID":"d2779c5d-d8b5-4912-9f61-978fe4efd932","Type":"ContainerStarted","Data":"7597876f50b85b7267dc52021028b0d12bd9d1f717b3f76ab8d4d1fc5eedb38d"}
Jul 24 14:26:45.647935 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.647917    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6drzf" event={"ID":"268b9c0e-6fb8-445f-adbc-c05406142a25","Type":"ContainerStarted","Data":"d5b1e617f04759628192cb959456091553e4e8fcf82797249898364a3a44f280"}
Jul 24 14:26:45.648899 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.648880    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:45.648899 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.648894    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-622k9" event={"ID":"12195fe5-614c-4140-b18a-10f0c231c632","Type":"ContainerStarted","Data":"f4f9193fae7b39a084653a00901030a014eb240b18ce32139d8071b3ff2b7e6d"}
Jul 24 14:26:45.655496 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.655478    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:45.673607 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.673559    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q" podStartSLOduration=1.673544836 podStartE2EDuration="1.673544836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:45.673084934 +0000 UTC m=+272.114835454" watchObservedRunningTime="2026-07-24 14:26:45.673544836 +0000 UTC m=+272.115295333"
Jul 24 14:26:45.713246 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.712364    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 14:26:45.717639 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.717505    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5975eb8-ba5f-41fb-8300-262a3d048566-cert\") pod \"ingress-canary-qdmgz\" (UID: \"b5975eb8-ba5f-41fb-8300-262a3d048566\") " pod="openshift-ingress-canary/ingress-canary-qdmgz"
Jul 24 14:26:45.742659 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.742439    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 14:26:45.824000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.821338    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-bound-sa-token\") pod \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") "
Jul 24 14:26:45.824000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.821385    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-trusted-ca\") pod \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") "
Jul 24 14:26:45.824000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.821419    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-tls\") pod \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") "
Jul 24 14:26:45.824000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.821449    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-ca-trust-extracted\") pod \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") "
Jul 24 14:26:45.824000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.821617    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-certificates\") pod \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") "
Jul 24 14:26:45.824000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.821660    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-installation-pull-secrets\") pod \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") "
Jul 24 14:26:45.824000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.821705    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddfgc\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-kube-api-access-ddfgc\") pod \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") "
Jul 24 14:26:45.824000 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.821732    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-image-registry-private-configuration\") pod \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\" (UID: \"7284b88a-0f9b-4d87-b676-c1a2ec6a4bba\") "
Jul 24 14:26:45.824753 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.824718    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" (UID: "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:26:45.825383 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.825233    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" (UID: "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:26:45.825711 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.825686    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" (UID: "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:26:45.826333 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.826306    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" (UID: "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:26:45.830784 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.830739    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" (UID: "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:26:45.831254 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.831013    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" (UID: "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:26:45.834899 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.833424    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" (UID: "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:26:45.837132 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.837104    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-kube-api-access-ddfgc" (OuterVolumeSpecName: "kube-api-access-ddfgc") pod "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" (UID: "7284b88a-0f9b-4d87-b676-c1a2ec6a4bba"). InnerVolumeSpecName "kube-api-access-ddfgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:26:45.922721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.922573    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-bound-sa-token\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:26:45.922721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.922604    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-trusted-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:26:45.922721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.922619    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:26:45.922721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.922632    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-ca-trust-extracted\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:26:45.922721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.922648    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-registry-certificates\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:26:45.922721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.922663    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-installation-pull-secrets\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:26:45.922721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.922677    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddfgc\" (UniqueName: \"kubernetes.io/projected/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-kube-api-access-ddfgc\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:26:45.922721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:45.922691    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba-image-registry-private-configuration\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:26:46.091880 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:46.091848    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 14:26:46.118513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:46.118484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmj88\" (UniqueName: \"kubernetes.io/projected/b5975eb8-ba5f-41fb-8300-262a3d048566-kube-api-access-kmj88\") pod \"ingress-canary-qdmgz\" (UID: \"b5975eb8-ba5f-41fb-8300-262a3d048566\") " pod="openshift-ingress-canary/ingress-canary-qdmgz"
Jul 24 14:26:46.284443 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:46.284362    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qdmgz"
Jul 24 14:26:46.506584 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:46.506549    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qdmgz"]
Jul 24 14:26:46.654135 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:46.653438    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f68c46978-fvtrn"
Jul 24 14:26:46.698327 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:46.698295    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f68c46978-fvtrn"]
Jul 24 14:26:46.701139 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:46.701112    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f68c46978-fvtrn"]
Jul 24 14:26:47.047664 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:47.042544    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5975eb8_ba5f_41fb_8300_262a3d048566.slice/crio-cc1193a2f2f5deefca2095bf97a9bab50b4719c39f33c48c98fb5f7c0cd4cdca WatchSource:0}: Error finding container cc1193a2f2f5deefca2095bf97a9bab50b4719c39f33c48c98fb5f7c0cd4cdca: Status 404 returned error can't find the container with id cc1193a2f2f5deefca2095bf97a9bab50b4719c39f33c48c98fb5f7c0cd4cdca
Jul 24 14:26:47.663003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:47.660321    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv" event={"ID":"d2779c5d-d8b5-4912-9f61-978fe4efd932","Type":"ContainerStarted","Data":"a9cb61d542c13fba10fcbdbf49cf1e1799910b45a8660535bd826887e885f06f"}
Jul 24 14:26:47.663684 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:47.663622    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"
Jul 24 14:26:47.666910 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:47.666838    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qdmgz" event={"ID":"b5975eb8-ba5f-41fb-8300-262a3d048566","Type":"ContainerStarted","Data":"cc1193a2f2f5deefca2095bf97a9bab50b4719c39f33c48c98fb5f7c0cd4cdca"}
Jul 24 14:26:47.669262 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:47.669201    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv"
Jul 24 14:26:47.682616 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:47.682556    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-lstzv" podStartSLOduration=1.954652753 podStartE2EDuration="3.682541105s" totalImagesPullingTime="1.727888352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:47.680928171 +0000 UTC m=+274.122678703" watchObservedRunningTime="2026-07-24 14:26:47.682541105 +0000 UTC m=+274.124291624"
Jul 24 14:26:48.018862 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.018648    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7284b88a-0f9b-4d87-b676-c1a2ec6a4bba" path="/var/lib/kubelet/pods/7284b88a-0f9b-4d87-b676-c1a2ec6a4bba/volumes"
Jul 24 14:26:48.100642 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.100606    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"]
Jul 24 14:26:48.104249 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.104222    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.108262 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.107573    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 14:26:48.108262 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.107776    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 14:26:48.108262 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.108082    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vpj27\""
Jul 24 14:26:48.109559 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.108884    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 14:26:48.109559 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.109158    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 14:26:48.109559 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.109382    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 14:26:48.119827 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.119799    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"]
Jul 24 14:26:48.244574 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.244458    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f6667b3-93ea-404f-8f20-dd46b097cd38-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.244574 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.244548    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8b88\" (UniqueName: \"kubernetes.io/projected/5f6667b3-93ea-404f-8f20-dd46b097cd38-kube-api-access-w8b88\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.244802 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.244599    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6667b3-93ea-404f-8f20-dd46b097cd38-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.244802 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.244653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f6667b3-93ea-404f-8f20-dd46b097cd38-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.345904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.345064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f6667b3-93ea-404f-8f20-dd46b097cd38-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.345904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.345123    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f6667b3-93ea-404f-8f20-dd46b097cd38-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.345904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.345159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8b88\" (UniqueName: \"kubernetes.io/projected/5f6667b3-93ea-404f-8f20-dd46b097cd38-kube-api-access-w8b88\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.345904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.345204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6667b3-93ea-404f-8f20-dd46b097cd38-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.346217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.346056    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6667b3-93ea-404f-8f20-dd46b097cd38-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.349727 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.348888    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f6667b3-93ea-404f-8f20-dd46b097cd38-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.350916 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.350891    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f6667b3-93ea-404f-8f20-dd46b097cd38-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.364205 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.364165    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8b88\" (UniqueName: \"kubernetes.io/projected/5f6667b3-93ea-404f-8f20-dd46b097cd38-kube-api-access-w8b88\") pod \"prometheus-operator-84d69f794d-jdlqj\" (UID: \"5f6667b3-93ea-404f-8f20-dd46b097cd38\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.417610 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.417583    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"
Jul 24 14:26:48.601565 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.601534    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jdlqj"]
Jul 24 14:26:48.606186 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:26:48.606153    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6667b3_93ea_404f_8f20_dd46b097cd38.slice/crio-5e6c6dc6809573480e5e92f925f1f830056808ecc585b66d862b01860dab774b WatchSource:0}: Error finding container 5e6c6dc6809573480e5e92f925f1f830056808ecc585b66d862b01860dab774b: Status 404 returned error can't find the container with id 5e6c6dc6809573480e5e92f925f1f830056808ecc585b66d862b01860dab774b
Jul 24 14:26:48.674232 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.674198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7ptl" event={"ID":"2ddd0013-4600-497f-ac52-502693253399","Type":"ContainerStarted","Data":"093aaec6150dcca735d6bbd7492ced85c7312ea39f425be50b814cd8be16a70a"}
Jul 24 14:26:48.674697 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.674261    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7ptl" event={"ID":"2ddd0013-4600-497f-ac52-502693253399","Type":"ContainerStarted","Data":"5f1a6e3e04181954deafa598346f9eb619c816cc5f8684b4748a119e3fc2b875"}
Jul 24 14:26:48.674697 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.674455    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:26:48.676745 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.676694    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj" event={"ID":"5f6667b3-93ea-404f-8f20-dd46b097cd38","Type":"ContainerStarted","Data":"5e6c6dc6809573480e5e92f925f1f830056808ecc585b66d862b01860dab774b"}
Jul 24 14:26:48.701422 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:48.701363    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z7ptl" podStartSLOduration=1.8329227769999998 podStartE2EDuration="4.701341335s" totalImagesPullingTime="2.868418558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:48.700583209 +0000 UTC m=+275.142333729" watchObservedRunningTime="2026-07-24 14:26:48.701341335 +0000 UTC m=+275.143091855"
Jul 24 14:26:53.697421 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:53.697379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qdmgz" event={"ID":"b5975eb8-ba5f-41fb-8300-262a3d048566","Type":"ContainerStarted","Data":"4eec9128f04269cef8bd44c6164dbf96a9ec5b00e701e9d57a27fd2f90de64aa"}
Jul 24 14:26:53.700693 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:53.700130    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj" event={"ID":"5f6667b3-93ea-404f-8f20-dd46b097cd38","Type":"ContainerStarted","Data":"08a39663dcf560acae98eed78edba1bb73001b00ae24055022313447fdc7a9b1"}
Jul 24 14:26:53.700693 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:53.700188    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj" event={"ID":"5f6667b3-93ea-404f-8f20-dd46b097cd38","Type":"ContainerStarted","Data":"88de531d8a5a37964581e62af962284539da0c95de8108d27cdfb72add6b7b84"}
Jul 24 14:26:53.702817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:53.702789    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6drzf" event={"ID":"268b9c0e-6fb8-445f-adbc-c05406142a25","Type":"ContainerStarted","Data":"2b4a7eb0f9a5075395e801e0e49ed229f52989133cd8cdf7dec2239fafe963c1"}
Jul 24 14:26:53.724313 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:53.724250    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qdmgz" podStartSLOduration=3.963536528 podStartE2EDuration="9.724227274s" totalImagesPullingTime="5.760690746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:53.724047766 +0000 UTC m=+280.165798304" watchObservedRunningTime="2026-07-24 14:26:53.724227274 +0000 UTC m=+280.165977793"
Jul 24 14:26:56.413712 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.413558    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-jdlqj" podStartSLOduration=3.777037791 podStartE2EDuration="8.413534377s" totalImagesPullingTime="4.636496586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:53.75330853 +0000 UTC m=+280.195059050" watchObservedRunningTime="2026-07-24 14:26:56.413534377 +0000 UTC m=+282.855284897"
Jul 24 14:26:56.414171 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.414103    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b6rfq"]
Jul 24 14:26:56.419270 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.419208    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.429753 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.429730    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 14:26:56.429898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.429773    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 14:26:56.437537 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.437511    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 14:26:56.473230 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.472954    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gmr2w\""
Jul 24 14:26:56.510129 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-tls\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.510290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510136    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a7cbe04-8968-4926-a484-265c2038c09f-metrics-client-ca\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.510290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.510290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510191    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbd29\" (UniqueName: \"kubernetes.io/projected/7a7cbe04-8968-4926-a484-265c2038c09f-kube-api-access-lbd29\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.510290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510234    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.510290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-root\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.510566 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510298    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-wtmp\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.510566 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-sys\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.510566 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.510379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-textfile\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.610752 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610716    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.610938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-root\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.610938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-wtmp\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.610938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-sys\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.610938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-textfile\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.610938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-tls\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.610938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-root\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.610938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a7cbe04-8968-4926-a484-265c2038c09f-metrics-client-ca\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.611317 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610921    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-sys\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.611317 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.611317 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610983    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-wtmp\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.611317 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.610988    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbd29\" (UniqueName: \"kubernetes.io/projected/7a7cbe04-8968-4926-a484-265c2038c09f-kube-api-access-lbd29\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.611317 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.611223    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-textfile\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.611491 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.611430    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.611575 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.611554    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a7cbe04-8968-4926-a484-265c2038c09f-metrics-client-ca\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.613640 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.613617    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-tls\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.614013 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.613989    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a7cbe04-8968-4926-a484-265c2038c09f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.624983 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.624957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbd29\" (UniqueName: \"kubernetes.io/projected/7a7cbe04-8968-4926-a484-265c2038c09f-kube-api-access-lbd29\") pod \"node-exporter-b6rfq\" (UID: \"7a7cbe04-8968-4926-a484-265c2038c09f\") " pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:56.731701 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:56.731675    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b6rfq"
Jul 24 14:26:58.682864 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:26:58.682830    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z7ptl"
Jul 24 14:27:00.418413 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.418379    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"]
Jul 24 14:27:00.424564 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.424529    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:00.427973 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.427927    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 14:27:00.428131 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.427971    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mx2tx\""
Jul 24 14:27:00.436325 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.436303    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"]
Jul 24 14:27:00.439741 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.439707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/989d1705-56a1-40bb-84ae-0cfae0fa853f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-tlgtz\" (UID: \"989d1705-56a1-40bb-84ae-0cfae0fa853f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:00.440098 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.439781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7wld\" (UniqueName: \"kubernetes.io/projected/989d1705-56a1-40bb-84ae-0cfae0fa853f-kube-api-access-n7wld\") pod \"monitoring-plugin-68b7fc9574-tlgtz\" (UID: \"989d1705-56a1-40bb-84ae-0cfae0fa853f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:00.540798 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.540758    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/989d1705-56a1-40bb-84ae-0cfae0fa853f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-tlgtz\" (UID: \"989d1705-56a1-40bb-84ae-0cfae0fa853f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:00.540981 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.540832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7wld\" (UniqueName: \"kubernetes.io/projected/989d1705-56a1-40bb-84ae-0cfae0fa853f-kube-api-access-n7wld\") pod \"monitoring-plugin-68b7fc9574-tlgtz\" (UID: \"989d1705-56a1-40bb-84ae-0cfae0fa853f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:00.540981 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:27:00.540921    2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 24 14:27:00.541095 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:27:00.541015    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989d1705-56a1-40bb-84ae-0cfae0fa853f-monitoring-plugin-cert podName:989d1705-56a1-40bb-84ae-0cfae0fa853f nodeName:}" failed. No retries permitted until 2026-07-24 14:27:01.040989304 +0000 UTC m=+287.482739806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/989d1705-56a1-40bb-84ae-0cfae0fa853f-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-tlgtz" (UID: "989d1705-56a1-40bb-84ae-0cfae0fa853f") : secret "monitoring-plugin-cert" not found
Jul 24 14:27:00.553435 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:00.553408    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7wld\" (UniqueName: \"kubernetes.io/projected/989d1705-56a1-40bb-84ae-0cfae0fa853f-kube-api-access-n7wld\") pod \"monitoring-plugin-68b7fc9574-tlgtz\" (UID: \"989d1705-56a1-40bb-84ae-0cfae0fa853f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:01.045707 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:01.045661    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/989d1705-56a1-40bb-84ae-0cfae0fa853f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-tlgtz\" (UID: \"989d1705-56a1-40bb-84ae-0cfae0fa853f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:01.048459 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:01.048423    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/989d1705-56a1-40bb-84ae-0cfae0fa853f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-tlgtz\" (UID: \"989d1705-56a1-40bb-84ae-0cfae0fa853f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:01.335901 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:01.335829    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:04.693335 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:27:04.693307    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7cbe04_8968_4926_a484_265c2038c09f.slice/crio-8620aa0c0fd5fb7591a13804f5a64f1908174634bb4313f0a3e320fe40de36cb WatchSource:0}: Error finding container 8620aa0c0fd5fb7591a13804f5a64f1908174634bb4313f0a3e320fe40de36cb: Status 404 returned error can't find the container with id 8620aa0c0fd5fb7591a13804f5a64f1908174634bb4313f0a3e320fe40de36cb
Jul 24 14:27:04.744887 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:04.744859    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6rfq" event={"ID":"7a7cbe04-8968-4926-a484-265c2038c09f","Type":"ContainerStarted","Data":"8620aa0c0fd5fb7591a13804f5a64f1908174634bb4313f0a3e320fe40de36cb"}
Jul 24 14:27:04.833542 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:04.830251    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"]
Jul 24 14:27:04.837418 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:27:04.837389    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989d1705_56a1_40bb_84ae_0cfae0fa853f.slice/crio-e3cf15c48377e399deabe7407c110296880ea8b7a3e830e9facd01cc1db10338 WatchSource:0}: Error finding container e3cf15c48377e399deabe7407c110296880ea8b7a3e830e9facd01cc1db10338: Status 404 returned error can't find the container with id e3cf15c48377e399deabe7407c110296880ea8b7a3e830e9facd01cc1db10338
Jul 24 14:27:05.426275 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.425339    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-846db577b6-bdw6c"]
Jul 24 14:27:05.458057 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.457890    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.462519 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.462474    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846db577b6-bdw6c"]
Jul 24 14:27:05.468840 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.468778    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 14:27:05.469233 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.469048    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 14:27:05.469725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.469706    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 14:27:05.470098 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.470079    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 14:27:05.470826 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.470682    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hktcq\""
Jul 24 14:27:05.471201 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.470914    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 14:27:05.479815 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.479774    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-service-ca\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.479998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.479824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-serving-cert\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.479998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.479870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-oauth-config\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.479998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.479900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5csr\" (UniqueName: \"kubernetes.io/projected/78a212ba-3ae7-417a-ad94-547dc745aac2-kube-api-access-x5csr\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.479998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.479953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-console-config\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.480259 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.479998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-oauth-serving-cert\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.581638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.580863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-oauth-config\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.581638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.580910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5csr\" (UniqueName: \"kubernetes.io/projected/78a212ba-3ae7-417a-ad94-547dc745aac2-kube-api-access-x5csr\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.581638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.580966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-console-config\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.581638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.581008    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-oauth-serving-cert\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.581638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.581071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-service-ca\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.581638 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.581098    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-serving-cert\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.585315 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.583452    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-oauth-serving-cert\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.585315 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.584646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-service-ca\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.585315 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.585276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-console-config\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.585315 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.585285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-serving-cert\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.587589 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.587546    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-oauth-config\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.597622 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.597586    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5csr\" (UniqueName: \"kubernetes.io/projected/78a212ba-3ae7-417a-ad94-547dc745aac2-kube-api-access-x5csr\") pod \"console-846db577b6-bdw6c\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") " pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.754081 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.753928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz" event={"ID":"989d1705-56a1-40bb-84ae-0cfae0fa853f","Type":"ContainerStarted","Data":"e3cf15c48377e399deabe7407c110296880ea8b7a3e830e9facd01cc1db10338"}
Jul 24 14:27:05.759411 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.759182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6drzf" event={"ID":"268b9c0e-6fb8-445f-adbc-c05406142a25","Type":"ContainerStarted","Data":"8caa37aec32fc6913d043a6a9987b42fb8acbf14c3ce5d00cd84e395124b2ae8"}
Jul 24 14:27:05.763802 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.763426    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-622k9" event={"ID":"12195fe5-614c-4140-b18a-10f0c231c632","Type":"ContainerStarted","Data":"af224511b43b09161d68e679f8deffc6b3c27aeb24d09b525a2e143e2c618907"}
Jul 24 14:27:05.765136 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.765087    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-622k9"
Jul 24 14:27:05.772525 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.772335    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:05.777905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.777857    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-622k9"
Jul 24 14:27:05.880372 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:05.880089    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-622k9" podStartSLOduration=2.292541473 podStartE2EDuration="21.880063726s" totalImagesPullingTime="19.587522253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:05.810218831 +0000 UTC m=+292.251969351" watchObservedRunningTime="2026-07-24 14:27:05.880063726 +0000 UTC m=+292.321814242"
Jul 24 14:27:06.491870 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:06.491152    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846db577b6-bdw6c"]
Jul 24 14:27:06.660439 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:06.659716    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6957cd85fd-vhn4q"
Jul 24 14:27:06.773180 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:06.773113    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846db577b6-bdw6c" event={"ID":"78a212ba-3ae7-417a-ad94-547dc745aac2","Type":"ContainerStarted","Data":"e3b6364d46b938ca1c9e980e56fefc041701d82c86104b5a340da3f79e8c5941"}
Jul 24 14:27:07.780873 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:07.780827    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6rfq" event={"ID":"7a7cbe04-8968-4926-a484-265c2038c09f","Type":"ContainerStarted","Data":"b3f0e997bcd7c0455fc7846e6b98eee5e2cee72aef50e65284f9895366611c70"}
Jul 24 14:27:07.889679 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:07.888460    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74fb4d5974-gmp6k"]
Jul 24 14:27:07.911563 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:07.911249    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:07.927124 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:07.926831    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fb4d5974-gmp6k"]
Jul 24 14:27:07.933367 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:07.933342    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 14:27:08.004871 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.004831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-service-ca\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.005075 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.004890    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-config\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.005075 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.004922    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-oauth-config\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.005075 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.004954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-serving-cert\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.005075 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.005013    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-oauth-serving-cert\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.005310 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.005113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv85b\" (UniqueName: \"kubernetes.io/projected/4fbbeee1-7fba-4c74-966c-003fde5bf33c-kube-api-access-gv85b\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.005310 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.005141    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-trusted-ca-bundle\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.106386 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.106349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-service-ca\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.106613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.106402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-config\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.106613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.106430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-oauth-config\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.106613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.106464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-serving-cert\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.106613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.106487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-oauth-serving-cert\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.106613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.106514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv85b\" (UniqueName: \"kubernetes.io/projected/4fbbeee1-7fba-4c74-966c-003fde5bf33c-kube-api-access-gv85b\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.106613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.106541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-trusted-ca-bundle\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.107710 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.107487    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-trusted-ca-bundle\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.108681 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.108626    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-config\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.108794 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.108726    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-oauth-serving-cert\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.109205 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.109152    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-service-ca\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.112373 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.112333    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-oauth-config\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.114063 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.113981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-serving-cert\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.122524 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.122389    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv85b\" (UniqueName: \"kubernetes.io/projected/4fbbeee1-7fba-4c74-966c-003fde5bf33c-kube-api-access-gv85b\") pod \"console-74fb4d5974-gmp6k\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") " pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:08.226992 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:08.226959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:10.576337 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:10.576300    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fb4d5974-gmp6k"]
Jul 24 14:27:10.579806 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:27:10.579776    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbbeee1_7fba_4c74_966c_003fde5bf33c.slice/crio-a26c8fb309996931a6111adc8d2fb08de90b4a65e28b7fc9bd1f42f1c8d2f6b8 WatchSource:0}: Error finding container a26c8fb309996931a6111adc8d2fb08de90b4a65e28b7fc9bd1f42f1c8d2f6b8: Status 404 returned error can't find the container with id a26c8fb309996931a6111adc8d2fb08de90b4a65e28b7fc9bd1f42f1c8d2f6b8
Jul 24 14:27:10.798940 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:10.798904    2574 generic.go:356] "Generic (PLEG): container finished" podID="7a7cbe04-8968-4926-a484-265c2038c09f" containerID="b3f0e997bcd7c0455fc7846e6b98eee5e2cee72aef50e65284f9895366611c70" exitCode=0
Jul 24 14:27:10.799143 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:10.798991    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6rfq" event={"ID":"7a7cbe04-8968-4926-a484-265c2038c09f","Type":"ContainerDied","Data":"b3f0e997bcd7c0455fc7846e6b98eee5e2cee72aef50e65284f9895366611c70"}
Jul 24 14:27:10.800815 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:10.800782    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz" event={"ID":"989d1705-56a1-40bb-84ae-0cfae0fa853f","Type":"ContainerStarted","Data":"ab75fadbb4b66b92c00320410b03f073cc0617e2d513f5ff6134c798fa55b930"}
Jul 24 14:27:10.801016 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:10.800965    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:10.802253 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:10.802224    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fb4d5974-gmp6k" event={"ID":"4fbbeee1-7fba-4c74-966c-003fde5bf33c","Type":"ContainerStarted","Data":"a26c8fb309996931a6111adc8d2fb08de90b4a65e28b7fc9bd1f42f1c8d2f6b8"}
Jul 24 14:27:10.806789 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:10.806768    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz"
Jul 24 14:27:10.853302 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:10.853244    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tlgtz" podStartSLOduration=5.275844525 podStartE2EDuration="10.853220505s" totalImagesPullingTime="5.57737598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:10.851516687 +0000 UTC m=+297.293267209" watchObservedRunningTime="2026-07-24 14:27:10.853220505 +0000 UTC m=+297.294971024"
Jul 24 14:27:11.636826 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:11.636790    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v7bz6"
Jul 24 14:27:12.815772 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:12.815234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6rfq" event={"ID":"7a7cbe04-8968-4926-a484-265c2038c09f","Type":"ContainerStarted","Data":"41a311ae0019010a9b775dfca8a4f6c245cb4a3962e8095a6682abb0fff83190"}
Jul 24 14:27:12.815772 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:12.815343    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6rfq" event={"ID":"7a7cbe04-8968-4926-a484-265c2038c09f","Type":"ContainerStarted","Data":"bd0c815a78e691dbf91e4ecd2344bfd38914a54b56a5e53f0609149c85ca1a20"}
Jul 24 14:27:12.817964 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:12.817938    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6drzf" event={"ID":"268b9c0e-6fb8-445f-adbc-c05406142a25","Type":"ContainerStarted","Data":"81d9840f93970f0d8d689bcde918c847fea08148e5b7dde57f56e887581fd8a9"}
Jul 24 14:27:12.820328 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:12.820296    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846db577b6-bdw6c" event={"ID":"78a212ba-3ae7-417a-ad94-547dc745aac2","Type":"ContainerStarted","Data":"0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3"}
Jul 24 14:27:12.840148 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:12.840080    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b6rfq" podStartSLOduration=14.063789886 podStartE2EDuration="16.840057681s" totalImagesPullingTime="2.672203506s" totalInitContainerRuntime="104.064289ms" isStatefulPod=true podCreationTimestamp="2026-07-24 14:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:12.837704756 +0000 UTC m=+299.279455319" watchObservedRunningTime="2026-07-24 14:27:12.840057681 +0000 UTC m=+299.281808202"
Jul 24 14:27:12.862660 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:12.862549    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6drzf" podStartSLOduration=2.175954082 podStartE2EDuration="28.862523338s" totalImagesPullingTime="26.686569256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:26:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:12.860730277 +0000 UTC m=+299.302480813" watchObservedRunningTime="2026-07-24 14:27:12.862523338 +0000 UTC m=+299.304273864"
Jul 24 14:27:13.064882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.064848    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846db577b6-bdw6c"]
Jul 24 14:27:13.106540 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.106505    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb88fb84b-h5bvb"]
Jul 24 14:27:13.122285 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.122211    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.125006 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.124917    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb88fb84b-h5bvb"]
Jul 24 14:27:13.259311 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.259271    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-console-config\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.259513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.259328    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-service-ca\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.259513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.259395    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl6v7\" (UniqueName: \"kubernetes.io/projected/9001d29f-e672-48dd-832e-e647a678bbd1-kube-api-access-hl6v7\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.259513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.259430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-oauth-serving-cert\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.259513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.259455    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-serving-cert\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.259513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.259472    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-oauth-config\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.259728 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.259545    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-trusted-ca-bundle\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.360676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.360641    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-service-ca\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.360676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.360685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl6v7\" (UniqueName: \"kubernetes.io/projected/9001d29f-e672-48dd-832e-e647a678bbd1-kube-api-access-hl6v7\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.360998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.360708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-oauth-serving-cert\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.360998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.360728    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-serving-cert\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.360998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.360753    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-oauth-config\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.360998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.360784    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-trusted-ca-bundle\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.360998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.360969    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-console-config\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.361913 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.361569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-service-ca\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.362064 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.361970    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-oauth-serving-cert\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.362150 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.362102    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-console-config\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.362448 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.362413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-trusted-ca-bundle\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.363976 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.363935    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-oauth-config\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.364491 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.364470    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-serving-cert\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.375045 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.374974    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl6v7\" (UniqueName: \"kubernetes.io/projected/9001d29f-e672-48dd-832e-e647a678bbd1-kube-api-access-hl6v7\") pod \"console-fb88fb84b-h5bvb\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") " pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.436067 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.436017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:13.615214 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.615184    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb88fb84b-h5bvb"]
Jul 24 14:27:13.619076 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:27:13.619050    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9001d29f_e672_48dd_832e_e647a678bbd1.slice/crio-618fec8e5d7b32e83605cb4b5f41cb17eb00088ae444320e7c721c41ef49a4c2 WatchSource:0}: Error finding container 618fec8e5d7b32e83605cb4b5f41cb17eb00088ae444320e7c721c41ef49a4c2: Status 404 returned error can't find the container with id 618fec8e5d7b32e83605cb4b5f41cb17eb00088ae444320e7c721c41ef49a4c2
Jul 24 14:27:13.828071 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.828014    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fb4d5974-gmp6k" event={"ID":"4fbbeee1-7fba-4c74-966c-003fde5bf33c","Type":"ContainerStarted","Data":"17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f"}
Jul 24 14:27:13.829534 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.829509    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb88fb84b-h5bvb" event={"ID":"9001d29f-e672-48dd-832e-e647a678bbd1","Type":"ContainerStarted","Data":"83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00"}
Jul 24 14:27:13.829606 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.829555    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb88fb84b-h5bvb" event={"ID":"9001d29f-e672-48dd-832e-e647a678bbd1","Type":"ContainerStarted","Data":"618fec8e5d7b32e83605cb4b5f41cb17eb00088ae444320e7c721c41ef49a4c2"}
Jul 24 14:27:13.860128 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.860074    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74fb4d5974-gmp6k" podStartSLOduration=4.765356332 podStartE2EDuration="6.860059784s" totalImagesPullingTime="2.094703452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:13.85955448 +0000 UTC m=+300.301304998" watchObservedRunningTime="2026-07-24 14:27:13.860059784 +0000 UTC m=+300.301810303"
Jul 24 14:27:13.890141 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.888502    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb88fb84b-h5bvb" podStartSLOduration=0.888483021 podStartE2EDuration="888.483021ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:13.886601449 +0000 UTC m=+300.328352028" watchObservedRunningTime="2026-07-24 14:27:13.888483021 +0000 UTC m=+300.330233540"
Jul 24 14:27:13.912746 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.909849    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-846db577b6-bdw6c" podStartSLOduration=2.891618418 podStartE2EDuration="8.90982857s" totalImagesPullingTime="6.018210152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:13.909496241 +0000 UTC m=+300.351246762" watchObservedRunningTime="2026-07-24 14:27:13.90982857 +0000 UTC m=+300.351579089"
Jul 24 14:27:13.919907 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:13.919885    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 14:27:15.773874 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:15.773838    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:18.227304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:18.227255    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:18.227705 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:18.227334    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:18.232901 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:18.232873    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:18.850458 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:18.850431    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:23.437127 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:23.437090    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:23.437528 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:23.437170    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:23.441676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:23.441654    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:23.866568 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:23.866489    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:27:23.947353 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:23.947320    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74fb4d5974-gmp6k"]
Jul 24 14:27:35.791823 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:35.791794    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qdmgz_b5975eb8-ba5f-41fb-8300-262a3d048566/serve-healthcheck-canary/0.log"
Jul 24 14:27:39.851543 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:39.851473    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-846db577b6-bdw6c" podUID="78a212ba-3ae7-417a-ad94-547dc745aac2" containerName="console" containerID="cri-o://0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3" gracePeriod=15
Jul 24 14:27:40.127347 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.127271    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:40.276016 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.275982    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-oauth-serving-cert\") pod \"78a212ba-3ae7-417a-ad94-547dc745aac2\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") "
Jul 24 14:27:40.276016 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.276015    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-console-config\") pod \"78a212ba-3ae7-417a-ad94-547dc745aac2\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") "
Jul 24 14:27:40.276234 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.276069    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-oauth-config\") pod \"78a212ba-3ae7-417a-ad94-547dc745aac2\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") "
Jul 24 14:27:40.276234 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.276117    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-service-ca\") pod \"78a212ba-3ae7-417a-ad94-547dc745aac2\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") "
Jul 24 14:27:40.276234 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.276156    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-serving-cert\") pod \"78a212ba-3ae7-417a-ad94-547dc745aac2\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") "
Jul 24 14:27:40.276234 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.276193    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5csr\" (UniqueName: \"kubernetes.io/projected/78a212ba-3ae7-417a-ad94-547dc745aac2-kube-api-access-x5csr\") pod \"78a212ba-3ae7-417a-ad94-547dc745aac2\" (UID: \"78a212ba-3ae7-417a-ad94-547dc745aac2\") "
Jul 24 14:27:40.276491 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.276464    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78a212ba-3ae7-417a-ad94-547dc745aac2" (UID: "78a212ba-3ae7-417a-ad94-547dc745aac2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:40.276572 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.276466    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-console-config" (OuterVolumeSpecName: "console-config") pod "78a212ba-3ae7-417a-ad94-547dc745aac2" (UID: "78a212ba-3ae7-417a-ad94-547dc745aac2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:40.276572 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.276551    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-service-ca" (OuterVolumeSpecName: "service-ca") pod "78a212ba-3ae7-417a-ad94-547dc745aac2" (UID: "78a212ba-3ae7-417a-ad94-547dc745aac2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:40.278491 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.278464    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78a212ba-3ae7-417a-ad94-547dc745aac2" (UID: "78a212ba-3ae7-417a-ad94-547dc745aac2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:27:40.278491 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.278481    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78a212ba-3ae7-417a-ad94-547dc745aac2" (UID: "78a212ba-3ae7-417a-ad94-547dc745aac2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:27:40.278491 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.278465    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78a212ba-3ae7-417a-ad94-547dc745aac2-kube-api-access-x5csr" (OuterVolumeSpecName: "kube-api-access-x5csr") pod "78a212ba-3ae7-417a-ad94-547dc745aac2" (UID: "78a212ba-3ae7-417a-ad94-547dc745aac2"). InnerVolumeSpecName "kube-api-access-x5csr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:27:40.377488 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.377406    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5csr\" (UniqueName: \"kubernetes.io/projected/78a212ba-3ae7-417a-ad94-547dc745aac2-kube-api-access-x5csr\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:40.377488 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.377435    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-oauth-serving-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:40.377488 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.377445    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-console-config\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:40.377488 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.377454    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-oauth-config\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:40.377488 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.377463    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78a212ba-3ae7-417a-ad94-547dc745aac2-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:40.377488 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.377470    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78a212ba-3ae7-417a-ad94-547dc745aac2-console-serving-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:40.921575 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.921540    2574 generic.go:356] "Generic (PLEG): container finished" podID="78a212ba-3ae7-417a-ad94-547dc745aac2" containerID="0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3" exitCode=0
Jul 24 14:27:40.921997 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.921582    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846db577b6-bdw6c"
Jul 24 14:27:40.921997 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.921585    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846db577b6-bdw6c" event={"ID":"78a212ba-3ae7-417a-ad94-547dc745aac2","Type":"ContainerDied","Data":"0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3"}
Jul 24 14:27:40.921997 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.921624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846db577b6-bdw6c" event={"ID":"78a212ba-3ae7-417a-ad94-547dc745aac2","Type":"ContainerDied","Data":"e3b6364d46b938ca1c9e980e56fefc041701d82c86104b5a340da3f79e8c5941"}
Jul 24 14:27:40.921997 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.921644    2574 scope.go:117] "RemoveContainer" containerID="0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3"
Jul 24 14:27:40.930277 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.930259    2574 scope.go:117] "RemoveContainer" containerID="0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3"
Jul 24 14:27:40.930585 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:27:40.930559    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3\": container with ID starting with 0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3 not found: ID does not exist" containerID="0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3"
Jul 24 14:27:40.930652 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.930593    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3"} err="failed to get container status \"0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3\": rpc error: code = NotFound desc = could not find container \"0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3\": container with ID starting with 0c2e91cf9647c7ae5b908a72e72a780d6f3f25d02eeb65165c9c0eaae880fed3 not found: ID does not exist"
Jul 24 14:27:40.944092 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.944067    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846db577b6-bdw6c"]
Jul 24 14:27:40.949534 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:40.949513    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-846db577b6-bdw6c"]
Jul 24 14:27:42.017593 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:42.017557    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78a212ba-3ae7-417a-ad94-547dc745aac2" path="/var/lib/kubelet/pods/78a212ba-3ae7-417a-ad94-547dc745aac2/volumes"
Jul 24 14:27:48.966357 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:48.966310    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74fb4d5974-gmp6k" podUID="4fbbeee1-7fba-4c74-966c-003fde5bf33c" containerName="console" containerID="cri-o://17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f" gracePeriod=15
Jul 24 14:27:49.249894 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.249819    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:49.350170 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350133    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-oauth-serving-cert\") pod \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") "
Jul 24 14:27:49.350337 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350182    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-service-ca\") pod \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") "
Jul 24 14:27:49.350337 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350204    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-trusted-ca-bundle\") pod \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") "
Jul 24 14:27:49.350421 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350325    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-serving-cert\") pod \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") "
Jul 24 14:27:49.350421 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350379    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-config\") pod \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") "
Jul 24 14:27:49.350421 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350408    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-oauth-config\") pod \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") "
Jul 24 14:27:49.350551 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350432    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv85b\" (UniqueName: \"kubernetes.io/projected/4fbbeee1-7fba-4c74-966c-003fde5bf33c-kube-api-access-gv85b\") pod \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\" (UID: \"4fbbeee1-7fba-4c74-966c-003fde5bf33c\") "
Jul 24 14:27:49.350551 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350520    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4fbbeee1-7fba-4c74-966c-003fde5bf33c" (UID: "4fbbeee1-7fba-4c74-966c-003fde5bf33c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:49.350656 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350640    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-trusted-ca-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:49.350709 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350661    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-service-ca" (OuterVolumeSpecName: "service-ca") pod "4fbbeee1-7fba-4c74-966c-003fde5bf33c" (UID: "4fbbeee1-7fba-4c74-966c-003fde5bf33c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:49.350709 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350573    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4fbbeee1-7fba-4c74-966c-003fde5bf33c" (UID: "4fbbeee1-7fba-4c74-966c-003fde5bf33c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:49.350814 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.350742    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-config" (OuterVolumeSpecName: "console-config") pod "4fbbeee1-7fba-4c74-966c-003fde5bf33c" (UID: "4fbbeee1-7fba-4c74-966c-003fde5bf33c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:49.352513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.352491    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fbbeee1-7fba-4c74-966c-003fde5bf33c-kube-api-access-gv85b" (OuterVolumeSpecName: "kube-api-access-gv85b") pod "4fbbeee1-7fba-4c74-966c-003fde5bf33c" (UID: "4fbbeee1-7fba-4c74-966c-003fde5bf33c"). InnerVolumeSpecName "kube-api-access-gv85b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:27:49.352605 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.352512    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4fbbeee1-7fba-4c74-966c-003fde5bf33c" (UID: "4fbbeee1-7fba-4c74-966c-003fde5bf33c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:27:49.352605 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.352563    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4fbbeee1-7fba-4c74-966c-003fde5bf33c" (UID: "4fbbeee1-7fba-4c74-966c-003fde5bf33c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:27:49.451635 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.451599    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-serving-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:49.451635 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.451629    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-config\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:49.451835 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.451644    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4fbbeee1-7fba-4c74-966c-003fde5bf33c-console-oauth-config\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:49.451835 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.451656    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv85b\" (UniqueName: \"kubernetes.io/projected/4fbbeee1-7fba-4c74-966c-003fde5bf33c-kube-api-access-gv85b\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:49.451835 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.451668    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-oauth-serving-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:49.451835 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.451679    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbbeee1-7fba-4c74-966c-003fde5bf33c-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:27:49.960146 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.960110    2574 generic.go:356] "Generic (PLEG): container finished" podID="4fbbeee1-7fba-4c74-966c-003fde5bf33c" containerID="17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f" exitCode=0
Jul 24 14:27:49.960306 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.960167    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fb4d5974-gmp6k"
Jul 24 14:27:49.960306 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.960176    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fb4d5974-gmp6k" event={"ID":"4fbbeee1-7fba-4c74-966c-003fde5bf33c","Type":"ContainerDied","Data":"17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f"}
Jul 24 14:27:49.960306 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.960238    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fb4d5974-gmp6k" event={"ID":"4fbbeee1-7fba-4c74-966c-003fde5bf33c","Type":"ContainerDied","Data":"a26c8fb309996931a6111adc8d2fb08de90b4a65e28b7fc9bd1f42f1c8d2f6b8"}
Jul 24 14:27:49.960306 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.960257    2574 scope.go:117] "RemoveContainer" containerID="17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f"
Jul 24 14:27:49.970245 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.969857    2574 scope.go:117] "RemoveContainer" containerID="17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f"
Jul 24 14:27:49.970245 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:27:49.970175    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f\": container with ID starting with 17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f not found: ID does not exist" containerID="17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f"
Jul 24 14:27:49.970245 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.970210    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f"} err="failed to get container status \"17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f\": rpc error: code = NotFound desc = could not find container \"17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f\": container with ID starting with 17d3229ea18eb4c355ae530fd87c0188b3e960fe6f77544490f8c8c274fa652f not found: ID does not exist"
Jul 24 14:27:49.985465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.985437    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74fb4d5974-gmp6k"]
Jul 24 14:27:49.992949 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:49.992922    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74fb4d5974-gmp6k"]
Jul 24 14:27:50.017795 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:27:50.017764    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fbbeee1-7fba-4c74-966c-003fde5bf33c" path="/var/lib/kubelet/pods/4fbbeee1-7fba-4c74-966c-003fde5bf33c/volumes"
Jul 24 14:28:28.084105 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.084067    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bc587f554-pkx7k"]
Jul 24 14:28:28.084641 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.084402    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78a212ba-3ae7-417a-ad94-547dc745aac2" containerName="console"
Jul 24 14:28:28.084641 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.084420    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="78a212ba-3ae7-417a-ad94-547dc745aac2" containerName="console"
Jul 24 14:28:28.084641 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.084440    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fbbeee1-7fba-4c74-966c-003fde5bf33c" containerName="console"
Jul 24 14:28:28.084641 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.084450    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fbbeee1-7fba-4c74-966c-003fde5bf33c" containerName="console"
Jul 24 14:28:28.084641 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.084514    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="78a212ba-3ae7-417a-ad94-547dc745aac2" containerName="console"
Jul 24 14:28:28.084641 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.084524    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fbbeee1-7fba-4c74-966c-003fde5bf33c" containerName="console"
Jul 24 14:28:28.087364 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.087343    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.100360 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.100332    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc587f554-pkx7k"]
Jul 24 14:28:28.158274 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.158236    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-config\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.158274 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.158272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-oauth-serving-cert\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.158532 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.158288    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8vz\" (UniqueName: \"kubernetes.io/projected/f30b3970-4c1f-4a9e-a253-e2a09713bbac-kube-api-access-bz8vz\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.158532 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.158377    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-serving-cert\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.158532 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.158397    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-trusted-ca-bundle\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.158532 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.158470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-service-ca\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.158532 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.158513    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-oauth-config\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.259837 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.259805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-serving-cert\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.259837 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.259839    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-trusted-ca-bundle\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260005 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.259865    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-service-ca\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260005 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.259910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-oauth-config\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260005 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.259935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-config\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260005 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.259952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-oauth-serving-cert\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260005 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.259974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8vz\" (UniqueName: \"kubernetes.io/projected/f30b3970-4c1f-4a9e-a253-e2a09713bbac-kube-api-access-bz8vz\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260811 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.260783    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-config\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260933 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.260820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-service-ca\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260933 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.260789    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-trusted-ca-bundle\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.260933 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.260880    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-oauth-serving-cert\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.262330 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.262301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-serving-cert\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.262456 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.262438    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-oauth-config\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.270395 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.270374    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8vz\" (UniqueName: \"kubernetes.io/projected/f30b3970-4c1f-4a9e-a253-e2a09713bbac-kube-api-access-bz8vz\") pod \"console-5bc587f554-pkx7k\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") " pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.396013 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.395904    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:28.528438 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:28.528302    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc587f554-pkx7k"]
Jul 24 14:28:28.531061 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:28:28.531019    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30b3970_4c1f_4a9e_a253_e2a09713bbac.slice/crio-509c77422ce45ebebf54335af532875ed1be20d2b3fba37ba4a80729f0799c9d WatchSource:0}: Error finding container 509c77422ce45ebebf54335af532875ed1be20d2b3fba37ba4a80729f0799c9d: Status 404 returned error can't find the container with id 509c77422ce45ebebf54335af532875ed1be20d2b3fba37ba4a80729f0799c9d
Jul 24 14:28:29.095206 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:29.095165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc587f554-pkx7k" event={"ID":"f30b3970-4c1f-4a9e-a253-e2a09713bbac","Type":"ContainerStarted","Data":"71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def"}
Jul 24 14:28:29.095572 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:29.095230    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc587f554-pkx7k" event={"ID":"f30b3970-4c1f-4a9e-a253-e2a09713bbac","Type":"ContainerStarted","Data":"509c77422ce45ebebf54335af532875ed1be20d2b3fba37ba4a80729f0799c9d"}
Jul 24 14:28:29.124660 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:29.124606    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bc587f554-pkx7k" podStartSLOduration=1.124589363 podStartE2EDuration="1.124589363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:28:29.124426017 +0000 UTC m=+375.566176536" watchObservedRunningTime="2026-07-24 14:28:29.124589363 +0000 UTC m=+375.566339881"
Jul 24 14:28:38.396176 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:38.396124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:38.396776 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:38.396211    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:38.400869 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:38.400841    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:39.135334 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:39.135302    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:28:39.230009 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:28:39.229979    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb88fb84b-h5bvb"]
Jul 24 14:29:04.247961 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.247920    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fb88fb84b-h5bvb" podUID="9001d29f-e672-48dd-832e-e647a678bbd1" containerName="console" containerID="cri-o://83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00" gracePeriod=15
Jul 24 14:29:04.495669 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.495647    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:29:04.529116 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529043    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-oauth-serving-cert\") pod \"9001d29f-e672-48dd-832e-e647a678bbd1\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") "
Jul 24 14:29:04.529264 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529158    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-trusted-ca-bundle\") pod \"9001d29f-e672-48dd-832e-e647a678bbd1\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") "
Jul 24 14:29:04.529264 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529185    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-service-ca\") pod \"9001d29f-e672-48dd-832e-e647a678bbd1\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") "
Jul 24 14:29:04.529264 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529212    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl6v7\" (UniqueName: \"kubernetes.io/projected/9001d29f-e672-48dd-832e-e647a678bbd1-kube-api-access-hl6v7\") pod \"9001d29f-e672-48dd-832e-e647a678bbd1\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") "
Jul 24 14:29:04.529264 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529246    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-oauth-config\") pod \"9001d29f-e672-48dd-832e-e647a678bbd1\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") "
Jul 24 14:29:04.529466 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529292    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-console-config\") pod \"9001d29f-e672-48dd-832e-e647a678bbd1\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") "
Jul 24 14:29:04.529466 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529318    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-serving-cert\") pod \"9001d29f-e672-48dd-832e-e647a678bbd1\" (UID: \"9001d29f-e672-48dd-832e-e647a678bbd1\") "
Jul 24 14:29:04.529466 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529352    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9001d29f-e672-48dd-832e-e647a678bbd1" (UID: "9001d29f-e672-48dd-832e-e647a678bbd1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:29:04.529625 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529524    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-oauth-serving-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:04.529683 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529659    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9001d29f-e672-48dd-832e-e647a678bbd1" (UID: "9001d29f-e672-48dd-832e-e647a678bbd1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:29:04.529731 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529709    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-service-ca" (OuterVolumeSpecName: "service-ca") pod "9001d29f-e672-48dd-832e-e647a678bbd1" (UID: "9001d29f-e672-48dd-832e-e647a678bbd1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:29:04.529826 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.529794    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-console-config" (OuterVolumeSpecName: "console-config") pod "9001d29f-e672-48dd-832e-e647a678bbd1" (UID: "9001d29f-e672-48dd-832e-e647a678bbd1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:29:04.531526 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.531489    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9001d29f-e672-48dd-832e-e647a678bbd1" (UID: "9001d29f-e672-48dd-832e-e647a678bbd1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:29:04.531626 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.531564    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9001d29f-e672-48dd-832e-e647a678bbd1" (UID: "9001d29f-e672-48dd-832e-e647a678bbd1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:29:04.531626 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.531583    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9001d29f-e672-48dd-832e-e647a678bbd1-kube-api-access-hl6v7" (OuterVolumeSpecName: "kube-api-access-hl6v7") pod "9001d29f-e672-48dd-832e-e647a678bbd1" (UID: "9001d29f-e672-48dd-832e-e647a678bbd1"). InnerVolumeSpecName "kube-api-access-hl6v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:29:04.630764 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.630727    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-console-config\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:04.630764 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.630756    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-serving-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:04.630764 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.630767    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-trusted-ca-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:04.630989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.630775    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9001d29f-e672-48dd-832e-e647a678bbd1-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:04.630989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.630784    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl6v7\" (UniqueName: \"kubernetes.io/projected/9001d29f-e672-48dd-832e-e647a678bbd1-kube-api-access-hl6v7\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:04.630989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:04.630791    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9001d29f-e672-48dd-832e-e647a678bbd1-console-oauth-config\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:05.221185 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.221150    2574 generic.go:356] "Generic (PLEG): container finished" podID="9001d29f-e672-48dd-832e-e647a678bbd1" containerID="83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00" exitCode=0
Jul 24 14:29:05.221361 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.221198    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb88fb84b-h5bvb"
Jul 24 14:29:05.221361 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.221240    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb88fb84b-h5bvb" event={"ID":"9001d29f-e672-48dd-832e-e647a678bbd1","Type":"ContainerDied","Data":"83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00"}
Jul 24 14:29:05.221361 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.221294    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb88fb84b-h5bvb" event={"ID":"9001d29f-e672-48dd-832e-e647a678bbd1","Type":"ContainerDied","Data":"618fec8e5d7b32e83605cb4b5f41cb17eb00088ae444320e7c721c41ef49a4c2"}
Jul 24 14:29:05.221361 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.221318    2574 scope.go:117] "RemoveContainer" containerID="83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00"
Jul 24 14:29:05.229361 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.229342    2574 scope.go:117] "RemoveContainer" containerID="83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00"
Jul 24 14:29:05.229615 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:29:05.229596    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00\": container with ID starting with 83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00 not found: ID does not exist" containerID="83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00"
Jul 24 14:29:05.229665 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.229623    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00"} err="failed to get container status \"83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00\": rpc error: code = NotFound desc = could not find container \"83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00\": container with ID starting with 83fc0d41a61b0ca6aacdab2d9ca35adc7b602202cedf9df354d340a284856a00 not found: ID does not exist"
Jul 24 14:29:05.244216 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.244189    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb88fb84b-h5bvb"]
Jul 24 14:29:05.245838 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:05.245818    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb88fb84b-h5bvb"]
Jul 24 14:29:06.017354 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:06.017323    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9001d29f-e672-48dd-832e-e647a678bbd1" path="/var/lib/kubelet/pods/9001d29f-e672-48dd-832e-e647a678bbd1/volumes"
Jul 24 14:29:22.234125 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.234090    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"]
Jul 24 14:29:22.234568 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.234321    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9001d29f-e672-48dd-832e-e647a678bbd1" containerName="console"
Jul 24 14:29:22.234568 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.234331    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9001d29f-e672-48dd-832e-e647a678bbd1" containerName="console"
Jul 24 14:29:22.234568 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.234383    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9001d29f-e672-48dd-832e-e647a678bbd1" containerName="console"
Jul 24 14:29:22.236640 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.236625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.239302 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.239281    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7cdg4\""
Jul 24 14:29:22.240304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.240285    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 14:29:22.240397 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.240338    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 14:29:22.247128 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.247106    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"]
Jul 24 14:29:22.356214 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.356180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.356371 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.356238    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.356371 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.356304    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpjg\" (UniqueName: \"kubernetes.io/projected/328a6f43-b14e-4997-bcda-b8ec9523657b-kube-api-access-jrpjg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.457213 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.457173    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.457415 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.457229    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpjg\" (UniqueName: \"kubernetes.io/projected/328a6f43-b14e-4997-bcda-b8ec9523657b-kube-api-access-jrpjg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.457415 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.457266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.457657 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.457634    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.457657 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.457647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.467232 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.467201    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpjg\" (UniqueName: \"kubernetes.io/projected/328a6f43-b14e-4997-bcda-b8ec9523657b-kube-api-access-jrpjg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.544987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.544909    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:22.674784 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.674744    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"]
Jul 24 14:29:22.677532 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:29:22.677502    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328a6f43_b14e_4997_bcda_b8ec9523657b.slice/crio-cf44a330b7293569356805a0317cbc74bcc80b78fe9217a25979dadb880e39fc WatchSource:0}: Error finding container cf44a330b7293569356805a0317cbc74bcc80b78fe9217a25979dadb880e39fc: Status 404 returned error can't find the container with id cf44a330b7293569356805a0317cbc74bcc80b78fe9217a25979dadb880e39fc
Jul 24 14:29:22.679479 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:22.679461    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:29:23.282427 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:23.282391    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk" event={"ID":"328a6f43-b14e-4997-bcda-b8ec9523657b","Type":"ContainerStarted","Data":"cf44a330b7293569356805a0317cbc74bcc80b78fe9217a25979dadb880e39fc"}
Jul 24 14:29:28.309398 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:28.309351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk" event={"ID":"328a6f43-b14e-4997-bcda-b8ec9523657b","Type":"ContainerStarted","Data":"b476ff16afc9cc77e22380f4176aeb6fc43f73c26c7fd6d3e02333368b4744da"}
Jul 24 14:29:29.314152 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:29.314119    2574 generic.go:356] "Generic (PLEG): container finished" podID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerID="b476ff16afc9cc77e22380f4176aeb6fc43f73c26c7fd6d3e02333368b4744da" exitCode=0
Jul 24 14:29:29.314551 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:29.314166    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk" event={"ID":"328a6f43-b14e-4997-bcda-b8ec9523657b","Type":"ContainerDied","Data":"b476ff16afc9cc77e22380f4176aeb6fc43f73c26c7fd6d3e02333368b4744da"}
Jul 24 14:29:32.327397 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:32.327354    2574 generic.go:356] "Generic (PLEG): container finished" podID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerID="64be2751f9995bc67bfbb119b2d5f2323b452e7784ad8f7d9f7ae0380ebfbe09" exitCode=0
Jul 24 14:29:32.327825 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:32.327405    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk" event={"ID":"328a6f43-b14e-4997-bcda-b8ec9523657b","Type":"ContainerDied","Data":"64be2751f9995bc67bfbb119b2d5f2323b452e7784ad8f7d9f7ae0380ebfbe09"}
Jul 24 14:29:39.358201 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:39.358168    2574 generic.go:356] "Generic (PLEG): container finished" podID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerID="ca3dc2bb56b3b04ea0e4b04768aa0fb752945e514bfa9f89690a7c47909a8bcf" exitCode=0
Jul 24 14:29:39.358597 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:39.358217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk" event={"ID":"328a6f43-b14e-4997-bcda-b8ec9523657b","Type":"ContainerDied","Data":"ca3dc2bb56b3b04ea0e4b04768aa0fb752945e514bfa9f89690a7c47909a8bcf"}
Jul 24 14:29:40.479942 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.479913    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:40.611582 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.611541    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-bundle\") pod \"328a6f43-b14e-4997-bcda-b8ec9523657b\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") "
Jul 24 14:29:40.611758 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.611619    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrpjg\" (UniqueName: \"kubernetes.io/projected/328a6f43-b14e-4997-bcda-b8ec9523657b-kube-api-access-jrpjg\") pod \"328a6f43-b14e-4997-bcda-b8ec9523657b\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") "
Jul 24 14:29:40.611758 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.611642    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-util\") pod \"328a6f43-b14e-4997-bcda-b8ec9523657b\" (UID: \"328a6f43-b14e-4997-bcda-b8ec9523657b\") "
Jul 24 14:29:40.612230 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.612201    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-bundle" (OuterVolumeSpecName: "bundle") pod "328a6f43-b14e-4997-bcda-b8ec9523657b" (UID: "328a6f43-b14e-4997-bcda-b8ec9523657b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:40.613889 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.613832    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/328a6f43-b14e-4997-bcda-b8ec9523657b-kube-api-access-jrpjg" (OuterVolumeSpecName: "kube-api-access-jrpjg") pod "328a6f43-b14e-4997-bcda-b8ec9523657b" (UID: "328a6f43-b14e-4997-bcda-b8ec9523657b"). InnerVolumeSpecName "kube-api-access-jrpjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:29:40.615767 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.615748    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-util" (OuterVolumeSpecName: "util") pod "328a6f43-b14e-4997-bcda-b8ec9523657b" (UID: "328a6f43-b14e-4997-bcda-b8ec9523657b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:40.712008 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.711970    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrpjg\" (UniqueName: \"kubernetes.io/projected/328a6f43-b14e-4997-bcda-b8ec9523657b-kube-api-access-jrpjg\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:40.712008 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.712000    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-util\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:40.712008 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:40.712010    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/328a6f43-b14e-4997-bcda-b8ec9523657b-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:41.368123 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:41.368087    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk" event={"ID":"328a6f43-b14e-4997-bcda-b8ec9523657b","Type":"ContainerDied","Data":"cf44a330b7293569356805a0317cbc74bcc80b78fe9217a25979dadb880e39fc"}
Jul 24 14:29:41.368123 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:41.368133    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf44a330b7293569356805a0317cbc74bcc80b78fe9217a25979dadb880e39fc"
Jul 24 14:29:41.368386 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:41.368133    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408tkpk"
Jul 24 14:29:45.268083 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.268044    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"]
Jul 24 14:29:45.268533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.268285    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerName="util"
Jul 24 14:29:45.268533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.268295    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerName="util"
Jul 24 14:29:45.268533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.268311    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerName="pull"
Jul 24 14:29:45.268533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.268316    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerName="pull"
Jul 24 14:29:45.268533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.268322    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerName="extract"
Jul 24 14:29:45.268533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.268328    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerName="extract"
Jul 24 14:29:45.268533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.268369    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="328a6f43-b14e-4997-bcda-b8ec9523657b" containerName="extract"
Jul 24 14:29:45.271435 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.271419    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"
Jul 24 14:29:45.273874 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.273853    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:29:45.274001 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.273860    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 14:29:45.274001 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.273883    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-twpjf\""
Jul 24 14:29:45.284133 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.284112    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"]
Jul 24 14:29:45.446217 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.446182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9c379e6-a5a2-4957-9a2b-a9e6c29f88be-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kvxm7\" (UID: \"a9c379e6-a5a2-4957-9a2b-a9e6c29f88be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"
Jul 24 14:29:45.446401 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.446255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c58w\" (UniqueName: \"kubernetes.io/projected/a9c379e6-a5a2-4957-9a2b-a9e6c29f88be-kube-api-access-8c58w\") pod \"cert-manager-operator-controller-manager-55c444bf86-kvxm7\" (UID: \"a9c379e6-a5a2-4957-9a2b-a9e6c29f88be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"
Jul 24 14:29:45.547453 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.547365    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c58w\" (UniqueName: \"kubernetes.io/projected/a9c379e6-a5a2-4957-9a2b-a9e6c29f88be-kube-api-access-8c58w\") pod \"cert-manager-operator-controller-manager-55c444bf86-kvxm7\" (UID: \"a9c379e6-a5a2-4957-9a2b-a9e6c29f88be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"
Jul 24 14:29:45.547453 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.547443    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9c379e6-a5a2-4957-9a2b-a9e6c29f88be-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kvxm7\" (UID: \"a9c379e6-a5a2-4957-9a2b-a9e6c29f88be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"
Jul 24 14:29:45.547858 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.547839    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9c379e6-a5a2-4957-9a2b-a9e6c29f88be-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kvxm7\" (UID: \"a9c379e6-a5a2-4957-9a2b-a9e6c29f88be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"
Jul 24 14:29:45.560491 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.560472    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c58w\" (UniqueName: \"kubernetes.io/projected/a9c379e6-a5a2-4957-9a2b-a9e6c29f88be-kube-api-access-8c58w\") pod \"cert-manager-operator-controller-manager-55c444bf86-kvxm7\" (UID: \"a9c379e6-a5a2-4957-9a2b-a9e6c29f88be\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"
Jul 24 14:29:45.580434 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.580412    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"
Jul 24 14:29:45.713863 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:45.713829    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7"]
Jul 24 14:29:45.717542 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:29:45.717516    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c379e6_a5a2_4957_9a2b_a9e6c29f88be.slice/crio-cd0b13899ead3c48441b3b58a0fc51df960d96ac197c6037cb3f6daa06b1a8a3 WatchSource:0}: Error finding container cd0b13899ead3c48441b3b58a0fc51df960d96ac197c6037cb3f6daa06b1a8a3: Status 404 returned error can't find the container with id cd0b13899ead3c48441b3b58a0fc51df960d96ac197c6037cb3f6daa06b1a8a3
Jul 24 14:29:46.387505 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:46.387472    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7" event={"ID":"a9c379e6-a5a2-4957-9a2b-a9e6c29f88be","Type":"ContainerStarted","Data":"cd0b13899ead3c48441b3b58a0fc51df960d96ac197c6037cb3f6daa06b1a8a3"}
Jul 24 14:29:48.360732 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.360694    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dgtl"]
Jul 24 14:29:48.363070 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.363054    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:48.366016 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.365997    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 14:29:48.366913 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.366895    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gv288\""
Jul 24 14:29:48.367008 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.366928    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 14:29:48.377849 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.377829    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dgtl"]
Jul 24 14:29:48.397175 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.397142    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7" event={"ID":"a9c379e6-a5a2-4957-9a2b-a9e6c29f88be","Type":"ContainerStarted","Data":"48c676d2f5eec4bba59834ad7d380d0def58df68d7983dc7676f2f94bd32490e"}
Jul 24 14:29:48.422153 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.422104    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kvxm7" podStartSLOduration=1.724310847 podStartE2EDuration="3.422084423s" totalImagesPullingTime="1.697773576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:48.421457883 +0000 UTC m=+454.863208403" watchObservedRunningTime="2026-07-24 14:29:48.422084423 +0000 UTC m=+454.863834943"
Jul 24 14:29:48.469986 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.469945    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf6f52d3-3a3b-4115-ac61-69e82677e193-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dgtl\" (UID: \"bf6f52d3-3a3b-4115-ac61-69e82677e193\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:48.470154 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.470010    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jh9x\" (UniqueName: \"kubernetes.io/projected/bf6f52d3-3a3b-4115-ac61-69e82677e193-kube-api-access-6jh9x\") pod \"cert-manager-webhook-6486ffd997-5dgtl\" (UID: \"bf6f52d3-3a3b-4115-ac61-69e82677e193\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:48.571458 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.571407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf6f52d3-3a3b-4115-ac61-69e82677e193-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dgtl\" (UID: \"bf6f52d3-3a3b-4115-ac61-69e82677e193\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:48.571653 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.571490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh9x\" (UniqueName: \"kubernetes.io/projected/bf6f52d3-3a3b-4115-ac61-69e82677e193-kube-api-access-6jh9x\") pod \"cert-manager-webhook-6486ffd997-5dgtl\" (UID: \"bf6f52d3-3a3b-4115-ac61-69e82677e193\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:48.586225 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.586193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf6f52d3-3a3b-4115-ac61-69e82677e193-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dgtl\" (UID: \"bf6f52d3-3a3b-4115-ac61-69e82677e193\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:48.586355 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.586317    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jh9x\" (UniqueName: \"kubernetes.io/projected/bf6f52d3-3a3b-4115-ac61-69e82677e193-kube-api-access-6jh9x\") pod \"cert-manager-webhook-6486ffd997-5dgtl\" (UID: \"bf6f52d3-3a3b-4115-ac61-69e82677e193\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:48.682421 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.682390    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:48.832366 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:48.832343    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dgtl"]
Jul 24 14:29:48.834301 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:29:48.834274    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf6f52d3_3a3b_4115_ac61_69e82677e193.slice/crio-534ed65dc36a5a6d14dda049111968d74ce303eb14f754d7d2944e043a4e94e8 WatchSource:0}: Error finding container 534ed65dc36a5a6d14dda049111968d74ce303eb14f754d7d2944e043a4e94e8: Status 404 returned error can't find the container with id 534ed65dc36a5a6d14dda049111968d74ce303eb14f754d7d2944e043a4e94e8
Jul 24 14:29:49.403197 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.403157    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl" event={"ID":"bf6f52d3-3a3b-4115-ac61-69e82677e193","Type":"ContainerStarted","Data":"534ed65dc36a5a6d14dda049111968d74ce303eb14f754d7d2944e043a4e94e8"}
Jul 24 14:29:49.721850 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.721812    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"]
Jul 24 14:29:49.724224 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.724202    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.727420 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:29:49.727390    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" is forbidden: User \"system:node:ip-10-0-134-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-134-104.ec2.internal' and this object" podUID="006a2657-a8be-456f-94d4-7410314342b3" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.727551 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.727501    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 14:29:49.727687 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.727633    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7cdg4\""
Jul 24 14:29:49.728524 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.728505    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 14:29:49.746615 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.746561    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"]
Jul 24 14:29:49.882293 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.882258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.882482 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.882322    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.882482 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.882343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tn28\" (UniqueName: \"kubernetes.io/projected/006a2657-a8be-456f-94d4-7410314342b3-kube-api-access-6tn28\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.983613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.983518    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.983613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.983586    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.983613 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.983606    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tn28\" (UniqueName: \"kubernetes.io/projected/006a2657-a8be-456f-94d4-7410314342b3-kube-api-access-6tn28\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.984067 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.984016    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:49.984152 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:49.984083    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:50.006246 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:50.006210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tn28\" (UniqueName: \"kubernetes.io/projected/006a2657-a8be-456f-94d4-7410314342b3-kube-api-access-6tn28\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:50.035614 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:50.035581    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:50.197290 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:50.197254    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"]
Jul 24 14:29:50.200371 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:29:50.200332    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006a2657_a8be_456f_94d4_7410314342b3.slice/crio-495e41be1734f27e3eb68d49fc4a6d231581c5988618069f9828b5afc5f4d027 WatchSource:0}: Error finding container 495e41be1734f27e3eb68d49fc4a6d231581c5988618069f9828b5afc5f4d027: Status 404 returned error can't find the container with id 495e41be1734f27e3eb68d49fc4a6d231581c5988618069f9828b5afc5f4d027
Jul 24 14:29:50.409581 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:50.409545    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666" event={"ID":"006a2657-a8be-456f-94d4-7410314342b3","Type":"ContainerStarted","Data":"394a129da6b23b3c605aa1ce0c444140e01931983ef6c881ff854cda129ae761"}
Jul 24 14:29:50.409989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:50.409596    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666" event={"ID":"006a2657-a8be-456f-94d4-7410314342b3","Type":"ContainerStarted","Data":"495e41be1734f27e3eb68d49fc4a6d231581c5988618069f9828b5afc5f4d027"}
Jul 24 14:29:51.414874 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.414774    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl" event={"ID":"bf6f52d3-3a3b-4115-ac61-69e82677e193","Type":"ContainerStarted","Data":"f150c7e855e4f103d9f6b5b8e9ece7a34f07e59bbf4448a56eb211222e06ff6d"}
Jul 24 14:29:51.414874 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.414819    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:51.416312 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.416291    2574 generic.go:356] "Generic (PLEG): container finished" podID="006a2657-a8be-456f-94d4-7410314342b3" containerID="394a129da6b23b3c605aa1ce0c444140e01931983ef6c881ff854cda129ae761" exitCode=0
Jul 24 14:29:51.416389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.416325    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666" event={"ID":"006a2657-a8be-456f-94d4-7410314342b3","Type":"ContainerDied","Data":"394a129da6b23b3c605aa1ce0c444140e01931983ef6c881ff854cda129ae761"}
Jul 24 14:29:51.433828 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.433775    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl" podStartSLOduration=1.119188943 podStartE2EDuration="3.433758565s" totalImagesPullingTime="2.314569622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:51.432869725 +0000 UTC m=+457.874620244" watchObservedRunningTime="2026-07-24 14:29:51.433758565 +0000 UTC m=+457.875509081"
Jul 24 14:29:51.855039 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.855005    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"]
Jul 24 14:29:51.856875 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.856859    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"
Jul 24 14:29:51.859336 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.859313    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tr44s\""
Jul 24 14:29:51.865882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:51.865860    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"]
Jul 24 14:29:52.001735 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.001703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acc81e2f-0752-45d5-ae4f-a1099d37e092-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rd6ml\" (UID: \"acc81e2f-0752-45d5-ae4f-a1099d37e092\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"
Jul 24 14:29:52.001914 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.001747    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzcmc\" (UniqueName: \"kubernetes.io/projected/acc81e2f-0752-45d5-ae4f-a1099d37e092-kube-api-access-qzcmc\") pod \"cert-manager-cainjector-559cdd8c87-rd6ml\" (UID: \"acc81e2f-0752-45d5-ae4f-a1099d37e092\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"
Jul 24 14:29:52.102510 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.102471    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acc81e2f-0752-45d5-ae4f-a1099d37e092-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rd6ml\" (UID: \"acc81e2f-0752-45d5-ae4f-a1099d37e092\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"
Jul 24 14:29:52.102510 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.102513    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzcmc\" (UniqueName: \"kubernetes.io/projected/acc81e2f-0752-45d5-ae4f-a1099d37e092-kube-api-access-qzcmc\") pod \"cert-manager-cainjector-559cdd8c87-rd6ml\" (UID: \"acc81e2f-0752-45d5-ae4f-a1099d37e092\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"
Jul 24 14:29:52.112995 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.112922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acc81e2f-0752-45d5-ae4f-a1099d37e092-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rd6ml\" (UID: \"acc81e2f-0752-45d5-ae4f-a1099d37e092\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"
Jul 24 14:29:52.112995 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.112960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzcmc\" (UniqueName: \"kubernetes.io/projected/acc81e2f-0752-45d5-ae4f-a1099d37e092-kube-api-access-qzcmc\") pod \"cert-manager-cainjector-559cdd8c87-rd6ml\" (UID: \"acc81e2f-0752-45d5-ae4f-a1099d37e092\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"
Jul 24 14:29:52.165840 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.165801    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"
Jul 24 14:29:52.315280 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.315243    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml"]
Jul 24 14:29:52.423422 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.423370    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml" event={"ID":"acc81e2f-0752-45d5-ae4f-a1099d37e092","Type":"ContainerStarted","Data":"d0fb701314db1d596103c5670dc85b7e92c9ba2e604d9110daf8fcd488d90009"}
Jul 24 14:29:52.423872 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.423435    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml" event={"ID":"acc81e2f-0752-45d5-ae4f-a1099d37e092","Type":"ContainerStarted","Data":"19813caa2d27ce36a540ac682873631fc2e6a604108c39181e3b843ea66aa9e5"}
Jul 24 14:29:52.443075 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:52.442997    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rd6ml" podStartSLOduration=1.442980965 podStartE2EDuration="1.442980965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:52.442182568 +0000 UTC m=+458.883933088" watchObservedRunningTime="2026-07-24 14:29:52.442980965 +0000 UTC m=+458.884731484"
Jul 24 14:29:53.430385 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:53.430342    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666" event={"ID":"006a2657-a8be-456f-94d4-7410314342b3","Type":"ContainerStarted","Data":"3b0a1f8cc98e43f66ba687a8f84ec2332ececd5a01eef6fc444b771ccab3d731"}
Jul 24 14:29:54.435716 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:54.435677    2574 generic.go:356] "Generic (PLEG): container finished" podID="006a2657-a8be-456f-94d4-7410314342b3" containerID="3b0a1f8cc98e43f66ba687a8f84ec2332ececd5a01eef6fc444b771ccab3d731" exitCode=0
Jul 24 14:29:54.436126 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:54.435747    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666" event={"ID":"006a2657-a8be-456f-94d4-7410314342b3","Type":"ContainerDied","Data":"3b0a1f8cc98e43f66ba687a8f84ec2332ececd5a01eef6fc444b771ccab3d731"}
Jul 24 14:29:55.442158 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:55.442123    2574 generic.go:356] "Generic (PLEG): container finished" podID="006a2657-a8be-456f-94d4-7410314342b3" containerID="b33a205cf4ce1a7c1906d14d6e62f642c549a32079ef0d8cffe6aaf645c90d37" exitCode=0
Jul 24 14:29:55.442552 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:55.442193    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666" event={"ID":"006a2657-a8be-456f-94d4-7410314342b3","Type":"ContainerDied","Data":"b33a205cf4ce1a7c1906d14d6e62f642c549a32079ef0d8cffe6aaf645c90d37"}
Jul 24 14:29:56.575650 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.575625    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:56.641406 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.641369    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-util\") pod \"006a2657-a8be-456f-94d4-7410314342b3\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") "
Jul 24 14:29:56.641575 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.641419    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tn28\" (UniqueName: \"kubernetes.io/projected/006a2657-a8be-456f-94d4-7410314342b3-kube-api-access-6tn28\") pod \"006a2657-a8be-456f-94d4-7410314342b3\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") "
Jul 24 14:29:56.641575 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.641494    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-bundle\") pod \"006a2657-a8be-456f-94d4-7410314342b3\" (UID: \"006a2657-a8be-456f-94d4-7410314342b3\") "
Jul 24 14:29:56.641906 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.641874    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-bundle" (OuterVolumeSpecName: "bundle") pod "006a2657-a8be-456f-94d4-7410314342b3" (UID: "006a2657-a8be-456f-94d4-7410314342b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:56.643619 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.643587    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006a2657-a8be-456f-94d4-7410314342b3-kube-api-access-6tn28" (OuterVolumeSpecName: "kube-api-access-6tn28") pod "006a2657-a8be-456f-94d4-7410314342b3" (UID: "006a2657-a8be-456f-94d4-7410314342b3"). InnerVolumeSpecName "kube-api-access-6tn28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:29:56.646043 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.646000    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-util" (OuterVolumeSpecName: "util") pod "006a2657-a8be-456f-94d4-7410314342b3" (UID: "006a2657-a8be-456f-94d4-7410314342b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:56.742944 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.742846    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:56.742944 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.742880    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/006a2657-a8be-456f-94d4-7410314342b3-util\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:56.742944 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:56.742894    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tn28\" (UniqueName: \"kubernetes.io/projected/006a2657-a8be-456f-94d4-7410314342b3-kube-api-access-6tn28\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:29:57.425574 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:57.425546    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5dgtl"
Jul 24 14:29:57.452583 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:57.452541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666" event={"ID":"006a2657-a8be-456f-94d4-7410314342b3","Type":"ContainerDied","Data":"495e41be1734f27e3eb68d49fc4a6d231581c5988618069f9828b5afc5f4d027"}
Jul 24 14:29:57.452739 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:57.452591    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="495e41be1734f27e3eb68d49fc4a6d231581c5988618069f9828b5afc5f4d027"
Jul 24 14:29:57.452739 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:57.452551    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzl666"
Jul 24 14:29:58.995997 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.995961    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4ftr4"]
Jul 24 14:29:58.996376 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.996226    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006a2657-a8be-456f-94d4-7410314342b3" containerName="util"
Jul 24 14:29:58.996376 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.996238    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="006a2657-a8be-456f-94d4-7410314342b3" containerName="util"
Jul 24 14:29:58.996376 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.996247    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006a2657-a8be-456f-94d4-7410314342b3" containerName="pull"
Jul 24 14:29:58.996376 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.996252    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="006a2657-a8be-456f-94d4-7410314342b3" containerName="pull"
Jul 24 14:29:58.996376 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.996265    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006a2657-a8be-456f-94d4-7410314342b3" containerName="extract"
Jul 24 14:29:58.996376 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.996273    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="006a2657-a8be-456f-94d4-7410314342b3" containerName="extract"
Jul 24 14:29:58.996376 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.996314    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="006a2657-a8be-456f-94d4-7410314342b3" containerName="extract"
Jul 24 14:29:58.999925 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:58.999909    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4ftr4"
Jul 24 14:29:59.003445 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.003423    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-z9k2d\""
Jul 24 14:29:59.009445 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.009422    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4ftr4"]
Jul 24 14:29:59.058681 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.058652    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84ctl\" (UniqueName: \"kubernetes.io/projected/bd4807b6-4564-449c-b4b1-50a71830107b-kube-api-access-84ctl\") pod \"cert-manager-55b4d954d5-4ftr4\" (UID: \"bd4807b6-4564-449c-b4b1-50a71830107b\") " pod="cert-manager/cert-manager-55b4d954d5-4ftr4"
Jul 24 14:29:59.058841 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.058709    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd4807b6-4564-449c-b4b1-50a71830107b-bound-sa-token\") pod \"cert-manager-55b4d954d5-4ftr4\" (UID: \"bd4807b6-4564-449c-b4b1-50a71830107b\") " pod="cert-manager/cert-manager-55b4d954d5-4ftr4"
Jul 24 14:29:59.159985 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.159942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd4807b6-4564-449c-b4b1-50a71830107b-bound-sa-token\") pod \"cert-manager-55b4d954d5-4ftr4\" (UID: \"bd4807b6-4564-449c-b4b1-50a71830107b\") " pod="cert-manager/cert-manager-55b4d954d5-4ftr4"
Jul 24 14:29:59.160189 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.160009    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84ctl\" (UniqueName: \"kubernetes.io/projected/bd4807b6-4564-449c-b4b1-50a71830107b-kube-api-access-84ctl\") pod \"cert-manager-55b4d954d5-4ftr4\" (UID: \"bd4807b6-4564-449c-b4b1-50a71830107b\") " pod="cert-manager/cert-manager-55b4d954d5-4ftr4"
Jul 24 14:29:59.174340 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.174299    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd4807b6-4564-449c-b4b1-50a71830107b-bound-sa-token\") pod \"cert-manager-55b4d954d5-4ftr4\" (UID: \"bd4807b6-4564-449c-b4b1-50a71830107b\") " pod="cert-manager/cert-manager-55b4d954d5-4ftr4"
Jul 24 14:29:59.174479 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.174460    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84ctl\" (UniqueName: \"kubernetes.io/projected/bd4807b6-4564-449c-b4b1-50a71830107b-kube-api-access-84ctl\") pod \"cert-manager-55b4d954d5-4ftr4\" (UID: \"bd4807b6-4564-449c-b4b1-50a71830107b\") " pod="cert-manager/cert-manager-55b4d954d5-4ftr4"
Jul 24 14:29:59.308860 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.308770    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4ftr4"
Jul 24 14:29:59.449712 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.449688    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4ftr4"]
Jul 24 14:29:59.451409 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:29:59.451380    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd4807b6_4564_449c_b4b1_50a71830107b.slice/crio-1d7c212ad9e51d40a1536fd908faf6032f2c4d236578c92f8f7894f772f05ad2 WatchSource:0}: Error finding container 1d7c212ad9e51d40a1536fd908faf6032f2c4d236578c92f8f7894f772f05ad2: Status 404 returned error can't find the container with id 1d7c212ad9e51d40a1536fd908faf6032f2c4d236578c92f8f7894f772f05ad2
Jul 24 14:29:59.461871 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:29:59.461848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4ftr4" event={"ID":"bd4807b6-4564-449c-b4b1-50a71830107b","Type":"ContainerStarted","Data":"1d7c212ad9e51d40a1536fd908faf6032f2c4d236578c92f8f7894f772f05ad2"}
Jul 24 14:30:00.467315 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:00.467278    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4ftr4" event={"ID":"bd4807b6-4564-449c-b4b1-50a71830107b","Type":"ContainerStarted","Data":"d7523f9c1b424938f9b1e0ec83376291ba2cb371ae1b59d66e3c38e3ac48654c"}
Jul 24 14:30:00.488540 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:00.488485    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4ftr4" podStartSLOduration=2.488467458 podStartE2EDuration="2.488467458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:30:00.487540929 +0000 UTC m=+466.929291451" watchObservedRunningTime="2026-07-24 14:30:00.488467458 +0000 UTC m=+466.930217977"
Jul 24 14:30:11.434207 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.434172    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"]
Jul 24 14:30:11.471094 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.471059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"]
Jul 24 14:30:11.471252 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.471171    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.473709 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.473681    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 14:30:11.474637 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.474619    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7cdg4\""
Jul 24 14:30:11.474756 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.474617    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 14:30:11.553073 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.553020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.553244 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.553112    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-744gs\" (UniqueName: \"kubernetes.io/projected/3a3c5c0a-775b-443a-bdec-ba96e841308a-kube-api-access-744gs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.553244 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.553143    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.654139 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.654104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.654311 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.654161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-744gs\" (UniqueName: \"kubernetes.io/projected/3a3c5c0a-775b-443a-bdec-ba96e841308a-kube-api-access-744gs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.654311 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.654188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.654489 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.654470    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.654531 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.654500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.664402 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.664381    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-744gs\" (UniqueName: \"kubernetes.io/projected/3a3c5c0a-775b-443a-bdec-ba96e841308a-kube-api-access-744gs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.780286 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.780197    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:11.909256 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:11.909194    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"]
Jul 24 14:30:11.911757 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:30:11.911729    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3c5c0a_775b_443a_bdec_ba96e841308a.slice/crio-1f0f3af078f6f6d24ea43152645b453e7e2cb7af820957506bf5316ab640ae72 WatchSource:0}: Error finding container 1f0f3af078f6f6d24ea43152645b453e7e2cb7af820957506bf5316ab640ae72: Status 404 returned error can't find the container with id 1f0f3af078f6f6d24ea43152645b453e7e2cb7af820957506bf5316ab640ae72
Jul 24 14:30:12.517930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:12.517902    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerID="9bec663c9ddf263a6fb494bb765fb198c0e2d0900232d16c0b70930f193497bc" exitCode=0
Jul 24 14:30:12.518347 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:12.517960    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr" event={"ID":"3a3c5c0a-775b-443a-bdec-ba96e841308a","Type":"ContainerDied","Data":"9bec663c9ddf263a6fb494bb765fb198c0e2d0900232d16c0b70930f193497bc"}
Jul 24 14:30:12.518347 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:12.517998    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr" event={"ID":"3a3c5c0a-775b-443a-bdec-ba96e841308a","Type":"ContainerStarted","Data":"1f0f3af078f6f6d24ea43152645b453e7e2cb7af820957506bf5316ab640ae72"}
Jul 24 14:30:13.523657 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:13.523621    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerID="f4006dfd21b2901ed6a7523103ab496a4def21f0335397453f3725d3bfc15f0d" exitCode=0
Jul 24 14:30:13.524092 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:13.523709    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr" event={"ID":"3a3c5c0a-775b-443a-bdec-ba96e841308a","Type":"ContainerDied","Data":"f4006dfd21b2901ed6a7523103ab496a4def21f0335397453f3725d3bfc15f0d"}
Jul 24 14:30:14.529871 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:14.529830    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerID="b598f1cf625aaf8228d9b9e590c45d6ce3d792456cf64cc7027a3e44b60ee683" exitCode=0
Jul 24 14:30:14.530266 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:14.529913    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr" event={"ID":"3a3c5c0a-775b-443a-bdec-ba96e841308a","Type":"ContainerDied","Data":"b598f1cf625aaf8228d9b9e590c45d6ce3d792456cf64cc7027a3e44b60ee683"}
Jul 24 14:30:15.663287 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.663263    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:15.785755 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.785669    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-744gs\" (UniqueName: \"kubernetes.io/projected/3a3c5c0a-775b-443a-bdec-ba96e841308a-kube-api-access-744gs\") pod \"3a3c5c0a-775b-443a-bdec-ba96e841308a\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") "
Jul 24 14:30:15.785755 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.785736    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-util\") pod \"3a3c5c0a-775b-443a-bdec-ba96e841308a\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") "
Jul 24 14:30:15.785932 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.785762    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-bundle\") pod \"3a3c5c0a-775b-443a-bdec-ba96e841308a\" (UID: \"3a3c5c0a-775b-443a-bdec-ba96e841308a\") "
Jul 24 14:30:15.786592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.786559    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-bundle" (OuterVolumeSpecName: "bundle") pod "3a3c5c0a-775b-443a-bdec-ba96e841308a" (UID: "3a3c5c0a-775b-443a-bdec-ba96e841308a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:30:15.787782 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.787761    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3c5c0a-775b-443a-bdec-ba96e841308a-kube-api-access-744gs" (OuterVolumeSpecName: "kube-api-access-744gs") pod "3a3c5c0a-775b-443a-bdec-ba96e841308a" (UID: "3a3c5c0a-775b-443a-bdec-ba96e841308a"). InnerVolumeSpecName "kube-api-access-744gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:30:15.791642 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.791599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-util" (OuterVolumeSpecName: "util") pod "3a3c5c0a-775b-443a-bdec-ba96e841308a" (UID: "3a3c5c0a-775b-443a-bdec-ba96e841308a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:30:15.887092 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.887062    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-util\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:30:15.887092 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.887088    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a3c5c0a-775b-443a-bdec-ba96e841308a-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:30:15.887275 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:15.887098    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-744gs\" (UniqueName: \"kubernetes.io/projected/3a3c5c0a-775b-443a-bdec-ba96e841308a-kube-api-access-744gs\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:30:16.539915 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:16.539881    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr" event={"ID":"3a3c5c0a-775b-443a-bdec-ba96e841308a","Type":"ContainerDied","Data":"1f0f3af078f6f6d24ea43152645b453e7e2cb7af820957506bf5316ab640ae72"}
Jul 24 14:30:16.539915 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:16.539904    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzcxgr"
Jul 24 14:30:16.540138 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:16.539927    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f0f3af078f6f6d24ea43152645b453e7e2cb7af820957506bf5316ab640ae72"
Jul 24 14:30:24.071906 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.071875    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"]
Jul 24 14:30:24.072410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.072150    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerName="pull"
Jul 24 14:30:24.072410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.072160    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerName="pull"
Jul 24 14:30:24.072410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.072169    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerName="util"
Jul 24 14:30:24.072410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.072175    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerName="util"
Jul 24 14:30:24.072410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.072181    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerName="extract"
Jul 24 14:30:24.072410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.072188    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerName="extract"
Jul 24 14:30:24.072410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.072227    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3c5c0a-775b-443a-bdec-ba96e841308a" containerName="extract"
Jul 24 14:30:24.074538 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.074520    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.077540 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.077517    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 14:30:24.077855 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.077839    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 14:30:24.078631 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.078613    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6r75f\""
Jul 24 14:30:24.078631 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.078620    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 14:30:24.078800 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.078647    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 14:30:24.078800 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.078620    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:30:24.098251 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.098220    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"]
Jul 24 14:30:24.149824 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.149790    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e7f858b-9df0-49fd-b4ab-5370128a40af-metrics-cert\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.149987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.149833    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e7f858b-9df0-49fd-b4ab-5370128a40af-manager-config\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.149987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.149920    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e7f858b-9df0-49fd-b4ab-5370128a40af-cert\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.149987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.149952    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jngtr\" (UniqueName: \"kubernetes.io/projected/9e7f858b-9df0-49fd-b4ab-5370128a40af-kube-api-access-jngtr\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.250716 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.250686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e7f858b-9df0-49fd-b4ab-5370128a40af-cert\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.250716 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.250719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jngtr\" (UniqueName: \"kubernetes.io/projected/9e7f858b-9df0-49fd-b4ab-5370128a40af-kube-api-access-jngtr\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.250940 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.250760    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e7f858b-9df0-49fd-b4ab-5370128a40af-metrics-cert\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.250940 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.250780    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e7f858b-9df0-49fd-b4ab-5370128a40af-manager-config\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.251406 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.251380    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e7f858b-9df0-49fd-b4ab-5370128a40af-manager-config\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.253289 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.253263    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e7f858b-9df0-49fd-b4ab-5370128a40af-cert\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.253289 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.253287    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e7f858b-9df0-49fd-b4ab-5370128a40af-metrics-cert\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.275956 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.275929    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jngtr\" (UniqueName: \"kubernetes.io/projected/9e7f858b-9df0-49fd-b4ab-5370128a40af-kube-api-access-jngtr\") pod \"lws-controller-manager-76765b76bd-mzl77\" (UID: \"9e7f858b-9df0-49fd-b4ab-5370128a40af\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.383355 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.383272    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:24.529499 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.529470    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"]
Jul 24 14:30:24.532521 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:30:24.532497    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7f858b_9df0_49fd_b4ab_5370128a40af.slice/crio-a0d28a0618ef7397e218c91d481c3e297bdae2de4f642f3477b1083414108880 WatchSource:0}: Error finding container a0d28a0618ef7397e218c91d481c3e297bdae2de4f642f3477b1083414108880: Status 404 returned error can't find the container with id a0d28a0618ef7397e218c91d481c3e297bdae2de4f642f3477b1083414108880
Jul 24 14:30:24.573976 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:24.573940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77" event={"ID":"9e7f858b-9df0-49fd-b4ab-5370128a40af","Type":"ContainerStarted","Data":"a0d28a0618ef7397e218c91d481c3e297bdae2de4f642f3477b1083414108880"}
Jul 24 14:30:26.584896 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:26.584849    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77" event={"ID":"9e7f858b-9df0-49fd-b4ab-5370128a40af","Type":"ContainerStarted","Data":"c2351f50f921d0e150d8440361cfa534e18fa64e9176697f4739a8b8167a8f62"}
Jul 24 14:30:26.585393 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:26.584937    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:26.620189 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:26.620120    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77" podStartSLOduration=1.1899945889999999 podStartE2EDuration="2.620101336s" totalImagesPullingTime="1.430106747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:30:26.619965885 +0000 UTC m=+493.061716417" watchObservedRunningTime="2026-07-24 14:30:26.620101336 +0000 UTC m=+493.061851855"
Jul 24 14:30:27.333610 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.333572    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"]
Jul 24 14:30:27.335647 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.335632    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.338527 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.338506    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 14:30:27.338663 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.338603    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k4dnd\""
Jul 24 14:30:27.338720 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.338707    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 14:30:27.338915 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.338900    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 14:30:27.339256 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.339244    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 14:30:27.363463 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.363431    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"]
Jul 24 14:30:27.476370 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.476330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42f78ced-aa2a-470e-b108-a30e2b2db03a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.476541 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.476380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/42f78ced-aa2a-470e-b108-a30e2b2db03a-manifests\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.476541 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.476457    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bt5h\" (UniqueName: \"kubernetes.io/projected/42f78ced-aa2a-470e-b108-a30e2b2db03a-kube-api-access-6bt5h\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.476541 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.476492    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42f78ced-aa2a-470e-b108-a30e2b2db03a-tmp\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.476541 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.476515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42f78ced-aa2a-470e-b108-a30e2b2db03a-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.577095 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.577060    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bt5h\" (UniqueName: \"kubernetes.io/projected/42f78ced-aa2a-470e-b108-a30e2b2db03a-kube-api-access-6bt5h\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.577095 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.577100    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42f78ced-aa2a-470e-b108-a30e2b2db03a-tmp\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.577308 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.577122    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42f78ced-aa2a-470e-b108-a30e2b2db03a-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.577308 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.577179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42f78ced-aa2a-470e-b108-a30e2b2db03a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.577308 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.577216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/42f78ced-aa2a-470e-b108-a30e2b2db03a-manifests\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.577602 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.577574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/42f78ced-aa2a-470e-b108-a30e2b2db03a-manifests\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.579473 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.579455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42f78ced-aa2a-470e-b108-a30e2b2db03a-tmp\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.579623 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.579607    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/42f78ced-aa2a-470e-b108-a30e2b2db03a-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.579743 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.579726    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/42f78ced-aa2a-470e-b108-a30e2b2db03a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.588536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.588476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bt5h\" (UniqueName: \"kubernetes.io/projected/42f78ced-aa2a-470e-b108-a30e2b2db03a-kube-api-access-6bt5h\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-jj8gv\" (UID: \"42f78ced-aa2a-470e-b108-a30e2b2db03a\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.646434 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.646393    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:27.786011 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:27.785981    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"]
Jul 24 14:30:27.789522 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:30:27.789497    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f78ced_aa2a_470e_b108_a30e2b2db03a.slice/crio-b1204dcab31d9e6dace79a274d2ad6f88968d3231b5d5dcceb358e55d37c7c0a WatchSource:0}: Error finding container b1204dcab31d9e6dace79a274d2ad6f88968d3231b5d5dcceb358e55d37c7c0a: Status 404 returned error can't find the container with id b1204dcab31d9e6dace79a274d2ad6f88968d3231b5d5dcceb358e55d37c7c0a
Jul 24 14:30:28.597664 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:28.597625    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv" event={"ID":"42f78ced-aa2a-470e-b108-a30e2b2db03a","Type":"ContainerStarted","Data":"b1204dcab31d9e6dace79a274d2ad6f88968d3231b5d5dcceb358e55d37c7c0a"}
Jul 24 14:30:31.613576 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:31.613541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv" event={"ID":"42f78ced-aa2a-470e-b108-a30e2b2db03a","Type":"ContainerStarted","Data":"ddb9ebca7b535c95a25463db7c20004486779ceed1d01ae12097a5fa722eb535"}
Jul 24 14:30:32.619565 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:32.619530    2574 generic.go:356] "Generic (PLEG): container finished" podID="42f78ced-aa2a-470e-b108-a30e2b2db03a" containerID="ddb9ebca7b535c95a25463db7c20004486779ceed1d01ae12097a5fa722eb535" exitCode=0
Jul 24 14:30:32.619971 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:32.619588    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv" event={"ID":"42f78ced-aa2a-470e-b108-a30e2b2db03a","Type":"ContainerDied","Data":"ddb9ebca7b535c95a25463db7c20004486779ceed1d01ae12097a5fa722eb535"}
Jul 24 14:30:33.625742 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:33.625710    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv" event={"ID":"42f78ced-aa2a-470e-b108-a30e2b2db03a","Type":"ContainerStarted","Data":"911751ac3155271b3756b23ad7138f2ea538538dfe1e949c70c976918f01b9e8"}
Jul 24 14:30:33.626161 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:33.625846    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:30:33.659827 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:33.659773    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv" podStartSLOduration=1.8708075640000001 podStartE2EDuration="6.6597564s" totalImagesPullingTime="3.75372054s" totalInitContainerRuntime="1.035228296s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:30:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:30:33.656994383 +0000 UTC m=+500.098744904" watchObservedRunningTime="2026-07-24 14:30:33.6597564 +0000 UTC m=+500.101506919"
Jul 24 14:30:37.592356 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:37.592326    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-mzl77"
Jul 24 14:30:44.636535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:30:44.636498    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-jj8gv"
Jul 24 14:31:00.534737 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.534700    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"]
Jul 24 14:31:00.541663 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.541645    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.544919 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.544895    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ntg28\""
Jul 24 14:31:00.546137 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.546118    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 14:31:00.548840 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.548815    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 14:31:00.549067 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.549050    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 14:31:00.549292 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.549273    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 14:31:00.549468 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.549456    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 14:31:00.551866 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.551851    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 14:31:00.569371 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.569347    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"]
Jul 24 14:31:00.655644 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.655599    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b30fc36e-262d-46dd-879e-a3bee4fa88e8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.655644 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.655646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.655872 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.655674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.655872 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.655748    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.655872 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.655823    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.655872 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.655864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.656012 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.655883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4bl7\" (UniqueName: \"kubernetes.io/projected/b30fc36e-262d-46dd-879e-a3bee4fa88e8-kube-api-access-k4bl7\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.756542 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.756505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.756542 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.756549    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.756776 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.756573    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4bl7\" (UniqueName: \"kubernetes.io/projected/b30fc36e-262d-46dd-879e-a3bee4fa88e8-kube-api-access-k4bl7\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.756776 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.756610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b30fc36e-262d-46dd-879e-a3bee4fa88e8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.756776 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.756632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.756776 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.756663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.756776 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.756696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.757410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.757372    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.759140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.759112    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b30fc36e-262d-46dd-879e-a3bee4fa88e8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.759272 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.759220    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.759335 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.759278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.759335 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.759297    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b30fc36e-262d-46dd-879e-a3bee4fa88e8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.767520 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.767494    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4bl7\" (UniqueName: \"kubernetes.io/projected/b30fc36e-262d-46dd-879e-a3bee4fa88e8-kube-api-access-k4bl7\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.769795 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.769776    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b30fc36e-262d-46dd-879e-a3bee4fa88e8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8gg9x\" (UID: \"b30fc36e-262d-46dd-879e-a3bee4fa88e8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:00.851515 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:00.851422    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:01.047694 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:01.047654    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"]
Jul 24 14:31:01.062716 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:31:01.062679    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30fc36e_262d_46dd_879e_a3bee4fa88e8.slice/crio-8d89a011116dcc6202d5f32298a4c925d3ebf3def366051dec3542bb23b37aee WatchSource:0}: Error finding container 8d89a011116dcc6202d5f32298a4c925d3ebf3def366051dec3542bb23b37aee: Status 404 returned error can't find the container with id 8d89a011116dcc6202d5f32298a4c925d3ebf3def366051dec3542bb23b37aee
Jul 24 14:31:01.752134 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:01.752099    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x" event={"ID":"b30fc36e-262d-46dd-879e-a3bee4fa88e8","Type":"ContainerStarted","Data":"8d89a011116dcc6202d5f32298a4c925d3ebf3def366051dec3542bb23b37aee"}
Jul 24 14:31:03.823581 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:03.823533    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 14:31:03.823837 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:03.823626    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 14:31:04.768301 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:04.768266    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x" event={"ID":"b30fc36e-262d-46dd-879e-a3bee4fa88e8","Type":"ContainerStarted","Data":"24b78efd6745f057db44771fbfdbdf04cf01400e6cd589e2f6efcda6ca065555"}
Jul 24 14:31:04.768577 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:04.768556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:31:04.769996 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:04.769965    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-8gg9x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 14:31:04.770182 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:04.770021    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x" podUID="b30fc36e-262d-46dd-879e-a3bee4fa88e8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 14:31:04.808823 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:04.808769    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x" podStartSLOduration=2.050086312 podStartE2EDuration="4.80875239s" totalImagesPullingTime="2.758666078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:31:04.805808412 +0000 UTC m=+531.247558932" watchObservedRunningTime="2026-07-24 14:31:04.80875239 +0000 UTC m=+531.250502908"
Jul 24 14:31:05.774023 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:05.773947    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-8gg9x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 14:31:05.774023 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:05.774005    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x" podUID="b30fc36e-262d-46dd-879e-a3bee4fa88e8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 14:31:08.774722 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:31:08.774693    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8gg9x"
Jul 24 14:32:03.915005 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.914973    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"]
Jul 24 14:32:03.919646 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.919624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:03.922524 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.922505    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 14:32:03.922650 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.922505    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 14:32:03.923526 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.923511    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wqjkb\""
Jul 24 14:32:03.929384 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.929363    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"]
Jul 24 14:32:03.971462 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.971433    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:03.971639 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.971485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5hg4\" (UniqueName: \"kubernetes.io/projected/b9ddc5ea-ad95-4aae-9640-d3e36f479139-kube-api-access-h5hg4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:03.971639 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:03.971582    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:04.071981 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.071945    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:04.072204 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.071993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5hg4\" (UniqueName: \"kubernetes.io/projected/b9ddc5ea-ad95-4aae-9640-d3e36f479139-kube-api-access-h5hg4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:04.072204 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.072070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:04.072488 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.072464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:04.072547 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.072476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:04.083933 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.083905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5hg4\" (UniqueName: \"kubernetes.io/projected/b9ddc5ea-ad95-4aae-9640-d3e36f479139-kube-api-access-h5hg4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:04.230021 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.229987    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:04.377293 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.377258    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"]
Jul 24 14:32:04.382167 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:32:04.382141    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ddc5ea_ad95_4aae_9640_d3e36f479139.slice/crio-659e2878b25c6a49b4e07fcf2cc2e76681d7a79cb38fc7e44302a1935a432c44 WatchSource:0}: Error finding container 659e2878b25c6a49b4e07fcf2cc2e76681d7a79cb38fc7e44302a1935a432c44: Status 404 returned error can't find the container with id 659e2878b25c6a49b4e07fcf2cc2e76681d7a79cb38fc7e44302a1935a432c44
Jul 24 14:32:04.503646 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.503569    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"]
Jul 24 14:32:04.507347 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.507311    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.517087 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.517056    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"]
Jul 24 14:32:04.575099 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.575057    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.575287 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.575163    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.575287 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.575203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvx27\" (UniqueName: \"kubernetes.io/projected/3a9157b8-31d4-47b0-b6c9-31320933caa1-kube-api-access-rvx27\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.676123 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.676088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.676295 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.676144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.676295 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.676172    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvx27\" (UniqueName: \"kubernetes.io/projected/3a9157b8-31d4-47b0-b6c9-31320933caa1-kube-api-access-rvx27\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.676471 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.676452    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.676513 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.676488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.689902 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.689877    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvx27\" (UniqueName: \"kubernetes.io/projected/3a9157b8-31d4-47b0-b6c9-31320933caa1-kube-api-access-rvx27\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.827931 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.827847    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:04.892614 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.892587    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"]
Jul 24 14:32:04.894977 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.894957    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:04.905753 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.905725    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"]
Jul 24 14:32:04.961068 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.960976    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"]
Jul 24 14:32:04.964917 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:32:04.964890    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9157b8_31d4_47b0_b6c9_31320933caa1.slice/crio-351bdd8f7aff764b0ce46ad8e7d1eb8fc6e890ecee06e338be2b3d2b33539d73 WatchSource:0}: Error finding container 351bdd8f7aff764b0ce46ad8e7d1eb8fc6e890ecee06e338be2b3d2b33539d73: Status 404 returned error can't find the container with id 351bdd8f7aff764b0ce46ad8e7d1eb8fc6e890ecee06e338be2b3d2b33539d73
Jul 24 14:32:04.978233 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.978117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:04.978233 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.978159    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8zjz\" (UniqueName: \"kubernetes.io/projected/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-kube-api-access-r8zjz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:04.978233 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:04.978200    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:05.023672 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.023635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2" event={"ID":"3a9157b8-31d4-47b0-b6c9-31320933caa1","Type":"ContainerStarted","Data":"9acb31b4696d052529a3bc851623ae247c1a5a6947ec33cb56c68b8a285629f6"}
Jul 24 14:32:05.023833 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.023701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2" event={"ID":"3a9157b8-31d4-47b0-b6c9-31320933caa1","Type":"ContainerStarted","Data":"351bdd8f7aff764b0ce46ad8e7d1eb8fc6e890ecee06e338be2b3d2b33539d73"}
Jul 24 14:32:05.025305 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.025282    2574 generic.go:356] "Generic (PLEG): container finished" podID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerID="59547e9e1522feb980cb414af9eee68200ae3fe24ce885844d02b28abfb27aa5" exitCode=0
Jul 24 14:32:05.025418 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.025364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk" event={"ID":"b9ddc5ea-ad95-4aae-9640-d3e36f479139","Type":"ContainerDied","Data":"59547e9e1522feb980cb414af9eee68200ae3fe24ce885844d02b28abfb27aa5"}
Jul 24 14:32:05.025418 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.025407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk" event={"ID":"b9ddc5ea-ad95-4aae-9640-d3e36f479139","Type":"ContainerStarted","Data":"659e2878b25c6a49b4e07fcf2cc2e76681d7a79cb38fc7e44302a1935a432c44"}
Jul 24 14:32:05.079238 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.079169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:05.079238 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.079210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8zjz\" (UniqueName: \"kubernetes.io/projected/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-kube-api-access-r8zjz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:05.079408 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.079240    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:05.079593 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.079571    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:05.079658 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.079591    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:05.089872 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.089848    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8zjz\" (UniqueName: \"kubernetes.io/projected/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-kube-api-access-r8zjz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:05.204965 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.204930    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:05.302102 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.302069    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"]
Jul 24 14:32:05.304731 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.304706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.315724 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.315698    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"]
Jul 24 14:32:05.340930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.340905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"]
Jul 24 14:32:05.342492 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:32:05.342463    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004ab5a7_9d75_4c01_b64a_a70e8b7182a9.slice/crio-31c72e7192bbefa0588a289b6cea058d102cf157d0a769549e28c9bd4bd251b9 WatchSource:0}: Error finding container 31c72e7192bbefa0588a289b6cea058d102cf157d0a769549e28c9bd4bd251b9: Status 404 returned error can't find the container with id 31c72e7192bbefa0588a289b6cea058d102cf157d0a769549e28c9bd4bd251b9
Jul 24 14:32:05.381332 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.381303    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.381481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.381369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.381481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.381404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c28j\" (UniqueName: \"kubernetes.io/projected/015a5fbc-d63c-42cb-b73c-5870ed555d35-kube-api-access-7c28j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.482739 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.482698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.482917 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.482760    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c28j\" (UniqueName: \"kubernetes.io/projected/015a5fbc-d63c-42cb-b73c-5870ed555d35-kube-api-access-7c28j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.482917 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.482817    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.483117 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.483095    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.483177 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.483159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.495256 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.495230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c28j\" (UniqueName: \"kubernetes.io/projected/015a5fbc-d63c-42cb-b73c-5870ed555d35-kube-api-access-7c28j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.615149 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.615124    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:05.751717 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:05.751692    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"]
Jul 24 14:32:05.753476 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:32:05.753454    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015a5fbc_d63c_42cb_b73c_5870ed555d35.slice/crio-f0bd44a4cccf3f532be4bdd5376dc93b38546ba6610a9cd80c08285a3fe19171 WatchSource:0}: Error finding container f0bd44a4cccf3f532be4bdd5376dc93b38546ba6610a9cd80c08285a3fe19171: Status 404 returned error can't find the container with id f0bd44a4cccf3f532be4bdd5376dc93b38546ba6610a9cd80c08285a3fe19171
Jul 24 14:32:06.030819 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.030787    2574 generic.go:356] "Generic (PLEG): container finished" podID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerID="069b4adbe376d5d8de0566e3323757277d2031279ab85add03f8383b2cc12206" exitCode=0
Jul 24 14:32:06.031275 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.030874    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8" event={"ID":"015a5fbc-d63c-42cb-b73c-5870ed555d35","Type":"ContainerDied","Data":"069b4adbe376d5d8de0566e3323757277d2031279ab85add03f8383b2cc12206"}
Jul 24 14:32:06.031275 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.030929    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8" event={"ID":"015a5fbc-d63c-42cb-b73c-5870ed555d35","Type":"ContainerStarted","Data":"f0bd44a4cccf3f532be4bdd5376dc93b38546ba6610a9cd80c08285a3fe19171"}
Jul 24 14:32:06.032389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.032363    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerID="9acb31b4696d052529a3bc851623ae247c1a5a6947ec33cb56c68b8a285629f6" exitCode=0
Jul 24 14:32:06.032509 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.032443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2" event={"ID":"3a9157b8-31d4-47b0-b6c9-31320933caa1","Type":"ContainerDied","Data":"9acb31b4696d052529a3bc851623ae247c1a5a6947ec33cb56c68b8a285629f6"}
Jul 24 14:32:06.034350 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.034331    2574 generic.go:356] "Generic (PLEG): container finished" podID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerID="1082afbd20911478475feb163f508da2deaa18261c8fac74fdaba92b83ce06fa" exitCode=0
Jul 24 14:32:06.034439 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.034404    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk" event={"ID":"b9ddc5ea-ad95-4aae-9640-d3e36f479139","Type":"ContainerDied","Data":"1082afbd20911478475feb163f508da2deaa18261c8fac74fdaba92b83ce06fa"}
Jul 24 14:32:06.036007 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.035981    2574 generic.go:356] "Generic (PLEG): container finished" podID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerID="66ca6794f261e05d7c31adc99aad749608013b43c58382775921240000433df0" exitCode=0
Jul 24 14:32:06.036132 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.036059    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df" event={"ID":"004ab5a7-9d75-4c01-b64a-a70e8b7182a9","Type":"ContainerDied","Data":"66ca6794f261e05d7c31adc99aad749608013b43c58382775921240000433df0"}
Jul 24 14:32:06.036132 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:06.036105    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df" event={"ID":"004ab5a7-9d75-4c01-b64a-a70e8b7182a9","Type":"ContainerStarted","Data":"31c72e7192bbefa0588a289b6cea058d102cf157d0a769549e28c9bd4bd251b9"}
Jul 24 14:32:07.043145 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:07.043060    2574 generic.go:356] "Generic (PLEG): container finished" podID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerID="bdd497057516c3b4dbae102534444aa3aa8d5932d824fc0d663b4e45f71700d4" exitCode=0
Jul 24 14:32:07.043573 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:07.043155    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df" event={"ID":"004ab5a7-9d75-4c01-b64a-a70e8b7182a9","Type":"ContainerDied","Data":"bdd497057516c3b4dbae102534444aa3aa8d5932d824fc0d663b4e45f71700d4"}
Jul 24 14:32:07.045191 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:07.045165    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerID="dee08f017d67d094123bc888761909e4faf1452cdef4e0fddf4ca6990d1b3e3a" exitCode=0
Jul 24 14:32:07.045299 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:07.045255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2" event={"ID":"3a9157b8-31d4-47b0-b6c9-31320933caa1","Type":"ContainerDied","Data":"dee08f017d67d094123bc888761909e4faf1452cdef4e0fddf4ca6990d1b3e3a"}
Jul 24 14:32:07.047592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:07.047570    2574 generic.go:356] "Generic (PLEG): container finished" podID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerID="580b7adca837864b3e3bcf45f217d094a17d2c2c40cef0613e4545127eb1fb4a" exitCode=0
Jul 24 14:32:07.047684 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:07.047616    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk" event={"ID":"b9ddc5ea-ad95-4aae-9640-d3e36f479139","Type":"ContainerDied","Data":"580b7adca837864b3e3bcf45f217d094a17d2c2c40cef0613e4545127eb1fb4a"}
Jul 24 14:32:08.054958 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.054924    2574 generic.go:356] "Generic (PLEG): container finished" podID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerID="5e1de4811423ac690c7ffc50cf6d0363251539e67d2ffae45230331d7c454adc" exitCode=0
Jul 24 14:32:08.055418 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.055011    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8" event={"ID":"015a5fbc-d63c-42cb-b73c-5870ed555d35","Type":"ContainerDied","Data":"5e1de4811423ac690c7ffc50cf6d0363251539e67d2ffae45230331d7c454adc"}
Jul 24 14:32:08.057302 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.057274    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerID="f528c276622e393d6827e9519c6e5ce7479c738b2b4f5d2c11f884c4ae2eee45" exitCode=0
Jul 24 14:32:08.057393 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.057308    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2" event={"ID":"3a9157b8-31d4-47b0-b6c9-31320933caa1","Type":"ContainerDied","Data":"f528c276622e393d6827e9519c6e5ce7479c738b2b4f5d2c11f884c4ae2eee45"}
Jul 24 14:32:08.059299 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.059278    2574 generic.go:356] "Generic (PLEG): container finished" podID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerID="66cff136192206a0236e3f101a5efbb32ed94c623f31e273c224fd5be0526410" exitCode=0
Jul 24 14:32:08.059385 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.059363    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df" event={"ID":"004ab5a7-9d75-4c01-b64a-a70e8b7182a9","Type":"ContainerDied","Data":"66cff136192206a0236e3f101a5efbb32ed94c623f31e273c224fd5be0526410"}
Jul 24 14:32:08.193163 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.193136    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:08.205546 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.205526    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5hg4\" (UniqueName: \"kubernetes.io/projected/b9ddc5ea-ad95-4aae-9640-d3e36f479139-kube-api-access-h5hg4\") pod \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") "
Jul 24 14:32:08.205641 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.205610    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-bundle\") pod \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") "
Jul 24 14:32:08.205677 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.205651    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-util\") pod \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\" (UID: \"b9ddc5ea-ad95-4aae-9640-d3e36f479139\") "
Jul 24 14:32:08.206052 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.206016    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-bundle" (OuterVolumeSpecName: "bundle") pod "b9ddc5ea-ad95-4aae-9640-d3e36f479139" (UID: "b9ddc5ea-ad95-4aae-9640-d3e36f479139"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:08.207592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.207573    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ddc5ea-ad95-4aae-9640-d3e36f479139-kube-api-access-h5hg4" (OuterVolumeSpecName: "kube-api-access-h5hg4") pod "b9ddc5ea-ad95-4aae-9640-d3e36f479139" (UID: "b9ddc5ea-ad95-4aae-9640-d3e36f479139"). InnerVolumeSpecName "kube-api-access-h5hg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:32:08.211112 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.211079    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-util" (OuterVolumeSpecName: "util") pod "b9ddc5ea-ad95-4aae-9640-d3e36f479139" (UID: "b9ddc5ea-ad95-4aae-9640-d3e36f479139"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:08.307109 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.307013    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:08.307109 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.307056    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9ddc5ea-ad95-4aae-9640-d3e36f479139-util\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:08.307109 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:08.307067    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5hg4\" (UniqueName: \"kubernetes.io/projected/b9ddc5ea-ad95-4aae-9640-d3e36f479139-kube-api-access-h5hg4\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:09.066845 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.066806    2574 generic.go:356] "Generic (PLEG): container finished" podID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerID="35f4a804906711680e6a903458f2bd456cd5338ef5f65521925595bfee681c17" exitCode=0
Jul 24 14:32:09.067335 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.066906    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8" event={"ID":"015a5fbc-d63c-42cb-b73c-5870ed555d35","Type":"ContainerDied","Data":"35f4a804906711680e6a903458f2bd456cd5338ef5f65521925595bfee681c17"}
Jul 24 14:32:09.068797 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.068777    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk"
Jul 24 14:32:09.068894 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.068815    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk" event={"ID":"b9ddc5ea-ad95-4aae-9640-d3e36f479139","Type":"ContainerDied","Data":"659e2878b25c6a49b4e07fcf2cc2e76681d7a79cb38fc7e44302a1935a432c44"}
Jul 24 14:32:09.068894 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.068859    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="659e2878b25c6a49b4e07fcf2cc2e76681d7a79cb38fc7e44302a1935a432c44"
Jul 24 14:32:09.201385 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.201357    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:09.214984 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.214959    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-bundle\") pod \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") "
Jul 24 14:32:09.214984 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.214988    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-util\") pod \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") "
Jul 24 14:32:09.215179 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.215067    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8zjz\" (UniqueName: \"kubernetes.io/projected/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-kube-api-access-r8zjz\") pod \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\" (UID: \"004ab5a7-9d75-4c01-b64a-a70e8b7182a9\") "
Jul 24 14:32:09.215691 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.215650    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-bundle" (OuterVolumeSpecName: "bundle") pod "004ab5a7-9d75-4c01-b64a-a70e8b7182a9" (UID: "004ab5a7-9d75-4c01-b64a-a70e8b7182a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:09.217589 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.217562    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-kube-api-access-r8zjz" (OuterVolumeSpecName: "kube-api-access-r8zjz") pod "004ab5a7-9d75-4c01-b64a-a70e8b7182a9" (UID: "004ab5a7-9d75-4c01-b64a-a70e8b7182a9"). InnerVolumeSpecName "kube-api-access-r8zjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:32:09.221904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.221770    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-util" (OuterVolumeSpecName: "util") pod "004ab5a7-9d75-4c01-b64a-a70e8b7182a9" (UID: "004ab5a7-9d75-4c01-b64a-a70e8b7182a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:09.238329 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.238306    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:09.316082 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.316049    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvx27\" (UniqueName: \"kubernetes.io/projected/3a9157b8-31d4-47b0-b6c9-31320933caa1-kube-api-access-rvx27\") pod \"3a9157b8-31d4-47b0-b6c9-31320933caa1\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") "
Jul 24 14:32:09.316266 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.316093    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-util\") pod \"3a9157b8-31d4-47b0-b6c9-31320933caa1\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") "
Jul 24 14:32:09.316266 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.316124    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-bundle\") pod \"3a9157b8-31d4-47b0-b6c9-31320933caa1\" (UID: \"3a9157b8-31d4-47b0-b6c9-31320933caa1\") "
Jul 24 14:32:09.316394 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.316300    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8zjz\" (UniqueName: \"kubernetes.io/projected/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-kube-api-access-r8zjz\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:09.316394 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.316316    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:09.316394 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.316327    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/004ab5a7-9d75-4c01-b64a-a70e8b7182a9-util\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:09.316691 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.316667    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-bundle" (OuterVolumeSpecName: "bundle") pod "3a9157b8-31d4-47b0-b6c9-31320933caa1" (UID: "3a9157b8-31d4-47b0-b6c9-31320933caa1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:09.318304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.318249    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a9157b8-31d4-47b0-b6c9-31320933caa1-kube-api-access-rvx27" (OuterVolumeSpecName: "kube-api-access-rvx27") pod "3a9157b8-31d4-47b0-b6c9-31320933caa1" (UID: "3a9157b8-31d4-47b0-b6c9-31320933caa1"). InnerVolumeSpecName "kube-api-access-rvx27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:32:09.321615 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.321583    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-util" (OuterVolumeSpecName: "util") pod "3a9157b8-31d4-47b0-b6c9-31320933caa1" (UID: "3a9157b8-31d4-47b0-b6c9-31320933caa1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:09.417126 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.417076    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:09.417126 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.417121    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvx27\" (UniqueName: \"kubernetes.io/projected/3a9157b8-31d4-47b0-b6c9-31320933caa1-kube-api-access-rvx27\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:09.417126 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:09.417131    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a9157b8-31d4-47b0-b6c9-31320933caa1-util\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:10.075450 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.075421    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df"
Jul 24 14:32:10.075450 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.075435    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df" event={"ID":"004ab5a7-9d75-4c01-b64a-a70e8b7182a9","Type":"ContainerDied","Data":"31c72e7192bbefa0588a289b6cea058d102cf157d0a769549e28c9bd4bd251b9"}
Jul 24 14:32:10.075894 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.075477    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31c72e7192bbefa0588a289b6cea058d102cf157d0a769549e28c9bd4bd251b9"
Jul 24 14:32:10.077679 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.077639    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2"
Jul 24 14:32:10.077679 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.077688    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2" event={"ID":"3a9157b8-31d4-47b0-b6c9-31320933caa1","Type":"ContainerDied","Data":"351bdd8f7aff764b0ce46ad8e7d1eb8fc6e890ecee06e338be2b3d2b33539d73"}
Jul 24 14:32:10.077963 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.077726    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="351bdd8f7aff764b0ce46ad8e7d1eb8fc6e890ecee06e338be2b3d2b33539d73"
Jul 24 14:32:10.212715 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.212691    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:10.223291 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.223258    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-util\") pod \"015a5fbc-d63c-42cb-b73c-5870ed555d35\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") "
Jul 24 14:32:10.223424 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.223316    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c28j\" (UniqueName: \"kubernetes.io/projected/015a5fbc-d63c-42cb-b73c-5870ed555d35-kube-api-access-7c28j\") pod \"015a5fbc-d63c-42cb-b73c-5870ed555d35\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") "
Jul 24 14:32:10.223424 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.223369    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-bundle\") pod \"015a5fbc-d63c-42cb-b73c-5870ed555d35\" (UID: \"015a5fbc-d63c-42cb-b73c-5870ed555d35\") "
Jul 24 14:32:10.223861 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.223826    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-bundle" (OuterVolumeSpecName: "bundle") pod "015a5fbc-d63c-42cb-b73c-5870ed555d35" (UID: "015a5fbc-d63c-42cb-b73c-5870ed555d35"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:10.225379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.225359    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015a5fbc-d63c-42cb-b73c-5870ed555d35-kube-api-access-7c28j" (OuterVolumeSpecName: "kube-api-access-7c28j") pod "015a5fbc-d63c-42cb-b73c-5870ed555d35" (UID: "015a5fbc-d63c-42cb-b73c-5870ed555d35"). InnerVolumeSpecName "kube-api-access-7c28j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:32:10.228568 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.228547    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-util" (OuterVolumeSpecName: "util") pod "015a5fbc-d63c-42cb-b73c-5870ed555d35" (UID: "015a5fbc-d63c-42cb-b73c-5870ed555d35"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:10.324093 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.323993    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:10.324093 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.324019    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/015a5fbc-d63c-42cb-b73c-5870ed555d35-util\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:10.324093 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:10.324051    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c28j\" (UniqueName: \"kubernetes.io/projected/015a5fbc-d63c-42cb-b73c-5870ed555d35-kube-api-access-7c28j\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:32:11.084511 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:11.084472    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8" event={"ID":"015a5fbc-d63c-42cb-b73c-5870ed555d35","Type":"ContainerDied","Data":"f0bd44a4cccf3f532be4bdd5376dc93b38546ba6610a9cd80c08285a3fe19171"}
Jul 24 14:32:11.084897 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:11.084529    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0bd44a4cccf3f532be4bdd5376dc93b38546ba6610a9cd80c08285a3fe19171"
Jul 24 14:32:11.084897 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:11.084487    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8"
Jul 24 14:32:27.421536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421497    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-649c988d67-lvhd2"]
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421893    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerName="util"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421909    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerName="util"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421931    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerName="pull"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421939    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerName="pull"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421951    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerName="pull"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421958    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerName="pull"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421967    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421973    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421981    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerName="pull"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421987    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerName="pull"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421993    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.421998    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422005    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerName="util"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422010    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerName="util"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422015    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerName="util"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422021    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerName="util"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422045    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerName="util"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422050    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerName="util"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422061    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerName="pull"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422065    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerName="pull"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422072    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422077    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422082    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422089    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422143    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ddc5ea-ad95-4aae-9640-d3e36f479139" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422150    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="015a5fbc-d63c-42cb-b73c-5870ed555d35" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422156    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a9157b8-31d4-47b0-b6c9-31320933caa1" containerName="extract"
Jul 24 14:32:27.423879 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.422163    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="004ab5a7-9d75-4c01-b64a-a70e8b7182a9" containerName="extract"
Jul 24 14:32:27.424882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.424865    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.438817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.438785    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649c988d67-lvhd2"]
Jul 24 14:32:27.460350 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.460312    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-oauth-config\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.460505 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.460356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctcwc\" (UniqueName: \"kubernetes.io/projected/11eb3a8c-bcf1-4cea-858b-15374ba780ef-kube-api-access-ctcwc\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.460505 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.460463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-trusted-ca-bundle\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.460586 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.460523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-service-ca\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.460586 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.460553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-config\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.460651 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.460585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-oauth-serving-cert\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.460651 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.460605    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-serving-cert\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.561310 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.561272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-trusted-ca-bundle\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.561506 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.561336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-service-ca\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.561506 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.561354    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-config\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.561506 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.561372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-oauth-serving-cert\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.561506 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.561392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-serving-cert\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.561506 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.561474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-oauth-config\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.561764 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.561515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctcwc\" (UniqueName: \"kubernetes.io/projected/11eb3a8c-bcf1-4cea-858b-15374ba780ef-kube-api-access-ctcwc\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.562210 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.562158    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-oauth-serving-cert\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.562348 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.562227    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-config\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.562348 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.562233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-service-ca\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.562427 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.562397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11eb3a8c-bcf1-4cea-858b-15374ba780ef-trusted-ca-bundle\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.564383 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.564355    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-serving-cert\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.564383 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.564370    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11eb3a8c-bcf1-4cea-858b-15374ba780ef-console-oauth-config\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.572606 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.572572    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctcwc\" (UniqueName: \"kubernetes.io/projected/11eb3a8c-bcf1-4cea-858b-15374ba780ef-kube-api-access-ctcwc\") pod \"console-649c988d67-lvhd2\" (UID: \"11eb3a8c-bcf1-4cea-858b-15374ba780ef\") " pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.733692 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.733602    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:27.867239 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:27.867215    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649c988d67-lvhd2"]
Jul 24 14:32:27.869146 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:32:27.869120    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11eb3a8c_bcf1_4cea_858b_15374ba780ef.slice/crio-bf6c69a523177d932ca0bc6b1e2459cbb0c0224df95ca18659d2d93473cd2309 WatchSource:0}: Error finding container bf6c69a523177d932ca0bc6b1e2459cbb0c0224df95ca18659d2d93473cd2309: Status 404 returned error can't find the container with id bf6c69a523177d932ca0bc6b1e2459cbb0c0224df95ca18659d2d93473cd2309
Jul 24 14:32:28.163609 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:28.163522    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649c988d67-lvhd2" event={"ID":"11eb3a8c-bcf1-4cea-858b-15374ba780ef","Type":"ContainerStarted","Data":"b6b219d7713f763a788036a760cd5be808e011cec8f60c755fad8921aecf1c86"}
Jul 24 14:32:28.163609 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:28.163569    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649c988d67-lvhd2" event={"ID":"11eb3a8c-bcf1-4cea-858b-15374ba780ef","Type":"ContainerStarted","Data":"bf6c69a523177d932ca0bc6b1e2459cbb0c0224df95ca18659d2d93473cd2309"}
Jul 24 14:32:28.200872 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:28.200814    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-649c988d67-lvhd2" podStartSLOduration=1.200796878 podStartE2EDuration="1.200796878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:28.198695406 +0000 UTC m=+614.640445924" watchObservedRunningTime="2026-07-24 14:32:28.200796878 +0000 UTC m=+614.642547396"
Jul 24 14:32:37.734124 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:37.734007    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:37.734124 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:37.734097    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:37.738882 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:37.738858    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:38.212888 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:38.212862    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-649c988d67-lvhd2"
Jul 24 14:32:38.276905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:32:38.276874    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc587f554-pkx7k"]
Jul 24 14:33:03.300259 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.300199    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bc587f554-pkx7k" podUID="f30b3970-4c1f-4a9e-a253-e2a09713bbac" containerName="console" containerID="cri-o://71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def" gracePeriod=15
Jul 24 14:33:03.546179 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.546155    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:33:03.571785 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.571692    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz8vz\" (UniqueName: \"kubernetes.io/projected/f30b3970-4c1f-4a9e-a253-e2a09713bbac-kube-api-access-bz8vz\") pod \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") "
Jul 24 14:33:03.571785 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.571736    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-service-ca\") pod \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") "
Jul 24 14:33:03.571785 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.571754    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-oauth-config\") pod \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") "
Jul 24 14:33:03.571785 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.571773    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-config\") pod \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") "
Jul 24 14:33:03.572162 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.571825    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-serving-cert\") pod \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") "
Jul 24 14:33:03.572162 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.571881    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-oauth-serving-cert\") pod \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") "
Jul 24 14:33:03.572162 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.571913    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-trusted-ca-bundle\") pod \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\" (UID: \"f30b3970-4c1f-4a9e-a253-e2a09713bbac\") "
Jul 24 14:33:03.572369 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.572340    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-config" (OuterVolumeSpecName: "console-config") pod "f30b3970-4c1f-4a9e-a253-e2a09713bbac" (UID: "f30b3970-4c1f-4a9e-a253-e2a09713bbac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:33:03.572448 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.572429    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f30b3970-4c1f-4a9e-a253-e2a09713bbac" (UID: "f30b3970-4c1f-4a9e-a253-e2a09713bbac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:33:03.572771 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.572729    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-service-ca" (OuterVolumeSpecName: "service-ca") pod "f30b3970-4c1f-4a9e-a253-e2a09713bbac" (UID: "f30b3970-4c1f-4a9e-a253-e2a09713bbac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:33:03.572903 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.572770    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f30b3970-4c1f-4a9e-a253-e2a09713bbac" (UID: "f30b3970-4c1f-4a9e-a253-e2a09713bbac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:33:03.574645 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.574601    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f30b3970-4c1f-4a9e-a253-e2a09713bbac" (UID: "f30b3970-4c1f-4a9e-a253-e2a09713bbac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:33:03.574645 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.574622    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30b3970-4c1f-4a9e-a253-e2a09713bbac-kube-api-access-bz8vz" (OuterVolumeSpecName: "kube-api-access-bz8vz") pod "f30b3970-4c1f-4a9e-a253-e2a09713bbac" (UID: "f30b3970-4c1f-4a9e-a253-e2a09713bbac"). InnerVolumeSpecName "kube-api-access-bz8vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:03.574909 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.574881    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f30b3970-4c1f-4a9e-a253-e2a09713bbac" (UID: "f30b3970-4c1f-4a9e-a253-e2a09713bbac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:33:03.672841 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.672804    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz8vz\" (UniqueName: \"kubernetes.io/projected/f30b3970-4c1f-4a9e-a253-e2a09713bbac-kube-api-access-bz8vz\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:03.672841 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.672835    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:03.672841 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.672846    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-oauth-config\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:03.673132 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.672855    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-config\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:03.673132 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.672864    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f30b3970-4c1f-4a9e-a253-e2a09713bbac-console-serving-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:03.673132 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.672872    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-oauth-serving-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:03.673132 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:03.672880    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f30b3970-4c1f-4a9e-a253-e2a09713bbac-trusted-ca-bundle\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:04.333221 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.333134    2574 generic.go:356] "Generic (PLEG): container finished" podID="f30b3970-4c1f-4a9e-a253-e2a09713bbac" containerID="71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def" exitCode=0
Jul 24 14:33:04.333221 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.333194    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc587f554-pkx7k"
Jul 24 14:33:04.333648 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.333232    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc587f554-pkx7k" event={"ID":"f30b3970-4c1f-4a9e-a253-e2a09713bbac","Type":"ContainerDied","Data":"71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def"}
Jul 24 14:33:04.333648 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.333280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc587f554-pkx7k" event={"ID":"f30b3970-4c1f-4a9e-a253-e2a09713bbac","Type":"ContainerDied","Data":"509c77422ce45ebebf54335af532875ed1be20d2b3fba37ba4a80729f0799c9d"}
Jul 24 14:33:04.333648 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.333302    2574 scope.go:117] "RemoveContainer" containerID="71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def"
Jul 24 14:33:04.341947 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.341936    2574 scope.go:117] "RemoveContainer" containerID="71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def"
Jul 24 14:33:04.342251 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:33:04.342231    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def\": container with ID starting with 71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def not found: ID does not exist" containerID="71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def"
Jul 24 14:33:04.342312 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.342260    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def"} err="failed to get container status \"71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def\": rpc error: code = NotFound desc = could not find container \"71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def\": container with ID starting with 71fcf91b1e70c1cd4362702dd46dd8cd43853a86937d6e6bf3bb2c977bbc6def not found: ID does not exist"
Jul 24 14:33:04.354164 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.354137    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc587f554-pkx7k"]
Jul 24 14:33:04.362730 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:04.362705    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bc587f554-pkx7k"]
Jul 24 14:33:06.018133 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:06.018104    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f30b3970-4c1f-4a9e-a253-e2a09713bbac" path="/var/lib/kubelet/pods/f30b3970-4c1f-4a9e-a253-e2a09713bbac/volumes"
Jul 24 14:33:12.402983 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.402946    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"]
Jul 24 14:33:12.403467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.403241    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30b3970-4c1f-4a9e-a253-e2a09713bbac" containerName="console"
Jul 24 14:33:12.403467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.403252    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30b3970-4c1f-4a9e-a253-e2a09713bbac" containerName="console"
Jul 24 14:33:12.403467 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.403301    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30b3970-4c1f-4a9e-a253-e2a09713bbac" containerName="console"
Jul 24 14:33:12.406160 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.406144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:12.409218 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.409183    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 14:33:12.409368 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.409256    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 14:33:12.409368 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.409197    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wqjkb\""
Jul 24 14:33:12.409854 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.409839    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 14:33:12.420795 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.420775    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"]
Jul 24 14:33:12.431278 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.431252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtms8\" (UniqueName: \"kubernetes.io/projected/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-kube-api-access-jtms8\") pod \"limitador-limitador-64c94fd64f-ptpwp\" (UID: \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:12.431415 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.431293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-config-file\") pod \"limitador-limitador-64c94fd64f-ptpwp\" (UID: \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:12.494414 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.494383    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"]
Jul 24 14:33:12.531739 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.531702    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtms8\" (UniqueName: \"kubernetes.io/projected/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-kube-api-access-jtms8\") pod \"limitador-limitador-64c94fd64f-ptpwp\" (UID: \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:12.531739 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.531740    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-config-file\") pod \"limitador-limitador-64c94fd64f-ptpwp\" (UID: \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:12.532350 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.532332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-config-file\") pod \"limitador-limitador-64c94fd64f-ptpwp\" (UID: \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:12.553351 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.553321    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtms8\" (UniqueName: \"kubernetes.io/projected/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-kube-api-access-jtms8\") pod \"limitador-limitador-64c94fd64f-ptpwp\" (UID: \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:12.715756 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.715724    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:12.862131 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:12.862097    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"]
Jul 24 14:33:12.866102 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:33:12.866075    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0526ada1_2970_46a5_ad4b_d1e16c8f87f5.slice/crio-0dcb5659014525d3768e718fa44d77908059c446ff9abd6b67946d9a7ab32893 WatchSource:0}: Error finding container 0dcb5659014525d3768e718fa44d77908059c446ff9abd6b67946d9a7ab32893: Status 404 returned error can't find the container with id 0dcb5659014525d3768e718fa44d77908059c446ff9abd6b67946d9a7ab32893
Jul 24 14:33:13.385321 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:13.385281    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp" event={"ID":"0526ada1-2970-46a5-ad4b-d1e16c8f87f5","Type":"ContainerStarted","Data":"0dcb5659014525d3768e718fa44d77908059c446ff9abd6b67946d9a7ab32893"}
Jul 24 14:33:16.400824 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:16.400790    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp" event={"ID":"0526ada1-2970-46a5-ad4b-d1e16c8f87f5","Type":"ContainerStarted","Data":"daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1"}
Jul 24 14:33:16.401256 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:16.400891    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:16.424212 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:16.424163    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp" podStartSLOduration=1.93142316 podStartE2EDuration="4.424146699s" totalImagesPullingTime="2.492723539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:16.423411814 +0000 UTC m=+662.865162333" watchObservedRunningTime="2026-07-24 14:33:16.424146699 +0000 UTC m=+662.865897212"
Jul 24 14:33:27.283576 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.283528    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"]
Jul 24 14:33:27.283994 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.283770    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp" podUID="0526ada1-2970-46a5-ad4b-d1e16c8f87f5" containerName="limitador" containerID="cri-o://daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1" gracePeriod=30
Jul 24 14:33:27.284524 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.284429    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:27.830162 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.830133    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:27.847436 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.847372    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtms8\" (UniqueName: \"kubernetes.io/projected/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-kube-api-access-jtms8\") pod \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\" (UID: \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\") "
Jul 24 14:33:27.847528 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.847434    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-config-file\") pod \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\" (UID: \"0526ada1-2970-46a5-ad4b-d1e16c8f87f5\") "
Jul 24 14:33:27.847806 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.847783    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-config-file" (OuterVolumeSpecName: "config-file") pod "0526ada1-2970-46a5-ad4b-d1e16c8f87f5" (UID: "0526ada1-2970-46a5-ad4b-d1e16c8f87f5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:33:27.849561 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.849543    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-kube-api-access-jtms8" (OuterVolumeSpecName: "kube-api-access-jtms8") pod "0526ada1-2970-46a5-ad4b-d1e16c8f87f5" (UID: "0526ada1-2970-46a5-ad4b-d1e16c8f87f5"). InnerVolumeSpecName "kube-api-access-jtms8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:27.948324 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.948291    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtms8\" (UniqueName: \"kubernetes.io/projected/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-kube-api-access-jtms8\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:27.948324 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:27.948318    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0526ada1-2970-46a5-ad4b-d1e16c8f87f5-config-file\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:33:28.456303 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.456271    2574 generic.go:356] "Generic (PLEG): container finished" podID="0526ada1-2970-46a5-ad4b-d1e16c8f87f5" containerID="daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1" exitCode=0
Jul 24 14:33:28.456303 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.456306    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp" event={"ID":"0526ada1-2970-46a5-ad4b-d1e16c8f87f5","Type":"ContainerDied","Data":"daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1"}
Jul 24 14:33:28.456820 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.456321    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"
Jul 24 14:33:28.456820 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.456349    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ptpwp" event={"ID":"0526ada1-2970-46a5-ad4b-d1e16c8f87f5","Type":"ContainerDied","Data":"0dcb5659014525d3768e718fa44d77908059c446ff9abd6b67946d9a7ab32893"}
Jul 24 14:33:28.456820 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.456370    2574 scope.go:117] "RemoveContainer" containerID="daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1"
Jul 24 14:33:28.464772 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.464748    2574 scope.go:117] "RemoveContainer" containerID="daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1"
Jul 24 14:33:28.465056 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:33:28.465006    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1\": container with ID starting with daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1 not found: ID does not exist" containerID="daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1"
Jul 24 14:33:28.465122 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.465067    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1"} err="failed to get container status \"daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1\": rpc error: code = NotFound desc = could not find container \"daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1\": container with ID starting with daa0e38c2fe86154b5bcfd3a69ea92ad0452fc79bf595916e8d2d19cbaadc0c1 not found: ID does not exist"
Jul 24 14:33:28.482250 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.482223    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"]
Jul 24 14:33:28.484875 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:28.484853    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ptpwp"]
Jul 24 14:33:29.138407 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.138368    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7m648"]
Jul 24 14:33:29.138680 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.138668    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0526ada1-2970-46a5-ad4b-d1e16c8f87f5" containerName="limitador"
Jul 24 14:33:29.138725 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.138684    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0526ada1-2970-46a5-ad4b-d1e16c8f87f5" containerName="limitador"
Jul 24 14:33:29.138760 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.138747    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0526ada1-2970-46a5-ad4b-d1e16c8f87f5" containerName="limitador"
Jul 24 14:33:29.143100 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.143072    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:29.148116 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.148085    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 14:33:29.148732 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.148709    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-sncxt\""
Jul 24 14:33:29.148848 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.148727    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 24 14:33:29.148977 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.148964    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:33:29.149876 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.149860    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7m648"]
Jul 24 14:33:29.259732 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.259694    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c639305-4166-4fe5-ac9c-9dffc94cb5c9-data\") pod \"postgres-69fb4594cf-7m648\" (UID: \"4c639305-4166-4fe5-ac9c-9dffc94cb5c9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:29.259925 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.259814    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ndl\" (UniqueName: \"kubernetes.io/projected/4c639305-4166-4fe5-ac9c-9dffc94cb5c9-kube-api-access-r4ndl\") pod \"postgres-69fb4594cf-7m648\" (UID: \"4c639305-4166-4fe5-ac9c-9dffc94cb5c9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:29.360713 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.360670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ndl\" (UniqueName: \"kubernetes.io/projected/4c639305-4166-4fe5-ac9c-9dffc94cb5c9-kube-api-access-r4ndl\") pod \"postgres-69fb4594cf-7m648\" (UID: \"4c639305-4166-4fe5-ac9c-9dffc94cb5c9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:29.360890 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.360729    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c639305-4166-4fe5-ac9c-9dffc94cb5c9-data\") pod \"postgres-69fb4594cf-7m648\" (UID: \"4c639305-4166-4fe5-ac9c-9dffc94cb5c9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:29.361116 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.361100    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c639305-4166-4fe5-ac9c-9dffc94cb5c9-data\") pod \"postgres-69fb4594cf-7m648\" (UID: \"4c639305-4166-4fe5-ac9c-9dffc94cb5c9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:29.381218 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.381191    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ndl\" (UniqueName: \"kubernetes.io/projected/4c639305-4166-4fe5-ac9c-9dffc94cb5c9-kube-api-access-r4ndl\") pod \"postgres-69fb4594cf-7m648\" (UID: \"4c639305-4166-4fe5-ac9c-9dffc94cb5c9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:29.456207 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.456170    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:29.593433 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:29.593404    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7m648"]
Jul 24 14:33:29.595754 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:33:29.595725    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c639305_4166_4fe5_ac9c_9dffc94cb5c9.slice/crio-f89f5838dd7633b91fc064476a42fb95330f314d1d9927dd3192b2950f0a35db WatchSource:0}: Error finding container f89f5838dd7633b91fc064476a42fb95330f314d1d9927dd3192b2950f0a35db: Status 404 returned error can't find the container with id f89f5838dd7633b91fc064476a42fb95330f314d1d9927dd3192b2950f0a35db
Jul 24 14:33:30.018161 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:30.018131    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0526ada1-2970-46a5-ad4b-d1e16c8f87f5" path="/var/lib/kubelet/pods/0526ada1-2970-46a5-ad4b-d1e16c8f87f5/volumes"
Jul 24 14:33:30.470985 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:30.470954    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648" event={"ID":"4c639305-4166-4fe5-ac9c-9dffc94cb5c9","Type":"ContainerStarted","Data":"f89f5838dd7633b91fc064476a42fb95330f314d1d9927dd3192b2950f0a35db"}
Jul 24 14:33:35.499978 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:35.499935    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648" event={"ID":"4c639305-4166-4fe5-ac9c-9dffc94cb5c9","Type":"ContainerStarted","Data":"68ebdc896be41ba0482fe4139fece5c3d79a3db15e0b06635550ad83795615f9"}
Jul 24 14:33:35.500375 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:35.500096    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:35.522015 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:35.521963    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648" podStartSLOduration=1.586761045 podStartE2EDuration="6.521947442s" totalImagesPullingTime="4.935186397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:35.520802296 +0000 UTC m=+681.962552818" watchObservedRunningTime="2026-07-24 14:33:35.521947442 +0000 UTC m=+681.963697961"
Jul 24 14:33:41.533597 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:41.533562    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7m648"
Jul 24 14:33:49.065504 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.065464    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6946c9fc55-fx88n"]
Jul 24 14:33:49.083385 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.083358    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:49.086668 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.086644    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:33:49.087211 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.087181    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:33:49.087544 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.087523    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s5p4r\""
Jul 24 14:33:49.089597 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.089577    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-fx88n"]
Jul 24 14:33:49.226523 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.226486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z8t4\" (UniqueName: \"kubernetes.io/projected/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-kube-api-access-6z8t4\") pod \"maas-controller-6946c9fc55-fx88n\" (UID: \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\") " pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:49.226523 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.226524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-webhook-cert\") pod \"maas-controller-6946c9fc55-fx88n\" (UID: \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\") " pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:49.327490 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.327396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-webhook-cert\") pod \"maas-controller-6946c9fc55-fx88n\" (UID: \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\") " pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:49.327490 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.327489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z8t4\" (UniqueName: \"kubernetes.io/projected/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-kube-api-access-6z8t4\") pod \"maas-controller-6946c9fc55-fx88n\" (UID: \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\") " pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:49.329818 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.329796    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-webhook-cert\") pod \"maas-controller-6946c9fc55-fx88n\" (UID: \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\") " pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:49.339749 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.339712    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z8t4\" (UniqueName: \"kubernetes.io/projected/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-kube-api-access-6z8t4\") pod \"maas-controller-6946c9fc55-fx88n\" (UID: \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\") " pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:49.395452 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.395417    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:49.529851 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.529826    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-fx88n"]
Jul 24 14:33:49.531690 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:33:49.531663    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4689ce0e_1bc9_4ef7_9579_059753f7a7a0.slice/crio-dcbd6a922dfa8d7ac9fce606b6fcdfead91f9ed1775e31aa4caa76b3291da70d WatchSource:0}: Error finding container dcbd6a922dfa8d7ac9fce606b6fcdfead91f9ed1775e31aa4caa76b3291da70d: Status 404 returned error can't find the container with id dcbd6a922dfa8d7ac9fce606b6fcdfead91f9ed1775e31aa4caa76b3291da70d
Jul 24 14:33:49.569850 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:49.569813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-fx88n" event={"ID":"4689ce0e-1bc9-4ef7-9579-059753f7a7a0","Type":"ContainerStarted","Data":"dcbd6a922dfa8d7ac9fce606b6fcdfead91f9ed1775e31aa4caa76b3291da70d"}
Jul 24 14:33:52.587302 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:52.587268    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-fx88n" event={"ID":"4689ce0e-1bc9-4ef7-9579-059753f7a7a0","Type":"ContainerStarted","Data":"65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4"}
Jul 24 14:33:52.587781 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:52.587387    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:33:52.607987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:33:52.607936    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6946c9fc55-fx88n" podStartSLOduration=1.4233072 podStartE2EDuration="3.60792084s" totalImagesPullingTime="2.18461364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:52.607565659 +0000 UTC m=+699.049316172" watchObservedRunningTime="2026-07-24 14:33:52.60792084 +0000 UTC m=+699.049671358"
Jul 24 14:34:03.594391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:03.594353    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:34:24.359386 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.359351    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"]
Jul 24 14:34:24.363729 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.363708    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:24.366289 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.366260    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 24 14:34:24.374979 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.374951    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"]
Jul 24 14:34:24.433400 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.433370    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-maas-api-tls\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:24.433588 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.433409    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-openshift-service-ca\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:24.433588 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.433497    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89px4\" (UniqueName: \"kubernetes.io/projected/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-kube-api-access-89px4\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:24.534088 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.534054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89px4\" (UniqueName: \"kubernetes.io/projected/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-kube-api-access-89px4\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:24.534088 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.534094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-maas-api-tls\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:24.534297 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.534122    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-openshift-service-ca\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:24.534297 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:34:24.534217    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 24 14:34:24.534297 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:34:24.534281    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-maas-api-tls podName:b1c300f6-e1d9-4638-8de3-ec0442aff5eb nodeName:}" failed. No retries permitted until 2026-07-24 14:34:25.034261865 +0000 UTC m=+731.476012367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-maas-api-tls") pod "maas-api-77cc5bc5d-8k4c7" (UID: "b1c300f6-e1d9-4638-8de3-ec0442aff5eb") : secret "maas-api-serving-cert" not found
Jul 24 14:34:24.534817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.534798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-openshift-service-ca\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:24.543289 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:24.543269    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89px4\" (UniqueName: \"kubernetes.io/projected/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-kube-api-access-89px4\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:25.038717 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.038682    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-maas-api-tls\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:25.041135 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.041105    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c300f6-e1d9-4638-8de3-ec0442aff5eb-maas-api-tls\") pod \"maas-api-77cc5bc5d-8k4c7\" (UID: \"b1c300f6-e1d9-4638-8de3-ec0442aff5eb\") " pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:25.088505 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.088468    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-5tpgv"]
Jul 24 14:34:25.091939 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.091917    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:25.095348 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.095328    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hv5xg\""
Jul 24 14:34:25.095465 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.095333    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 14:34:25.104718 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.104693    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-5tpgv"]
Jul 24 14:34:25.139976 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.139940    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7d2d37a-9bb7-4c9e-987b-3291a3a49661-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-5tpgv\" (UID: \"c7d2d37a-9bb7-4c9e-987b-3291a3a49661\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:25.140182 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.140013    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwgb\" (UniqueName: \"kubernetes.io/projected/c7d2d37a-9bb7-4c9e-987b-3291a3a49661-kube-api-access-mgwgb\") pod \"payload-processing-5cc6cd444b-5tpgv\" (UID: \"c7d2d37a-9bb7-4c9e-987b-3291a3a49661\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:25.241161 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.241127    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwgb\" (UniqueName: \"kubernetes.io/projected/c7d2d37a-9bb7-4c9e-987b-3291a3a49661-kube-api-access-mgwgb\") pod \"payload-processing-5cc6cd444b-5tpgv\" (UID: \"c7d2d37a-9bb7-4c9e-987b-3291a3a49661\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:25.241360 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.241195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7d2d37a-9bb7-4c9e-987b-3291a3a49661-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-5tpgv\" (UID: \"c7d2d37a-9bb7-4c9e-987b-3291a3a49661\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:25.241864 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.241843    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7d2d37a-9bb7-4c9e-987b-3291a3a49661-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-5tpgv\" (UID: \"c7d2d37a-9bb7-4c9e-987b-3291a3a49661\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:25.251249 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.251210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwgb\" (UniqueName: \"kubernetes.io/projected/c7d2d37a-9bb7-4c9e-987b-3291a3a49661-kube-api-access-mgwgb\") pod \"payload-processing-5cc6cd444b-5tpgv\" (UID: \"c7d2d37a-9bb7-4c9e-987b-3291a3a49661\") " pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:25.275875 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.275839    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:25.402662 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.402632    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:25.414984 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.414956    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"]
Jul 24 14:34:25.416010 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:34:25.415982    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c300f6_e1d9_4638_8de3_ec0442aff5eb.slice/crio-43c2499e4ef84201866fc85c616a96caa72d1e7a579db9c7f83db878caf6ba7e WatchSource:0}: Error finding container 43c2499e4ef84201866fc85c616a96caa72d1e7a579db9c7f83db878caf6ba7e: Status 404 returned error can't find the container with id 43c2499e4ef84201866fc85c616a96caa72d1e7a579db9c7f83db878caf6ba7e
Jul 24 14:34:25.417289 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.417271    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:34:25.542930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.542901    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-5tpgv"]
Jul 24 14:34:25.544647 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:34:25.544622    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d2d37a_9bb7_4c9e_987b_3291a3a49661.slice/crio-a42fd6e07593d74fdeebfac83e17624d20f8fcf9517fed44e436598ec0673a54 WatchSource:0}: Error finding container a42fd6e07593d74fdeebfac83e17624d20f8fcf9517fed44e436598ec0673a54: Status 404 returned error can't find the container with id a42fd6e07593d74fdeebfac83e17624d20f8fcf9517fed44e436598ec0673a54
Jul 24 14:34:25.745738 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.745701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv" event={"ID":"c7d2d37a-9bb7-4c9e-987b-3291a3a49661","Type":"ContainerStarted","Data":"a42fd6e07593d74fdeebfac83e17624d20f8fcf9517fed44e436598ec0673a54"}
Jul 24 14:34:25.746973 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:25.746950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7" event={"ID":"b1c300f6-e1d9-4638-8de3-ec0442aff5eb","Type":"ContainerStarted","Data":"43c2499e4ef84201866fc85c616a96caa72d1e7a579db9c7f83db878caf6ba7e"}
Jul 24 14:34:27.761593 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:27.761530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7" event={"ID":"b1c300f6-e1d9-4638-8de3-ec0442aff5eb","Type":"ContainerStarted","Data":"2b640eabf96d1271c7cab857c8e76527971d24524597a5760a34bb0b4fe72396"}
Jul 24 14:34:27.762096 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:27.761613    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:27.763285 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:27.763252    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv" event={"ID":"c7d2d37a-9bb7-4c9e-987b-3291a3a49661","Type":"ContainerStarted","Data":"389cb0bd2860e0ecbc872df08616baedfa588bb0ba53127c9cda8f283fc9f1c7"}
Jul 24 14:34:27.763427 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:27.763357    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:27.782567 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:27.782513    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7" podStartSLOduration=1.8591063289999998 podStartE2EDuration="3.782496341s" totalImagesPullingTime="1.923390012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:27.780544417 +0000 UTC m=+734.222294935" watchObservedRunningTime="2026-07-24 14:34:27.782496341 +0000 UTC m=+734.224246860"
Jul 24 14:34:27.803074 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:27.802999    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv" podStartSLOduration=1.002887001 podStartE2EDuration="2.802983573s" totalImagesPullingTime="1.800096572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:27.801139907 +0000 UTC m=+734.242890431" watchObservedRunningTime="2026-07-24 14:34:27.802983573 +0000 UTC m=+734.244734093"
Jul 24 14:34:33.774258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:33.774227    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-77cc5bc5d-8k4c7"
Jul 24 14:34:38.770586 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:38.770543    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-5tpgv"
Jul 24 14:34:52.454900 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.454865    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"]
Jul 24 14:34:52.458172 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.458144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.460847 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.460824    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 14:34:52.460961 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.460833    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 14:34:52.461753 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.461738    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 14:34:52.461834 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.461786    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fcprz\""
Jul 24 14:34:52.470995 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.470969    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"]
Jul 24 14:34:52.484544 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.484517    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzdcd\" (UniqueName: \"kubernetes.io/projected/8a720ab6-8fbc-4681-a401-6a1d315a498d-kube-api-access-tzdcd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.484697 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.484549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.484697 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.484653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.484792 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.484698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.484792 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.484750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.484792 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.484774    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a720ab6-8fbc-4681-a401-6a1d315a498d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.585829 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.585798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzdcd\" (UniqueName: \"kubernetes.io/projected/8a720ab6-8fbc-4681-a401-6a1d315a498d-kube-api-access-tzdcd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.585829 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.585834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.586097 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.585877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.586097 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.585903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.586097 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.585929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.586097 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.585947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a720ab6-8fbc-4681-a401-6a1d315a498d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.586374 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.586354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.586442 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.586380    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.586442 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.586425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.588096 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.588068    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a720ab6-8fbc-4681-a401-6a1d315a498d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.588405 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.588385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a720ab6-8fbc-4681-a401-6a1d315a498d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.594471 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.594452    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzdcd\" (UniqueName: \"kubernetes.io/projected/8a720ab6-8fbc-4681-a401-6a1d315a498d-kube-api-access-tzdcd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9\" (UID: \"8a720ab6-8fbc-4681-a401-6a1d315a498d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.768585 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.768487    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:34:52.906935 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:52.906907    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"]
Jul 24 14:34:52.908700 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:34:52.908673    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a720ab6_8fbc_4681_a401_6a1d315a498d.slice/crio-f0c287a93960c2f32da7450a48e82d3aae1da372c1bccb7fe96ac9db05c0d0d4 WatchSource:0}: Error finding container f0c287a93960c2f32da7450a48e82d3aae1da372c1bccb7fe96ac9db05c0d0d4: Status 404 returned error can't find the container with id f0c287a93960c2f32da7450a48e82d3aae1da372c1bccb7fe96ac9db05c0d0d4
Jul 24 14:34:53.892413 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:53.892363    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9" event={"ID":"8a720ab6-8fbc-4681-a401-6a1d315a498d","Type":"ContainerStarted","Data":"f0c287a93960c2f32da7450a48e82d3aae1da372c1bccb7fe96ac9db05c0d0d4"}
Jul 24 14:34:54.899210 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:54.899174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9" event={"ID":"8a720ab6-8fbc-4681-a401-6a1d315a498d","Type":"ContainerStarted","Data":"7d1072d0c613251681525f21825382bdd4d0a58618b82b182cdf626e7ba54120"}
Jul 24 14:34:54.931332 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:34:54.931275    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9" podStartSLOduration=1.59927745 podStartE2EDuration="2.93125981s" totalImagesPullingTime="1.33198236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:54.929837315 +0000 UTC m=+761.371587848" watchObservedRunningTime="2026-07-24 14:34:54.93125981 +0000 UTC m=+761.373010328"
Jul 24 14:35:02.768804 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:02.768746    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:35:02.769337 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:02.768826    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:35:02.781688 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:02.781657    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:35:02.948525 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:02.948496    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9"
Jul 24 14:35:29.364347 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.364313    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"]
Jul 24 14:35:29.367551 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.367525    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.370131 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.370112    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 14:35:29.379827 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.379804    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"]
Jul 24 14:35:29.505715 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.505677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgzft\" (UniqueName: \"kubernetes.io/projected/bf5f6697-e3be-4468-b461-8e6de05a491b-kube-api-access-rgzft\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.505715 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.505719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5f6697-e3be-4468-b461-8e6de05a491b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.505930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.505765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.505930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.505809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.505930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.505839    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.505930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.505875    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.606998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.606960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzft\" (UniqueName: \"kubernetes.io/projected/bf5f6697-e3be-4468-b461-8e6de05a491b-kube-api-access-rgzft\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.606998 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.607004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5f6697-e3be-4468-b461-8e6de05a491b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.607258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.607086    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.607258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.607114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.607258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.607142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.607258 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.607181    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.607536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.607510    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.607573 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.607531    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.607655 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.607638    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.609495 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.609473    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5f6697-e3be-4468-b461-8e6de05a491b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.610327 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.610310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5f6697-e3be-4468-b461-8e6de05a491b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.619955 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.619889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgzft\" (UniqueName: \"kubernetes.io/projected/bf5f6697-e3be-4468-b461-8e6de05a491b-kube-api-access-rgzft\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m\" (UID: \"bf5f6697-e3be-4468-b461-8e6de05a491b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.678220 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.678177    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:29.811822 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:29.811796    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"]
Jul 24 14:35:29.813499 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:35:29.813469    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5f6697_e3be_4468_b461_8e6de05a491b.slice/crio-0c749dcb92b9b88309c7527793067819445015d4126d6131389c9e327b366eb6 WatchSource:0}: Error finding container 0c749dcb92b9b88309c7527793067819445015d4126d6131389c9e327b366eb6: Status 404 returned error can't find the container with id 0c749dcb92b9b88309c7527793067819445015d4126d6131389c9e327b366eb6
Jul 24 14:35:30.071291 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:30.071252    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m" event={"ID":"bf5f6697-e3be-4468-b461-8e6de05a491b","Type":"ContainerStarted","Data":"e939e65cd6b1d26217c1e685356a5eb6ce515211120c8d2481ab3ca0bc541d4d"}
Jul 24 14:35:30.071473 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:30.071304    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m" event={"ID":"bf5f6697-e3be-4468-b461-8e6de05a491b","Type":"ContainerStarted","Data":"0c749dcb92b9b88309c7527793067819445015d4126d6131389c9e327b366eb6"}
Jul 24 14:35:30.093365 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:30.093307    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m" podStartSLOduration=0.903812293 podStartE2EDuration="1.093288056s" totalImagesPullingTime="189.475763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:30.091580066 +0000 UTC m=+796.533330595" watchObservedRunningTime="2026-07-24 14:35:30.093288056 +0000 UTC m=+796.535038576"
Jul 24 14:35:39.678755 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:39.678650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:39.678755 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:39.678762    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:39.691449 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:39.691423    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:35:40.131835 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:35:40.131755    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m"
Jul 24 14:37:14.788103 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:14.788063    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-fx88n"]
Jul 24 14:37:14.788588 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:14.788315    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6946c9fc55-fx88n" podUID="4689ce0e-1bc9-4ef7-9579-059753f7a7a0" containerName="manager" containerID="cri-o://65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4" gracePeriod=30
Jul 24 14:37:15.026010 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.025981    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:37:15.103316 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.103235    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-webhook-cert\") pod \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\" (UID: \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\") "
Jul 24 14:37:15.103484 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.103404    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z8t4\" (UniqueName: \"kubernetes.io/projected/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-kube-api-access-6z8t4\") pod \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\" (UID: \"4689ce0e-1bc9-4ef7-9579-059753f7a7a0\") "
Jul 24 14:37:15.105449 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.105417    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-kube-api-access-6z8t4" (OuterVolumeSpecName: "kube-api-access-6z8t4") pod "4689ce0e-1bc9-4ef7-9579-059753f7a7a0" (UID: "4689ce0e-1bc9-4ef7-9579-059753f7a7a0"). InnerVolumeSpecName "kube-api-access-6z8t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:37:15.105449 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.105443    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4689ce0e-1bc9-4ef7-9579-059753f7a7a0" (UID: "4689ce0e-1bc9-4ef7-9579-059753f7a7a0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:37:15.204354 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.204327    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z8t4\" (UniqueName: \"kubernetes.io/projected/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-kube-api-access-6z8t4\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:37:15.204354 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.204353    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4689ce0e-1bc9-4ef7-9579-059753f7a7a0-webhook-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:37:15.593583 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.593549    2574 generic.go:356] "Generic (PLEG): container finished" podID="4689ce0e-1bc9-4ef7-9579-059753f7a7a0" containerID="65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4" exitCode=0
Jul 24 14:37:15.593787 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.593611    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-fx88n"
Jul 24 14:37:15.593787 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.593637    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-fx88n" event={"ID":"4689ce0e-1bc9-4ef7-9579-059753f7a7a0","Type":"ContainerDied","Data":"65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4"}
Jul 24 14:37:15.593787 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.593725    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-fx88n" event={"ID":"4689ce0e-1bc9-4ef7-9579-059753f7a7a0","Type":"ContainerDied","Data":"dcbd6a922dfa8d7ac9fce606b6fcdfead91f9ed1775e31aa4caa76b3291da70d"}
Jul 24 14:37:15.593787 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.593755    2574 scope.go:117] "RemoveContainer" containerID="65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4"
Jul 24 14:37:15.603180 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.603160    2574 scope.go:117] "RemoveContainer" containerID="65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4"
Jul 24 14:37:15.603443 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:37:15.603425    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4\": container with ID starting with 65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4 not found: ID does not exist" containerID="65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4"
Jul 24 14:37:15.603492 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.603453    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4"} err="failed to get container status \"65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4\": rpc error: code = NotFound desc = could not find container \"65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4\": container with ID starting with 65c8e8110209ca1ad71db9bac0a9e349e38134814f2085e190ae5846181dcad4 not found: ID does not exist"
Jul 24 14:37:15.626915 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.626888    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-fx88n"]
Jul 24 14:37:15.635906 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:15.635882    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-fx88n"]
Jul 24 14:37:16.018671 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:37:16.018635    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4689ce0e-1bc9-4ef7-9579-059753f7a7a0" path="/var/lib/kubelet/pods/4689ce0e-1bc9-4ef7-9579-059753f7a7a0/volumes"
Jul 24 14:38:16.570593 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.570554    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6946c9fc55-xgrbb"]
Jul 24 14:38:16.570992 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.570895    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4689ce0e-1bc9-4ef7-9579-059753f7a7a0" containerName="manager"
Jul 24 14:38:16.570992 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.570907    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4689ce0e-1bc9-4ef7-9579-059753f7a7a0" containerName="manager"
Jul 24 14:38:16.570992 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.570959    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4689ce0e-1bc9-4ef7-9579-059753f7a7a0" containerName="manager"
Jul 24 14:38:16.573555 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.573538    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:16.582783 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.582759    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:38:16.583517 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.583501    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s5p4r\""
Jul 24 14:38:16.583619 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.583506    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:38:16.591512 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.591488    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-xgrbb"]
Jul 24 14:38:16.607722 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.607691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef1e185-0ce6-408e-b328-da3c32db3525-webhook-cert\") pod \"maas-controller-6946c9fc55-xgrbb\" (UID: \"1ef1e185-0ce6-408e-b328-da3c32db3525\") " pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:16.607868 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.607755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twbkn\" (UniqueName: \"kubernetes.io/projected/1ef1e185-0ce6-408e-b328-da3c32db3525-kube-api-access-twbkn\") pod \"maas-controller-6946c9fc55-xgrbb\" (UID: \"1ef1e185-0ce6-408e-b328-da3c32db3525\") " pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:16.709157 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.709117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twbkn\" (UniqueName: \"kubernetes.io/projected/1ef1e185-0ce6-408e-b328-da3c32db3525-kube-api-access-twbkn\") pod \"maas-controller-6946c9fc55-xgrbb\" (UID: \"1ef1e185-0ce6-408e-b328-da3c32db3525\") " pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:16.709344 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.709186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef1e185-0ce6-408e-b328-da3c32db3525-webhook-cert\") pod \"maas-controller-6946c9fc55-xgrbb\" (UID: \"1ef1e185-0ce6-408e-b328-da3c32db3525\") " pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:16.711552 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.711524    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef1e185-0ce6-408e-b328-da3c32db3525-webhook-cert\") pod \"maas-controller-6946c9fc55-xgrbb\" (UID: \"1ef1e185-0ce6-408e-b328-da3c32db3525\") " pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:16.726671 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.726646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twbkn\" (UniqueName: \"kubernetes.io/projected/1ef1e185-0ce6-408e-b328-da3c32db3525-kube-api-access-twbkn\") pod \"maas-controller-6946c9fc55-xgrbb\" (UID: \"1ef1e185-0ce6-408e-b328-da3c32db3525\") " pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:16.883293 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:16.883194    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:17.023451 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:17.023421    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-xgrbb"]
Jul 24 14:38:17.026650 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:38:17.026628    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef1e185_0ce6_408e_b328_da3c32db3525.slice/crio-256aa1f34074c0f515c9aebba95bb301e12406c00dbd19343acaa88cab4dc267 WatchSource:0}: Error finding container 256aa1f34074c0f515c9aebba95bb301e12406c00dbd19343acaa88cab4dc267: Status 404 returned error can't find the container with id 256aa1f34074c0f515c9aebba95bb301e12406c00dbd19343acaa88cab4dc267
Jul 24 14:38:17.905728 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:17.905632    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-xgrbb" event={"ID":"1ef1e185-0ce6-408e-b328-da3c32db3525","Type":"ContainerStarted","Data":"b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781"}
Jul 24 14:38:17.905728 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:17.905693    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-xgrbb" event={"ID":"1ef1e185-0ce6-408e-b328-da3c32db3525","Type":"ContainerStarted","Data":"256aa1f34074c0f515c9aebba95bb301e12406c00dbd19343acaa88cab4dc267"}
Jul 24 14:38:17.905728 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:17.905722    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:17.937996 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:17.937945    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6946c9fc55-xgrbb" podStartSLOduration=1.512979825 podStartE2EDuration="1.937928228s" totalImagesPullingTime="424.948403ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:17.936211554 +0000 UTC m=+964.377962073" watchObservedRunningTime="2026-07-24 14:38:17.937928228 +0000 UTC m=+964.379678758"
Jul 24 14:38:28.912010 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:28.911978    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:33.639591 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.639557    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-xgrbb"]
Jul 24 14:38:33.640107 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.639755    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6946c9fc55-xgrbb" podUID="1ef1e185-0ce6-408e-b328-da3c32db3525" containerName="manager" containerID="cri-o://b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781" gracePeriod=30
Jul 24 14:38:33.885209 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.885186    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:33.949282 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.949256    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef1e185-0ce6-408e-b328-da3c32db3525-webhook-cert\") pod \"1ef1e185-0ce6-408e-b328-da3c32db3525\" (UID: \"1ef1e185-0ce6-408e-b328-da3c32db3525\") "
Jul 24 14:38:33.949477 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.949305    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twbkn\" (UniqueName: \"kubernetes.io/projected/1ef1e185-0ce6-408e-b328-da3c32db3525-kube-api-access-twbkn\") pod \"1ef1e185-0ce6-408e-b328-da3c32db3525\" (UID: \"1ef1e185-0ce6-408e-b328-da3c32db3525\") "
Jul 24 14:38:33.951425 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.951395    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ef1e185-0ce6-408e-b328-da3c32db3525-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1ef1e185-0ce6-408e-b328-da3c32db3525" (UID: "1ef1e185-0ce6-408e-b328-da3c32db3525"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:38:33.951536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.951479    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ef1e185-0ce6-408e-b328-da3c32db3525-kube-api-access-twbkn" (OuterVolumeSpecName: "kube-api-access-twbkn") pod "1ef1e185-0ce6-408e-b328-da3c32db3525" (UID: "1ef1e185-0ce6-408e-b328-da3c32db3525"). InnerVolumeSpecName "kube-api-access-twbkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:33.985180 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.985151    2574 generic.go:356] "Generic (PLEG): container finished" podID="1ef1e185-0ce6-408e-b328-da3c32db3525" containerID="b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781" exitCode=0
Jul 24 14:38:33.985336 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.985202    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-xgrbb"
Jul 24 14:38:33.985336 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.985235    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-xgrbb" event={"ID":"1ef1e185-0ce6-408e-b328-da3c32db3525","Type":"ContainerDied","Data":"b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781"}
Jul 24 14:38:33.985336 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.985287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-xgrbb" event={"ID":"1ef1e185-0ce6-408e-b328-da3c32db3525","Type":"ContainerDied","Data":"256aa1f34074c0f515c9aebba95bb301e12406c00dbd19343acaa88cab4dc267"}
Jul 24 14:38:33.985336 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.985314    2574 scope.go:117] "RemoveContainer" containerID="b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781"
Jul 24 14:38:33.994296 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.994277    2574 scope.go:117] "RemoveContainer" containerID="b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781"
Jul 24 14:38:33.994552 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:38:33.994530    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781\": container with ID starting with b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781 not found: ID does not exist" containerID="b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781"
Jul 24 14:38:33.994617 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:33.994562    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781"} err="failed to get container status \"b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781\": rpc error: code = NotFound desc = could not find container \"b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781\": container with ID starting with b3cefeb8ed6fe9ed9a1374a9ba15afcbe7fe171a6a9a8892bac6342fb9bee781 not found: ID does not exist"
Jul 24 14:38:34.009391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.009363    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-xgrbb"]
Jul 24 14:38:34.016895 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.016856    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-xgrbb"]
Jul 24 14:38:34.022922 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.022897    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ef1e185-0ce6-408e-b328-da3c32db3525" path="/var/lib/kubelet/pods/1ef1e185-0ce6-408e-b328-da3c32db3525/volumes"
Jul 24 14:38:34.050481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.050451    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef1e185-0ce6-408e-b328-da3c32db3525-webhook-cert\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:38:34.050481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.050479    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twbkn\" (UniqueName: \"kubernetes.io/projected/1ef1e185-0ce6-408e-b328-da3c32db3525-kube-api-access-twbkn\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:38:34.873562 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.873532    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6946c9fc55-npzz2"]
Jul 24 14:38:34.873938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.873849    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ef1e185-0ce6-408e-b328-da3c32db3525" containerName="manager"
Jul 24 14:38:34.873938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.873859    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ef1e185-0ce6-408e-b328-da3c32db3525" containerName="manager"
Jul 24 14:38:34.873938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.873918    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ef1e185-0ce6-408e-b328-da3c32db3525" containerName="manager"
Jul 24 14:38:34.876547 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.876530    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:34.880012 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.879996    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s5p4r\""
Jul 24 14:38:34.880080 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.880010    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:38:34.880080 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.880010    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:38:34.890017 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.889993    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-npzz2"]
Jul 24 14:38:34.956816 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.956783    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffc757c4-4d1e-4a76-a517-8d53652bde44-webhook-cert\") pod \"maas-controller-6946c9fc55-npzz2\" (UID: \"ffc757c4-4d1e-4a76-a517-8d53652bde44\") " pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:34.956816 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:34.956819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q44w4\" (UniqueName: \"kubernetes.io/projected/ffc757c4-4d1e-4a76-a517-8d53652bde44-kube-api-access-q44w4\") pod \"maas-controller-6946c9fc55-npzz2\" (UID: \"ffc757c4-4d1e-4a76-a517-8d53652bde44\") " pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:35.057703 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.057670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffc757c4-4d1e-4a76-a517-8d53652bde44-webhook-cert\") pod \"maas-controller-6946c9fc55-npzz2\" (UID: \"ffc757c4-4d1e-4a76-a517-8d53652bde44\") " pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:35.057703 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.057703    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q44w4\" (UniqueName: \"kubernetes.io/projected/ffc757c4-4d1e-4a76-a517-8d53652bde44-kube-api-access-q44w4\") pod \"maas-controller-6946c9fc55-npzz2\" (UID: \"ffc757c4-4d1e-4a76-a517-8d53652bde44\") " pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:35.060134 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.060110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffc757c4-4d1e-4a76-a517-8d53652bde44-webhook-cert\") pod \"maas-controller-6946c9fc55-npzz2\" (UID: \"ffc757c4-4d1e-4a76-a517-8d53652bde44\") " pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:35.068509 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.068483    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q44w4\" (UniqueName: \"kubernetes.io/projected/ffc757c4-4d1e-4a76-a517-8d53652bde44-kube-api-access-q44w4\") pod \"maas-controller-6946c9fc55-npzz2\" (UID: \"ffc757c4-4d1e-4a76-a517-8d53652bde44\") " pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:35.185765 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.185732    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:35.325393 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.325365    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6946c9fc55-npzz2"]
Jul 24 14:38:35.327234 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:38:35.327209    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc757c4_4d1e_4a76_a517_8d53652bde44.slice/crio-7916c40ce2615ece947316d7199ec54ff2cee18124040fb359a2815c37fc4be3 WatchSource:0}: Error finding container 7916c40ce2615ece947316d7199ec54ff2cee18124040fb359a2815c37fc4be3: Status 404 returned error can't find the container with id 7916c40ce2615ece947316d7199ec54ff2cee18124040fb359a2815c37fc4be3
Jul 24 14:38:35.997794 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.997756    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-npzz2" event={"ID":"ffc757c4-4d1e-4a76-a517-8d53652bde44","Type":"ContainerStarted","Data":"fd6cf3264c95eaa29698d6155f9b25258ecc1bf1abc7e5ac2846067aebf389f5"}
Jul 24 14:38:35.998315 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.997813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6946c9fc55-npzz2" event={"ID":"ffc757c4-4d1e-4a76-a517-8d53652bde44","Type":"ContainerStarted","Data":"7916c40ce2615ece947316d7199ec54ff2cee18124040fb359a2815c37fc4be3"}
Jul 24 14:38:35.998315 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:35.997873    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:38:36.025969 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:36.025917    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6946c9fc55-npzz2" podStartSLOduration=1.569333514 podStartE2EDuration="2.025900386s" totalImagesPullingTime="456.566872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:36.0241296 +0000 UTC m=+982.465880119" watchObservedRunningTime="2026-07-24 14:38:36.025900386 +0000 UTC m=+982.467650905"
Jul 24 14:38:47.005619 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:38:47.005587    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6946c9fc55-npzz2"
Jul 24 14:47:22.060045 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.059986    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"]
Jul 24 14:47:22.066352 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.066328    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.070652 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.070620    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-e842d7f9-kserve-self-signed-certs\""
Jul 24 14:47:22.077286 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.077253    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"]
Jul 24 14:47:22.210873 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.210839    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-model-cache\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.210873 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.210873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd08d12e-acec-402a-a059-9935c6929a4c-tls-certs\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.211159 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.210911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-tmp-dir\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.211159 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.211000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-home\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.211159 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.211045    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwd6l\" (UniqueName: \"kubernetes.io/projected/dd08d12e-acec-402a-a059-9935c6929a4c-kube-api-access-jwd6l\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.211159 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.211078    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-dshm\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312453 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-model-cache\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312453 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd08d12e-acec-402a-a059-9935c6929a4c-tls-certs\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312692 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312531    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-tmp-dir\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312692 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-home\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312692 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwd6l\" (UniqueName: \"kubernetes.io/projected/dd08d12e-acec-402a-a059-9935c6929a4c-kube-api-access-jwd6l\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312856 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312797    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-dshm\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312856 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312835    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-model-cache\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312981 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312871    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-tmp-dir\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.312981 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.312941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-home\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.314856 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.314828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-dshm\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.315007 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.314970    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd08d12e-acec-402a-a059-9935c6929a4c-tls-certs\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.323307 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.323285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwd6l\" (UniqueName: \"kubernetes.io/projected/dd08d12e-acec-402a-a059-9935c6929a4c-kube-api-access-jwd6l\") pod \"e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") " pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.377700 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.377664    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:22.517623 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.517598    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"]
Jul 24 14:47:22.518911 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:47:22.518876    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd08d12e_acec_402a_a059_9935c6929a4c.slice/crio-8ebea4c3883941f3ab332aecc0fd188a6c84a4ade03b86b6591ef4e6428a47d2 WatchSource:0}: Error finding container 8ebea4c3883941f3ab332aecc0fd188a6c84a4ade03b86b6591ef4e6428a47d2: Status 404 returned error can't find the container with id 8ebea4c3883941f3ab332aecc0fd188a6c84a4ade03b86b6591ef4e6428a47d2
Jul 24 14:47:22.604133 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.604097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp" event={"ID":"dd08d12e-acec-402a-a059-9935c6929a4c","Type":"ContainerStarted","Data":"03988c55eba46a3359d61cdd28f3c5602657a0fa34deb67e96227c99358eb505"}
Jul 24 14:47:22.604313 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.604147    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp" event={"ID":"dd08d12e-acec-402a-a059-9935c6929a4c","Type":"ContainerStarted","Data":"8ebea4c3883941f3ab332aecc0fd188a6c84a4ade03b86b6591ef4e6428a47d2"}
Jul 24 14:47:22.626928 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:22.626875    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp" podStartSLOduration=0.626856813 podStartE2EDuration="626.856813ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:47:22.625756385 +0000 UTC m=+1509.067506934" watchObservedRunningTime="2026-07-24 14:47:22.626856813 +0000 UTC m=+1509.068607369"
Jul 24 14:47:32.377946 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:32.377903    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:32.378385 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:32.377973    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:32.390435 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:32.390409    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:32.665492 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:32.665406    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:40.540389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:40.540297    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"]
Jul 24 14:47:55.559536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.559465    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp" podUID="dd08d12e-acec-402a-a059-9935c6929a4c" containerName="main" containerID="cri-o://03988c55eba46a3359d61cdd28f3c5602657a0fa34deb67e96227c99358eb505" gracePeriod=45
Jul 24 14:47:55.772582 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.772553    2574 generic.go:356] "Generic (PLEG): container finished" podID="dd08d12e-acec-402a-a059-9935c6929a4c" containerID="03988c55eba46a3359d61cdd28f3c5602657a0fa34deb67e96227c99358eb505" exitCode=0
Jul 24 14:47:55.772733 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.772591    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp" event={"ID":"dd08d12e-acec-402a-a059-9935c6929a4c","Type":"ContainerDied","Data":"03988c55eba46a3359d61cdd28f3c5602657a0fa34deb67e96227c99358eb505"}
Jul 24 14:47:55.811385 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.811322    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:55.914651 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914618    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd08d12e-acec-402a-a059-9935c6929a4c-tls-certs\") pod \"dd08d12e-acec-402a-a059-9935c6929a4c\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") "
Jul 24 14:47:55.914651 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914653    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-home\") pod \"dd08d12e-acec-402a-a059-9935c6929a4c\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") "
Jul 24 14:47:55.914906 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914672    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-model-cache\") pod \"dd08d12e-acec-402a-a059-9935c6929a4c\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") "
Jul 24 14:47:55.914906 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914690    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-tmp-dir\") pod \"dd08d12e-acec-402a-a059-9935c6929a4c\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") "
Jul 24 14:47:55.914906 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914710    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwd6l\" (UniqueName: \"kubernetes.io/projected/dd08d12e-acec-402a-a059-9935c6929a4c-kube-api-access-jwd6l\") pod \"dd08d12e-acec-402a-a059-9935c6929a4c\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") "
Jul 24 14:47:55.914906 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914773    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-dshm\") pod \"dd08d12e-acec-402a-a059-9935c6929a4c\" (UID: \"dd08d12e-acec-402a-a059-9935c6929a4c\") "
Jul 24 14:47:55.915147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914927    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd08d12e-acec-402a-a059-9935c6929a4c" (UID: "dd08d12e-acec-402a-a059-9935c6929a4c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:47:55.915147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914962    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-home" (OuterVolumeSpecName: "home") pod "dd08d12e-acec-402a-a059-9935c6929a4c" (UID: "dd08d12e-acec-402a-a059-9935c6929a4c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:47:55.915147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.914980    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd08d12e-acec-402a-a059-9935c6929a4c" (UID: "dd08d12e-acec-402a-a059-9935c6929a4c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:47:55.915147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.915077    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-home\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:47:55.915147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.915090    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-model-cache\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:47:55.915147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.915100    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-tmp-dir\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:47:55.917100 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.917072    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd08d12e-acec-402a-a059-9935c6929a4c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd08d12e-acec-402a-a059-9935c6929a4c" (UID: "dd08d12e-acec-402a-a059-9935c6929a4c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:47:55.917200 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.917078    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-dshm" (OuterVolumeSpecName: "dshm") pod "dd08d12e-acec-402a-a059-9935c6929a4c" (UID: "dd08d12e-acec-402a-a059-9935c6929a4c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:47:55.917200 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:55.917170    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd08d12e-acec-402a-a059-9935c6929a4c-kube-api-access-jwd6l" (OuterVolumeSpecName: "kube-api-access-jwd6l") pod "dd08d12e-acec-402a-a059-9935c6929a4c" (UID: "dd08d12e-acec-402a-a059-9935c6929a4c"). InnerVolumeSpecName "kube-api-access-jwd6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:47:56.015904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:56.015873    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd08d12e-acec-402a-a059-9935c6929a4c-dshm\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:47:56.015904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:56.015895    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd08d12e-acec-402a-a059-9935c6929a4c-tls-certs\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:47:56.015904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:56.015905    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwd6l\" (UniqueName: \"kubernetes.io/projected/dd08d12e-acec-402a-a059-9935c6929a4c-kube-api-access-jwd6l\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:47:56.779103 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:56.779073    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"
Jul 24 14:47:56.779103 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:56.779085    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp" event={"ID":"dd08d12e-acec-402a-a059-9935c6929a4c","Type":"ContainerDied","Data":"8ebea4c3883941f3ab332aecc0fd188a6c84a4ade03b86b6591ef4e6428a47d2"}
Jul 24 14:47:56.779601 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:56.779131    2574 scope.go:117] "RemoveContainer" containerID="03988c55eba46a3359d61cdd28f3c5602657a0fa34deb67e96227c99358eb505"
Jul 24 14:47:56.797125 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:56.797093    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"]
Jul 24 14:47:56.803895 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:56.803866    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-e842d7f9-kserve-f5975485f-4cqbp"]
Jul 24 14:47:58.018327 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:47:58.018288    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd08d12e-acec-402a-a059-9935c6929a4c" path="/var/lib/kubelet/pods/dd08d12e-acec-402a-a059-9935c6929a4c/volumes"
Jul 24 14:51:28.010380 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.010351    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"]
Jul 24 14:51:28.012589 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.010666    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd08d12e-acec-402a-a059-9935c6929a4c" containerName="main"
Jul 24 14:51:28.012589 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.010676    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd08d12e-acec-402a-a059-9935c6929a4c" containerName="main"
Jul 24 14:51:28.012589 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.010740    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd08d12e-acec-402a-a059-9935c6929a4c" containerName="main"
Jul 24 14:51:28.013549 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.013527    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.016455 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.016422    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2e2d5bdd-serving-cert\""
Jul 24 14:51:28.016586 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.016475    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 14:51:28.030534 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.030504    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"]
Jul 24 14:51:28.077977 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.077944    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9919edcb-248a-455b-856d-73c730b24125-openshift-service-ca\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.078188 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.078022    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.078188 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.078104    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhv2h\" (UniqueName: \"kubernetes.io/projected/9919edcb-248a-455b-856d-73c730b24125-kube-api-access-bhv2h\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.178985 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.178941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.179236 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.179009    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhv2h\" (UniqueName: \"kubernetes.io/projected/9919edcb-248a-455b-856d-73c730b24125-kube-api-access-bhv2h\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.179236 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.179093    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9919edcb-248a-455b-856d-73c730b24125-openshift-service-ca\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.179236 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:51:28.179130    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-serving-cert: secret "maas-api-e2e-ait-2e2d5bdd-serving-cert" not found
Jul 24 14:51:28.179236 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:51:28.179205    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls podName:9919edcb-248a-455b-856d-73c730b24125 nodeName:}" failed. No retries permitted until 2026-07-24 14:51:28.679186508 +0000 UTC m=+1755.120937008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls") pod "maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65" (UID: "9919edcb-248a-455b-856d-73c730b24125") : secret "maas-api-e2e-ait-2e2d5bdd-serving-cert" not found
Jul 24 14:51:28.179765 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.179741    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9919edcb-248a-455b-856d-73c730b24125-openshift-service-ca\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.192442 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.192416    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhv2h\" (UniqueName: \"kubernetes.io/projected/9919edcb-248a-455b-856d-73c730b24125-kube-api-access-bhv2h\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.683592 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.683557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.685984 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.685960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls\") pod \"maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:28.923881 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:28.923849    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:29.076721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.076677    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"]
Jul 24 14:51:29.078967 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:51:29.078938    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9919edcb_248a_455b_856d_73c730b24125.slice/crio-4a1cb918c06a4f937d2608045a56f4825926ee09c7b64edd172ecb7a9d2b7769 WatchSource:0}: Error finding container 4a1cb918c06a4f937d2608045a56f4825926ee09c7b64edd172ecb7a9d2b7769: Status 404 returned error can't find the container with id 4a1cb918c06a4f937d2608045a56f4825926ee09c7b64edd172ecb7a9d2b7769
Jul 24 14:51:29.080207 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.080188    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:51:29.142978 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.142947    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"]
Jul 24 14:51:29.147326 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.147310    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.150869 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.150839    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2e2d5bdd\""
Jul 24 14:51:29.151021 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.150886    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2e2d5bdd-dockercfg-g8mmc\""
Jul 24 14:51:29.169968 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.169934    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"]
Jul 24 14:51:29.289887 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.289780    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx\" (UID: \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.289887 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.289858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv2d9\" (UniqueName: \"kubernetes.io/projected/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-kube-api-access-wv2d9\") pod \"payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx\" (UID: \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.390564 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.390525    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv2d9\" (UniqueName: \"kubernetes.io/projected/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-kube-api-access-wv2d9\") pod \"payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx\" (UID: \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.390751 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.390613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx\" (UID: \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.391410 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.391391    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx\" (UID: \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.402193 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.402171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv2d9\" (UniqueName: \"kubernetes.io/projected/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-kube-api-access-wv2d9\") pod \"payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx\" (UID: \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.458151 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.458107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.607719 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.607698    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"]
Jul 24 14:51:29.610077 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:51:29.610048    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e293ed_74f1_4f9e_8579_8ac8515af9c2.slice/crio-f10bbf2aa2b18edcb8d0855d3cdb3e0e4ddba89d32cd84ee6bbefe1bce0424cb WatchSource:0}: Error finding container f10bbf2aa2b18edcb8d0855d3cdb3e0e4ddba89d32cd84ee6bbefe1bce0424cb: Status 404 returned error can't find the container with id f10bbf2aa2b18edcb8d0855d3cdb3e0e4ddba89d32cd84ee6bbefe1bce0424cb
Jul 24 14:51:29.836060 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.835948    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx" event={"ID":"a3e293ed-74f1-4f9e-8579-8ac8515af9c2","Type":"ContainerStarted","Data":"475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0"}
Jul 24 14:51:29.836060 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.836001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx" event={"ID":"a3e293ed-74f1-4f9e-8579-8ac8515af9c2","Type":"ContainerStarted","Data":"f10bbf2aa2b18edcb8d0855d3cdb3e0e4ddba89d32cd84ee6bbefe1bce0424cb"}
Jul 24 14:51:29.836295 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.836124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:51:29.837556 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.837526    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65" event={"ID":"9919edcb-248a-455b-856d-73c730b24125","Type":"ContainerStarted","Data":"85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf"}
Jul 24 14:51:29.837676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.837578    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65" event={"ID":"9919edcb-248a-455b-856d-73c730b24125","Type":"ContainerStarted","Data":"4a1cb918c06a4f937d2608045a56f4825926ee09c7b64edd172ecb7a9d2b7769"}
Jul 24 14:51:29.837676 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.837611    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:29.861418 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.861369    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx" podStartSLOduration=0.86135245 podStartE2EDuration="861.35245ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:51:29.859942753 +0000 UTC m=+1756.301693275" watchObservedRunningTime="2026-07-24 14:51:29.86135245 +0000 UTC m=+1756.303102968"
Jul 24 14:51:29.901462 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:29.901401    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65" podStartSLOduration=2.31139274 podStartE2EDuration="2.901377653s" totalImagesPullingTime="589.984913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:51:29.901327241 +0000 UTC m=+1756.343077761" watchObservedRunningTime="2026-07-24 14:51:29.901377653 +0000 UTC m=+1756.343128174"
Jul 24 14:51:35.847667 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:35.847639    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:51:40.844589 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:51:40.844556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:52:04.283208 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.283172    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"]
Jul 24 14:52:04.283797 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.283427    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65" podUID="9919edcb-248a-455b-856d-73c730b24125" containerName="maas-api" containerID="cri-o://85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf" gracePeriod=30
Jul 24 14:52:04.402649 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.402604    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"]
Jul 24 14:52:04.402936 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.402871    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx" podUID="a3e293ed-74f1-4f9e-8579-8ac8515af9c2" containerName="payload-processing" containerID="cri-o://475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0" gracePeriod=30
Jul 24 14:52:04.557951 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.557923    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:52:04.604297 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.604267    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9919edcb-248a-455b-856d-73c730b24125-openshift-service-ca\") pod \"9919edcb-248a-455b-856d-73c730b24125\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") "
Jul 24 14:52:04.604482 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.604370    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhv2h\" (UniqueName: \"kubernetes.io/projected/9919edcb-248a-455b-856d-73c730b24125-kube-api-access-bhv2h\") pod \"9919edcb-248a-455b-856d-73c730b24125\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") "
Jul 24 14:52:04.604482 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.604423    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls\") pod \"9919edcb-248a-455b-856d-73c730b24125\" (UID: \"9919edcb-248a-455b-856d-73c730b24125\") "
Jul 24 14:52:04.604620 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.604603    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9919edcb-248a-455b-856d-73c730b24125-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9919edcb-248a-455b-856d-73c730b24125" (UID: "9919edcb-248a-455b-856d-73c730b24125"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:52:04.604810 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.604786    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9919edcb-248a-455b-856d-73c730b24125-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:04.606692 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.606663    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9919edcb-248a-455b-856d-73c730b24125" (UID: "9919edcb-248a-455b-856d-73c730b24125"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:52:04.606780 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.606752    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9919edcb-248a-455b-856d-73c730b24125-kube-api-access-bhv2h" (OuterVolumeSpecName: "kube-api-access-bhv2h") pod "9919edcb-248a-455b-856d-73c730b24125" (UID: "9919edcb-248a-455b-856d-73c730b24125"). InnerVolumeSpecName "kube-api-access-bhv2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:52:04.666426 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.666396    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:52:04.705543 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.705507    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv2d9\" (UniqueName: \"kubernetes.io/projected/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-kube-api-access-wv2d9\") pod \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\" (UID: \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\") "
Jul 24 14:52:04.705718 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.705568    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-plugins-config-volume\") pod \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\" (UID: \"a3e293ed-74f1-4f9e-8579-8ac8515af9c2\") "
Jul 24 14:52:04.705961 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.705936    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhv2h\" (UniqueName: \"kubernetes.io/projected/9919edcb-248a-455b-856d-73c730b24125-kube-api-access-bhv2h\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:04.706102 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.705970    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9919edcb-248a-455b-856d-73c730b24125-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:04.706102 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.705936    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3e293ed-74f1-4f9e-8579-8ac8515af9c2" (UID: "a3e293ed-74f1-4f9e-8579-8ac8515af9c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:52:04.707657 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.707627    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-kube-api-access-wv2d9" (OuterVolumeSpecName: "kube-api-access-wv2d9") pod "a3e293ed-74f1-4f9e-8579-8ac8515af9c2" (UID: "a3e293ed-74f1-4f9e-8579-8ac8515af9c2"). InnerVolumeSpecName "kube-api-access-wv2d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:52:04.807115 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.807000    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv2d9\" (UniqueName: \"kubernetes.io/projected/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-kube-api-access-wv2d9\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:04.807115 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:04.807044    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e293ed-74f1-4f9e-8579-8ac8515af9c2-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:05.013480 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.013445    2574 generic.go:356] "Generic (PLEG): container finished" podID="a3e293ed-74f1-4f9e-8579-8ac8515af9c2" containerID="475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0" exitCode=0
Jul 24 14:52:05.013659 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.013485    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"
Jul 24 14:52:05.013659 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.013536    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx" event={"ID":"a3e293ed-74f1-4f9e-8579-8ac8515af9c2","Type":"ContainerDied","Data":"475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0"}
Jul 24 14:52:05.013659 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.013577    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx" event={"ID":"a3e293ed-74f1-4f9e-8579-8ac8515af9c2","Type":"ContainerDied","Data":"f10bbf2aa2b18edcb8d0855d3cdb3e0e4ddba89d32cd84ee6bbefe1bce0424cb"}
Jul 24 14:52:05.013659 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.013604    2574 scope.go:117] "RemoveContainer" containerID="475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0"
Jul 24 14:52:05.014865 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.014845    2574 generic.go:356] "Generic (PLEG): container finished" podID="9919edcb-248a-455b-856d-73c730b24125" containerID="85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf" exitCode=0
Jul 24 14:52:05.014940 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.014905    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"
Jul 24 14:52:05.014940 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.014928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65" event={"ID":"9919edcb-248a-455b-856d-73c730b24125","Type":"ContainerDied","Data":"85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf"}
Jul 24 14:52:05.015019 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.014968    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65" event={"ID":"9919edcb-248a-455b-856d-73c730b24125","Type":"ContainerDied","Data":"4a1cb918c06a4f937d2608045a56f4825926ee09c7b64edd172ecb7a9d2b7769"}
Jul 24 14:52:05.022416 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.022394    2574 scope.go:117] "RemoveContainer" containerID="475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0"
Jul 24 14:52:05.022747 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:52:05.022720    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0\": container with ID starting with 475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0 not found: ID does not exist" containerID="475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0"
Jul 24 14:52:05.022817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.022761    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0"} err="failed to get container status \"475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0\": rpc error: code = NotFound desc = could not find container \"475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0\": container with ID starting with 475bffeaa6d94d83bd1fb8c55e1dd0e3a0fa8ff5afd8dbac33c15942ab9088c0 not found: ID does not exist"
Jul 24 14:52:05.022817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.022786    2574 scope.go:117] "RemoveContainer" containerID="85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf"
Jul 24 14:52:05.031709 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.031691    2574 scope.go:117] "RemoveContainer" containerID="85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf"
Jul 24 14:52:05.031972 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:52:05.031950    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf\": container with ID starting with 85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf not found: ID does not exist" containerID="85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf"
Jul 24 14:52:05.032104 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.031977    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf"} err="failed to get container status \"85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf\": rpc error: code = NotFound desc = could not find container \"85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf\": container with ID starting with 85690cfc2e44479cd610d76d9e4ec0208259a88b4fe666caac18ae043e545bdf not found: ID does not exist"
Jul 24 14:52:05.042957 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.042930    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"]
Jul 24 14:52:05.050332 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.050303    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2e2d5bdd-6ff974797c-rhn65"]
Jul 24 14:52:05.063771 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.063687    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"]
Jul 24 14:52:05.071352 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:05.071256    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2e2d5bdd-67c9b78bd8-lrdwx"]
Jul 24 14:52:06.018996 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:06.018911    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9919edcb-248a-455b-856d-73c730b24125" path="/var/lib/kubelet/pods/9919edcb-248a-455b-856d-73c730b24125/volumes"
Jul 24 14:52:06.019463 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:06.019275    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3e293ed-74f1-4f9e-8579-8ac8515af9c2" path="/var/lib/kubelet/pods/a3e293ed-74f1-4f9e-8579-8ac8515af9c2/volumes"
Jul 24 14:52:13.727448 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.727417    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"]
Jul 24 14:52:13.727989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.727921    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e293ed-74f1-4f9e-8579-8ac8515af9c2" containerName="payload-processing"
Jul 24 14:52:13.727989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.727943    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e293ed-74f1-4f9e-8579-8ac8515af9c2" containerName="payload-processing"
Jul 24 14:52:13.727989 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.727983    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9919edcb-248a-455b-856d-73c730b24125" containerName="maas-api"
Jul 24 14:52:13.728189 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.727992    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9919edcb-248a-455b-856d-73c730b24125" containerName="maas-api"
Jul 24 14:52:13.728189 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.728093    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9919edcb-248a-455b-856d-73c730b24125" containerName="maas-api"
Jul 24 14:52:13.728189 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.728107    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3e293ed-74f1-4f9e-8579-8ac8515af9c2" containerName="payload-processing"
Jul 24 14:52:13.731239 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.731220    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.733614 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.733594    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 14:52:13.733884 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.733864    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-9671202b-serving-cert\""
Jul 24 14:52:13.753477 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.753452    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"]
Jul 24 14:52:13.782797 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.782758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qsx8\" (UniqueName: \"kubernetes.io/projected/34d9540a-8276-45fc-90a5-ec57c583e09e-kube-api-access-2qsx8\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.782973 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.782807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34d9540a-8276-45fc-90a5-ec57c583e09e-openshift-service-ca\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.783059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.782976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34d9540a-8276-45fc-90a5-ec57c583e09e-maas-api-tls\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.883689 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.883653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34d9540a-8276-45fc-90a5-ec57c583e09e-maas-api-tls\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.883689 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.883697    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qsx8\" (UniqueName: \"kubernetes.io/projected/34d9540a-8276-45fc-90a5-ec57c583e09e-kube-api-access-2qsx8\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.883923 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.883719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34d9540a-8276-45fc-90a5-ec57c583e09e-openshift-service-ca\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.884318 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.884301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34d9540a-8276-45fc-90a5-ec57c583e09e-openshift-service-ca\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.888550 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.888531    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-9671202b-serving-cert\""
Jul 24 14:52:13.895188 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.895164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qsx8\" (UniqueName: \"kubernetes.io/projected/34d9540a-8276-45fc-90a5-ec57c583e09e-kube-api-access-2qsx8\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:13.896161 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:13.896145    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34d9540a-8276-45fc-90a5-ec57c583e09e-maas-api-tls\") pod \"maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:14.045023 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.044947    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 14:52:14.051563 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.051534    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:14.223703 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.223673    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"]
Jul 24 14:52:14.226041 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:52:14.226005    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d9540a_8276_45fc_90a5_ec57c583e09e.slice/crio-db0751bb70608cc1470c82e7bb6d194ce95efb14d2a97c00af2c49699b351b70 WatchSource:0}: Error finding container db0751bb70608cc1470c82e7bb6d194ce95efb14d2a97c00af2c49699b351b70: Status 404 returned error can't find the container with id db0751bb70608cc1470c82e7bb6d194ce95efb14d2a97c00af2c49699b351b70
Jul 24 14:52:14.702648 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.702626    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"]
Jul 24 14:52:14.707270 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.707252    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:14.712562 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.712522    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-9671202b\""
Jul 24 14:52:14.712728 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.712709    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-9671202b-dockercfg-vdc9j\""
Jul 24 14:52:14.729720 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.729689    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"]
Jul 24 14:52:14.786426 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.786392    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"]
Jul 24 14:52:14.789876 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.789857    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:14.793494 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.793464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45272c5e-54e7-48a1-8bc1-114f24db955c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z\" (UID: \"45272c5e-54e7-48a1-8bc1-114f24db955c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:14.793615 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.793593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgbqc\" (UniqueName: \"kubernetes.io/projected/45272c5e-54e7-48a1-8bc1-114f24db955c-kube-api-access-lgbqc\") pod \"payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z\" (UID: \"45272c5e-54e7-48a1-8bc1-114f24db955c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:14.801555 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.801524    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"]
Jul 24 14:52:14.894932 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.894893    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgbqc\" (UniqueName: \"kubernetes.io/projected/45272c5e-54e7-48a1-8bc1-114f24db955c-kube-api-access-lgbqc\") pod \"payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z\" (UID: \"45272c5e-54e7-48a1-8bc1-114f24db955c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:14.895147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.894952    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g9q7\" (UniqueName: \"kubernetes.io/projected/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-kube-api-access-2g9q7\") pod \"payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl\" (UID: \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\") " pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:14.895147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.895001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45272c5e-54e7-48a1-8bc1-114f24db955c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z\" (UID: \"45272c5e-54e7-48a1-8bc1-114f24db955c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:14.895147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.895058    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl\" (UID: \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\") " pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:14.895781 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.895751    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45272c5e-54e7-48a1-8bc1-114f24db955c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z\" (UID: \"45272c5e-54e7-48a1-8bc1-114f24db955c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:14.905201 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.905176    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgbqc\" (UniqueName: \"kubernetes.io/projected/45272c5e-54e7-48a1-8bc1-114f24db955c-kube-api-access-lgbqc\") pod \"payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z\" (UID: \"45272c5e-54e7-48a1-8bc1-114f24db955c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:14.995670 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.995636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g9q7\" (UniqueName: \"kubernetes.io/projected/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-kube-api-access-2g9q7\") pod \"payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl\" (UID: \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\") " pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:14.995849 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.995686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl\" (UID: \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\") " pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:14.996476 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:14.996456    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl\" (UID: \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\") " pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:15.007579 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.007553    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g9q7\" (UniqueName: \"kubernetes.io/projected/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-kube-api-access-2g9q7\") pod \"payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl\" (UID: \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\") " pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:15.017452 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.017427    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:15.072735 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.072706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr" event={"ID":"34d9540a-8276-45fc-90a5-ec57c583e09e","Type":"ContainerStarted","Data":"c47c17db7ff3c94c1c2675ff0c586c1df961d14c86d9fe3b294bafa8c4f0af5f"}
Jul 24 14:52:15.072925 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.072906    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr" event={"ID":"34d9540a-8276-45fc-90a5-ec57c583e09e","Type":"ContainerStarted","Data":"db0751bb70608cc1470c82e7bb6d194ce95efb14d2a97c00af2c49699b351b70"}
Jul 24 14:52:15.073089 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.073073    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:15.098703 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.098643    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr" podStartSLOduration=1.6696674809999998 podStartE2EDuration="2.098621275s" totalImagesPullingTime="428.953794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:52:15.09762321 +0000 UTC m=+1801.539373731" watchObservedRunningTime="2026-07-24 14:52:15.098621275 +0000 UTC m=+1801.540371795"
Jul 24 14:52:15.100709 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.100683    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:15.167378 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.167285    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"]
Jul 24 14:52:15.169328 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:52:15.169235    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45272c5e_54e7_48a1_8bc1_114f24db955c.slice/crio-bb0b6b8eae7e2cbb634b2966ab25b8118f4a861f2f877903e6e6a516db43d639 WatchSource:0}: Error finding container bb0b6b8eae7e2cbb634b2966ab25b8118f4a861f2f877903e6e6a516db43d639: Status 404 returned error can't find the container with id bb0b6b8eae7e2cbb634b2966ab25b8118f4a861f2f877903e6e6a516db43d639
Jul 24 14:52:15.270278 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:15.270200    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"]
Jul 24 14:52:15.273042 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:52:15.272994    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4e7864_fdcf_47c5_91e8_18ae0e0f8ee9.slice/crio-cbd842e0632b3ed3fa01929a12d526249fc54946758aa28a3b91ced7ab093d42 WatchSource:0}: Error finding container cbd842e0632b3ed3fa01929a12d526249fc54946758aa28a3b91ced7ab093d42: Status 404 returned error can't find the container with id cbd842e0632b3ed3fa01929a12d526249fc54946758aa28a3b91ced7ab093d42
Jul 24 14:52:16.081098 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:16.081057    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z" event={"ID":"45272c5e-54e7-48a1-8bc1-114f24db955c","Type":"ContainerStarted","Data":"325e7128c24fb9fdb1b889fe4a0897f90dd53e98aa10d06523eb518edd2ca96f"}
Jul 24 14:52:16.081577 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:16.081120    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:16.081577 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:16.081142    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z" event={"ID":"45272c5e-54e7-48a1-8bc1-114f24db955c","Type":"ContainerStarted","Data":"bb0b6b8eae7e2cbb634b2966ab25b8118f4a861f2f877903e6e6a516db43d639"}
Jul 24 14:52:16.082545 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:16.082520    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl" event={"ID":"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9","Type":"ContainerStarted","Data":"9e49fbd3ac513ea03019b2de23e3fcb151e87953ea0b9edd15972dce63573599"}
Jul 24 14:52:16.082615 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:16.082571    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl" event={"ID":"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9","Type":"ContainerStarted","Data":"cbd842e0632b3ed3fa01929a12d526249fc54946758aa28a3b91ced7ab093d42"}
Jul 24 14:52:16.082669 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:16.082612    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:16.107408 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:16.107350    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z" podStartSLOduration=2.107328076 podStartE2EDuration="2.107328076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:52:16.106423052 +0000 UTC m=+1802.548173573" watchObservedRunningTime="2026-07-24 14:52:16.107328076 +0000 UTC m=+1802.549078596"
Jul 24 14:52:16.130927 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:16.130871    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl" podStartSLOduration=2.130854025 podStartE2EDuration="2.130854025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:52:16.129961532 +0000 UTC m=+1802.571712057" watchObservedRunningTime="2026-07-24 14:52:16.130854025 +0000 UTC m=+1802.572604545"
Jul 24 14:52:22.093080 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:22.093049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:27.089257 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:27.089225    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:27.089734 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:27.089315    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:49.047088 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.047050    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"]
Jul 24 14:52:49.047566 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.047252    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr" podUID="34d9540a-8276-45fc-90a5-ec57c583e09e" containerName="maas-api" containerID="cri-o://c47c17db7ff3c94c1c2675ff0c586c1df961d14c86d9fe3b294bafa8c4f0af5f" gracePeriod=30
Jul 24 14:52:49.137426 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.137378    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"]
Jul 24 14:52:49.137708 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.137648    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl" podUID="cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9" containerName="payload-processing" containerID="cri-o://9e49fbd3ac513ea03019b2de23e3fcb151e87953ea0b9edd15972dce63573599" gracePeriod=30
Jul 24 14:52:49.140923 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.140890    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"]
Jul 24 14:52:49.141525 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.141491    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z" podUID="45272c5e-54e7-48a1-8bc1-114f24db955c" containerName="payload-pre-processing" containerID="cri-o://325e7128c24fb9fdb1b889fe4a0897f90dd53e98aa10d06523eb518edd2ca96f" gracePeriod=30
Jul 24 14:52:49.260637 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.260599    2574 generic.go:356] "Generic (PLEG): container finished" podID="45272c5e-54e7-48a1-8bc1-114f24db955c" containerID="325e7128c24fb9fdb1b889fe4a0897f90dd53e98aa10d06523eb518edd2ca96f" exitCode=0
Jul 24 14:52:49.260799 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.260634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z" event={"ID":"45272c5e-54e7-48a1-8bc1-114f24db955c","Type":"ContainerDied","Data":"325e7128c24fb9fdb1b889fe4a0897f90dd53e98aa10d06523eb518edd2ca96f"}
Jul 24 14:52:49.262662 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.262629    2574 generic.go:356] "Generic (PLEG): container finished" podID="cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9" containerID="9e49fbd3ac513ea03019b2de23e3fcb151e87953ea0b9edd15972dce63573599" exitCode=0
Jul 24 14:52:49.262811 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.262663    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl" event={"ID":"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9","Type":"ContainerDied","Data":"9e49fbd3ac513ea03019b2de23e3fcb151e87953ea0b9edd15972dce63573599"}
Jul 24 14:52:49.264633 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.264604    2574 generic.go:356] "Generic (PLEG): container finished" podID="34d9540a-8276-45fc-90a5-ec57c583e09e" containerID="c47c17db7ff3c94c1c2675ff0c586c1df961d14c86d9fe3b294bafa8c4f0af5f" exitCode=0
Jul 24 14:52:49.264757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.264652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr" event={"ID":"34d9540a-8276-45fc-90a5-ec57c583e09e","Type":"ContainerDied","Data":"c47c17db7ff3c94c1c2675ff0c586c1df961d14c86d9fe3b294bafa8c4f0af5f"}
Jul 24 14:52:49.423885 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.423852    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:49.448057 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.448002    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:49.456572 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.456548    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:49.494391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494363    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qsx8\" (UniqueName: \"kubernetes.io/projected/34d9540a-8276-45fc-90a5-ec57c583e09e-kube-api-access-2qsx8\") pod \"34d9540a-8276-45fc-90a5-ec57c583e09e\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") "
Jul 24 14:52:49.494391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494395    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34d9540a-8276-45fc-90a5-ec57c583e09e-openshift-service-ca\") pod \"34d9540a-8276-45fc-90a5-ec57c583e09e\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") "
Jul 24 14:52:49.494620 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494416    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-plugins-config-volume\") pod \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\" (UID: \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\") "
Jul 24 14:52:49.494620 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494456    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45272c5e-54e7-48a1-8bc1-114f24db955c-plugins-config-volume\") pod \"45272c5e-54e7-48a1-8bc1-114f24db955c\" (UID: \"45272c5e-54e7-48a1-8bc1-114f24db955c\") "
Jul 24 14:52:49.494620 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494476    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g9q7\" (UniqueName: \"kubernetes.io/projected/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-kube-api-access-2g9q7\") pod \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\" (UID: \"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9\") "
Jul 24 14:52:49.494620 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494493    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34d9540a-8276-45fc-90a5-ec57c583e09e-maas-api-tls\") pod \"34d9540a-8276-45fc-90a5-ec57c583e09e\" (UID: \"34d9540a-8276-45fc-90a5-ec57c583e09e\") "
Jul 24 14:52:49.494620 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494570    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgbqc\" (UniqueName: \"kubernetes.io/projected/45272c5e-54e7-48a1-8bc1-114f24db955c-kube-api-access-lgbqc\") pod \"45272c5e-54e7-48a1-8bc1-114f24db955c\" (UID: \"45272c5e-54e7-48a1-8bc1-114f24db955c\") "
Jul 24 14:52:49.494884 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494836    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9" (UID: "cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:52:49.494884 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.494869    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45272c5e-54e7-48a1-8bc1-114f24db955c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45272c5e-54e7-48a1-8bc1-114f24db955c" (UID: "45272c5e-54e7-48a1-8bc1-114f24db955c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:52:49.495239 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.495214    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34d9540a-8276-45fc-90a5-ec57c583e09e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34d9540a-8276-45fc-90a5-ec57c583e09e" (UID: "34d9540a-8276-45fc-90a5-ec57c583e09e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:52:49.496838 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.496809    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-kube-api-access-2g9q7" (OuterVolumeSpecName: "kube-api-access-2g9q7") pod "cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9" (UID: "cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9"). InnerVolumeSpecName "kube-api-access-2g9q7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:52:49.496939 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.496839    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d9540a-8276-45fc-90a5-ec57c583e09e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34d9540a-8276-45fc-90a5-ec57c583e09e" (UID: "34d9540a-8276-45fc-90a5-ec57c583e09e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:52:49.496939 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.496848    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45272c5e-54e7-48a1-8bc1-114f24db955c-kube-api-access-lgbqc" (OuterVolumeSpecName: "kube-api-access-lgbqc") pod "45272c5e-54e7-48a1-8bc1-114f24db955c" (UID: "45272c5e-54e7-48a1-8bc1-114f24db955c"). InnerVolumeSpecName "kube-api-access-lgbqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:52:49.497055 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.497008    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34d9540a-8276-45fc-90a5-ec57c583e09e-kube-api-access-2qsx8" (OuterVolumeSpecName: "kube-api-access-2qsx8") pod "34d9540a-8276-45fc-90a5-ec57c583e09e" (UID: "34d9540a-8276-45fc-90a5-ec57c583e09e"). InnerVolumeSpecName "kube-api-access-2qsx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:52:49.596072 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.595949    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qsx8\" (UniqueName: \"kubernetes.io/projected/34d9540a-8276-45fc-90a5-ec57c583e09e-kube-api-access-2qsx8\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:49.596072 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.595979    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34d9540a-8276-45fc-90a5-ec57c583e09e-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:49.596072 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.595989    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:49.596072 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.595997    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45272c5e-54e7-48a1-8bc1-114f24db955c-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:49.596072 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.596006    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g9q7\" (UniqueName: \"kubernetes.io/projected/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9-kube-api-access-2g9q7\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:49.596072 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.596015    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34d9540a-8276-45fc-90a5-ec57c583e09e-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:49.596072 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:49.596023    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgbqc\" (UniqueName: \"kubernetes.io/projected/45272c5e-54e7-48a1-8bc1-114f24db955c-kube-api-access-lgbqc\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:52:50.270951 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.270919    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"
Jul 24 14:52:50.270951 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.270942    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z" event={"ID":"45272c5e-54e7-48a1-8bc1-114f24db955c","Type":"ContainerDied","Data":"bb0b6b8eae7e2cbb634b2966ab25b8118f4a861f2f877903e6e6a516db43d639"}
Jul 24 14:52:50.271529 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.271009    2574 scope.go:117] "RemoveContainer" containerID="325e7128c24fb9fdb1b889fe4a0897f90dd53e98aa10d06523eb518edd2ca96f"
Jul 24 14:52:50.272468 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.272443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl" event={"ID":"cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9","Type":"ContainerDied","Data":"cbd842e0632b3ed3fa01929a12d526249fc54946758aa28a3b91ced7ab093d42"}
Jul 24 14:52:50.272576 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.272452    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"
Jul 24 14:52:50.273819 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.273798    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr" event={"ID":"34d9540a-8276-45fc-90a5-ec57c583e09e","Type":"ContainerDied","Data":"db0751bb70608cc1470c82e7bb6d194ce95efb14d2a97c00af2c49699b351b70"}
Jul 24 14:52:50.273819 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.273815    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"
Jul 24 14:52:50.281904 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.281799    2574 scope.go:117] "RemoveContainer" containerID="9e49fbd3ac513ea03019b2de23e3fcb151e87953ea0b9edd15972dce63573599"
Jul 24 14:52:50.290928 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.290906    2574 scope.go:117] "RemoveContainer" containerID="c47c17db7ff3c94c1c2675ff0c586c1df961d14c86d9fe3b294bafa8c4f0af5f"
Jul 24 14:52:50.301707 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.301681    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"]
Jul 24 14:52:50.305726 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.305699    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9671202b-7bfc889c57-42qhl"]
Jul 24 14:52:50.320959 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.320928    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"]
Jul 24 14:52:50.326362 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.326334    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9671202b-5f95c49b64-d9p2z"]
Jul 24 14:52:50.343173 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.343144    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"]
Jul 24 14:52:50.348403 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:50.348378    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9671202b-5d48cf548f-68dgr"]
Jul 24 14:52:52.018378 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:52.018331    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34d9540a-8276-45fc-90a5-ec57c583e09e" path="/var/lib/kubelet/pods/34d9540a-8276-45fc-90a5-ec57c583e09e/volumes"
Jul 24 14:52:52.018898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:52.018824    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45272c5e-54e7-48a1-8bc1-114f24db955c" path="/var/lib/kubelet/pods/45272c5e-54e7-48a1-8bc1-114f24db955c/volumes"
Jul 24 14:52:52.019235 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:52.019216    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9" path="/var/lib/kubelet/pods/cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9/volumes"
Jul 24 14:52:57.608381 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608350    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"]
Jul 24 14:52:57.608742 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608655    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45272c5e-54e7-48a1-8bc1-114f24db955c" containerName="payload-pre-processing"
Jul 24 14:52:57.608742 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608666    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="45272c5e-54e7-48a1-8bc1-114f24db955c" containerName="payload-pre-processing"
Jul 24 14:52:57.608742 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608684    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d9540a-8276-45fc-90a5-ec57c583e09e" containerName="maas-api"
Jul 24 14:52:57.608742 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608689    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d9540a-8276-45fc-90a5-ec57c583e09e" containerName="maas-api"
Jul 24 14:52:57.608742 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608695    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9" containerName="payload-processing"
Jul 24 14:52:57.608742 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608700    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9" containerName="payload-processing"
Jul 24 14:52:57.608930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608756    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4e7864-fdcf-47c5-91e8-18ae0e0f8ee9" containerName="payload-processing"
Jul 24 14:52:57.608930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608764    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="45272c5e-54e7-48a1-8bc1-114f24db955c" containerName="payload-pre-processing"
Jul 24 14:52:57.608930 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.608771    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="34d9540a-8276-45fc-90a5-ec57c583e09e" containerName="maas-api"
Jul 24 14:52:57.613343 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.613316    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.616311 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.616290    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6b842b2f-serving-cert\""
Jul 24 14:52:57.616510 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.616492    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 14:52:57.625251 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.625225    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"]
Jul 24 14:52:57.668228 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.668196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff18a005-b77b-484d-93e7-9ade7b5cddbe-openshift-service-ca\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.668403 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.668250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76l2q\" (UniqueName: \"kubernetes.io/projected/ff18a005-b77b-484d-93e7-9ade7b5cddbe-kube-api-access-76l2q\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.668403 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.668302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff18a005-b77b-484d-93e7-9ade7b5cddbe-maas-api-tls\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.769054 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.768996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff18a005-b77b-484d-93e7-9ade7b5cddbe-openshift-service-ca\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.769215 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.769088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76l2q\" (UniqueName: \"kubernetes.io/projected/ff18a005-b77b-484d-93e7-9ade7b5cddbe-kube-api-access-76l2q\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.769215 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.769122    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff18a005-b77b-484d-93e7-9ade7b5cddbe-maas-api-tls\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.769714 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.769690    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff18a005-b77b-484d-93e7-9ade7b5cddbe-openshift-service-ca\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.771602 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.771571    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff18a005-b77b-484d-93e7-9ade7b5cddbe-maas-api-tls\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.779786 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.779761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76l2q\" (UniqueName: \"kubernetes.io/projected/ff18a005-b77b-484d-93e7-9ade7b5cddbe-kube-api-access-76l2q\") pod \"maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:57.923772 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:57.923745    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:58.064612 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.064585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"]
Jul 24 14:52:58.066572 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:52:58.066544    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff18a005_b77b_484d_93e7_9ade7b5cddbe.slice/crio-8bc599fd5aa84cfb545aede8aabfd309c16a14f81785a496aefda9b2b904bbb0 WatchSource:0}: Error finding container 8bc599fd5aa84cfb545aede8aabfd309c16a14f81785a496aefda9b2b904bbb0: Status 404 returned error can't find the container with id 8bc599fd5aa84cfb545aede8aabfd309c16a14f81785a496aefda9b2b904bbb0
Jul 24 14:52:58.318069 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.317967    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm" event={"ID":"ff18a005-b77b-484d-93e7-9ade7b5cddbe","Type":"ContainerStarted","Data":"8bc599fd5aa84cfb545aede8aabfd309c16a14f81785a496aefda9b2b904bbb0"}
Jul 24 14:52:58.343066 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.343018    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"]
Jul 24 14:52:58.347876 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.347848    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"]
Jul 24 14:52:58.348044 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.347965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:58.350857 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.350834    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-6b842b2f-dockercfg-6fbp7\""
Jul 24 14:52:58.350987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.350863    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-6b842b2f\""
Jul 24 14:52:58.351133 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.351114    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:58.357349 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.357318    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"]
Jul 24 14:52:58.361560 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.361539    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"]
Jul 24 14:52:58.374668 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.374638    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq94z\" (UniqueName: \"kubernetes.io/projected/7477ffc6-9321-42d8-975e-a585c4bc0dd2-kube-api-access-rq94z\") pod \"payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q\" (UID: \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\") " pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:58.374781 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.374684    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t\" (UID: \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:58.374781 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.374754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7477ffc6-9321-42d8-975e-a585c4bc0dd2-plugins-config-volume\") pod \"payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q\" (UID: \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\") " pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:58.374917 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.374778    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf6h4\" (UniqueName: \"kubernetes.io/projected/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-kube-api-access-tf6h4\") pod \"payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t\" (UID: \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:58.475712 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.475680    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq94z\" (UniqueName: \"kubernetes.io/projected/7477ffc6-9321-42d8-975e-a585c4bc0dd2-kube-api-access-rq94z\") pod \"payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q\" (UID: \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\") " pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:58.475897 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.475736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t\" (UID: \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:58.475897 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.475788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7477ffc6-9321-42d8-975e-a585c4bc0dd2-plugins-config-volume\") pod \"payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q\" (UID: \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\") " pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:58.475897 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.475815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf6h4\" (UniqueName: \"kubernetes.io/projected/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-kube-api-access-tf6h4\") pod \"payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t\" (UID: \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:58.476594 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.476569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7477ffc6-9321-42d8-975e-a585c4bc0dd2-plugins-config-volume\") pod \"payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q\" (UID: \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\") " pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:58.476689 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.476574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t\" (UID: \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:58.487912 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.487878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq94z\" (UniqueName: \"kubernetes.io/projected/7477ffc6-9321-42d8-975e-a585c4bc0dd2-kube-api-access-rq94z\") pod \"payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q\" (UID: \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\") " pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:58.488304 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.488287    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf6h4\" (UniqueName: \"kubernetes.io/projected/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-kube-api-access-tf6h4\") pod \"payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t\" (UID: \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:58.662166 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.662132    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:58.671214 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.671186    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:58.812420 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:58.810842    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"]
Jul 24 14:52:58.814436 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:52:58.814409    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd4756a_3e6c_45aa_b493_ddeb3d5f0b5f.slice/crio-ca7f74d93f65a37020d3f59e657db5494e8d2ed28005d8811f537e7ad9b1ce3f WatchSource:0}: Error finding container ca7f74d93f65a37020d3f59e657db5494e8d2ed28005d8811f537e7ad9b1ce3f: Status 404 returned error can't find the container with id ca7f74d93f65a37020d3f59e657db5494e8d2ed28005d8811f537e7ad9b1ce3f
Jul 24 14:52:59.045059 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.045009    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"]
Jul 24 14:52:59.046197 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:52:59.046166    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7477ffc6_9321_42d8_975e_a585c4bc0dd2.slice/crio-b160e72a1cc53af19634438602aba55135e9f59eaf3c29f49f07ab80b01edfae WatchSource:0}: Error finding container b160e72a1cc53af19634438602aba55135e9f59eaf3c29f49f07ab80b01edfae: Status 404 returned error can't find the container with id b160e72a1cc53af19634438602aba55135e9f59eaf3c29f49f07ab80b01edfae
Jul 24 14:52:59.324870 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.324830    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm" event={"ID":"ff18a005-b77b-484d-93e7-9ade7b5cddbe","Type":"ContainerStarted","Data":"3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0"}
Jul 24 14:52:59.325162 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.325009    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:52:59.326605 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.326581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q" event={"ID":"7477ffc6-9321-42d8-975e-a585c4bc0dd2","Type":"ContainerStarted","Data":"2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9"}
Jul 24 14:52:59.326713 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.326624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q" event={"ID":"7477ffc6-9321-42d8-975e-a585c4bc0dd2","Type":"ContainerStarted","Data":"b160e72a1cc53af19634438602aba55135e9f59eaf3c29f49f07ab80b01edfae"}
Jul 24 14:52:59.326713 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.326643    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:52:59.328085 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.328062    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t" event={"ID":"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f","Type":"ContainerStarted","Data":"d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29"}
Jul 24 14:52:59.328165 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.328102    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t" event={"ID":"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f","Type":"ContainerStarted","Data":"ca7f74d93f65a37020d3f59e657db5494e8d2ed28005d8811f537e7ad9b1ce3f"}
Jul 24 14:52:59.328165 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.328124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:52:59.355662 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.355564    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm" podStartSLOduration=1.873894913 podStartE2EDuration="2.355548682s" totalImagesPullingTime="481.653769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:52:59.353300581 +0000 UTC m=+1845.795051133" watchObservedRunningTime="2026-07-24 14:52:59.355548682 +0000 UTC m=+1845.797299223"
Jul 24 14:52:59.376715 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.376662    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t" podStartSLOduration=1.3766462210000001 podStartE2EDuration="1.376646221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:52:59.375201654 +0000 UTC m=+1845.816952172" watchObservedRunningTime="2026-07-24 14:52:59.376646221 +0000 UTC m=+1845.818396739"
Jul 24 14:52:59.402391 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:52:59.402342    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q" podStartSLOduration=1.402326668 podStartE2EDuration="1.402326668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:52:59.399880773 +0000 UTC m=+1845.841631293" watchObservedRunningTime="2026-07-24 14:52:59.402326668 +0000 UTC m=+1845.844077187"
Jul 24 14:53:05.345651 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:05.345615    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:53:10.342795 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:10.342753    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:53:10.343210 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:10.342978    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:53:34.039333 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.039297    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"]
Jul 24 14:53:34.040178 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.039551    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm" podUID="ff18a005-b77b-484d-93e7-9ade7b5cddbe" containerName="maas-api" containerID="cri-o://3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0" gracePeriod=30
Jul 24 14:53:34.118424 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.118388    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"]
Jul 24 14:53:34.118612 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.118591    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q" podUID="7477ffc6-9321-42d8-975e-a585c4bc0dd2" containerName="payload-processing" containerID="cri-o://2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9" gracePeriod=30
Jul 24 14:53:34.142718 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.142686    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"]
Jul 24 14:53:34.142957 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.142927    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t" podUID="dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f" containerName="payload-pre-processing" containerID="cri-o://d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29" gracePeriod=30
Jul 24 14:53:34.296232 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.296151    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:53:34.404438 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.404407    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff18a005-b77b-484d-93e7-9ade7b5cddbe-openshift-service-ca\") pod \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") "
Jul 24 14:53:34.404615 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.404459    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff18a005-b77b-484d-93e7-9ade7b5cddbe-maas-api-tls\") pod \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") "
Jul 24 14:53:34.404615 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.404520    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76l2q\" (UniqueName: \"kubernetes.io/projected/ff18a005-b77b-484d-93e7-9ade7b5cddbe-kube-api-access-76l2q\") pod \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\" (UID: \"ff18a005-b77b-484d-93e7-9ade7b5cddbe\") "
Jul 24 14:53:34.404870 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.404834    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff18a005-b77b-484d-93e7-9ade7b5cddbe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff18a005-b77b-484d-93e7-9ade7b5cddbe" (UID: "ff18a005-b77b-484d-93e7-9ade7b5cddbe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:53:34.406919 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.406882    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff18a005-b77b-484d-93e7-9ade7b5cddbe-kube-api-access-76l2q" (OuterVolumeSpecName: "kube-api-access-76l2q") pod "ff18a005-b77b-484d-93e7-9ade7b5cddbe" (UID: "ff18a005-b77b-484d-93e7-9ade7b5cddbe"). InnerVolumeSpecName "kube-api-access-76l2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:53:34.407063 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.407005    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff18a005-b77b-484d-93e7-9ade7b5cddbe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff18a005-b77b-484d-93e7-9ade7b5cddbe" (UID: "ff18a005-b77b-484d-93e7-9ade7b5cddbe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:53:34.415656 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.415627    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:53:34.418283 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.418263    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:53:34.505590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.505556    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf6h4\" (UniqueName: \"kubernetes.io/projected/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-kube-api-access-tf6h4\") pod \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\" (UID: \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\") "
Jul 24 14:53:34.505590 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.505594    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq94z\" (UniqueName: \"kubernetes.io/projected/7477ffc6-9321-42d8-975e-a585c4bc0dd2-kube-api-access-rq94z\") pod \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\" (UID: \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\") "
Jul 24 14:53:34.505853 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.505649    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-plugins-config-volume\") pod \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\" (UID: \"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f\") "
Jul 24 14:53:34.505853 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.505694    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7477ffc6-9321-42d8-975e-a585c4bc0dd2-plugins-config-volume\") pod \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\" (UID: \"7477ffc6-9321-42d8-975e-a585c4bc0dd2\") "
Jul 24 14:53:34.505969 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.505959    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff18a005-b77b-484d-93e7-9ade7b5cddbe-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:53:34.506062 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.505977    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff18a005-b77b-484d-93e7-9ade7b5cddbe-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:53:34.506062 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.505991    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76l2q\" (UniqueName: \"kubernetes.io/projected/ff18a005-b77b-484d-93e7-9ade7b5cddbe-kube-api-access-76l2q\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:53:34.506174 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.506111    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f" (UID: "dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:53:34.506174 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.506151    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7477ffc6-9321-42d8-975e-a585c4bc0dd2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7477ffc6-9321-42d8-975e-a585c4bc0dd2" (UID: "7477ffc6-9321-42d8-975e-a585c4bc0dd2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:53:34.507768 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.507745    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7477ffc6-9321-42d8-975e-a585c4bc0dd2-kube-api-access-rq94z" (OuterVolumeSpecName: "kube-api-access-rq94z") pod "7477ffc6-9321-42d8-975e-a585c4bc0dd2" (UID: "7477ffc6-9321-42d8-975e-a585c4bc0dd2"). InnerVolumeSpecName "kube-api-access-rq94z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:53:34.507844 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.507776    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-kube-api-access-tf6h4" (OuterVolumeSpecName: "kube-api-access-tf6h4") pod "dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f" (UID: "dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f"). InnerVolumeSpecName "kube-api-access-tf6h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:53:34.515312 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.515283    2574 generic.go:356] "Generic (PLEG): container finished" podID="ff18a005-b77b-484d-93e7-9ade7b5cddbe" containerID="3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0" exitCode=0
Jul 24 14:53:34.515440 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.515332    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"
Jul 24 14:53:34.515440 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.515359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm" event={"ID":"ff18a005-b77b-484d-93e7-9ade7b5cddbe","Type":"ContainerDied","Data":"3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0"}
Jul 24 14:53:34.515440 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.515418    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm" event={"ID":"ff18a005-b77b-484d-93e7-9ade7b5cddbe","Type":"ContainerDied","Data":"8bc599fd5aa84cfb545aede8aabfd309c16a14f81785a496aefda9b2b904bbb0"}
Jul 24 14:53:34.515597 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.515447    2574 scope.go:117] "RemoveContainer" containerID="3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0"
Jul 24 14:53:34.516714 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.516690    2574 generic.go:356] "Generic (PLEG): container finished" podID="7477ffc6-9321-42d8-975e-a585c4bc0dd2" containerID="2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9" exitCode=0
Jul 24 14:53:34.516815 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.516735    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"
Jul 24 14:53:34.516815 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.516770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q" event={"ID":"7477ffc6-9321-42d8-975e-a585c4bc0dd2","Type":"ContainerDied","Data":"2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9"}
Jul 24 14:53:34.516938 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.516818    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q" event={"ID":"7477ffc6-9321-42d8-975e-a585c4bc0dd2","Type":"ContainerDied","Data":"b160e72a1cc53af19634438602aba55135e9f59eaf3c29f49f07ab80b01edfae"}
Jul 24 14:53:34.518221 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.518197    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f" containerID="d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29" exitCode=0
Jul 24 14:53:34.518335 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.518240    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"
Jul 24 14:53:34.518335 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.518280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t" event={"ID":"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f","Type":"ContainerDied","Data":"d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29"}
Jul 24 14:53:34.518437 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.518342    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t" event={"ID":"dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f","Type":"ContainerDied","Data":"ca7f74d93f65a37020d3f59e657db5494e8d2ed28005d8811f537e7ad9b1ce3f"}
Jul 24 14:53:34.526197 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.526101    2574 scope.go:117] "RemoveContainer" containerID="3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0"
Jul 24 14:53:34.526464 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:53:34.526425    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0\": container with ID starting with 3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0 not found: ID does not exist" containerID="3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0"
Jul 24 14:53:34.526542 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.526476    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0"} err="failed to get container status \"3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0\": rpc error: code = NotFound desc = could not find container \"3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0\": container with ID starting with 3753be394daeda0a7e60d0ea1dd8b0daff061c6380415b211760dccdb7def6f0 not found: ID does not exist"
Jul 24 14:53:34.526542 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.526497    2574 scope.go:117] "RemoveContainer" containerID="2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9"
Jul 24 14:53:34.534832 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.534813    2574 scope.go:117] "RemoveContainer" containerID="2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9"
Jul 24 14:53:34.535121 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:53:34.535096    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9\": container with ID starting with 2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9 not found: ID does not exist" containerID="2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9"
Jul 24 14:53:34.535206 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.535128    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9"} err="failed to get container status \"2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9\": rpc error: code = NotFound desc = could not find container \"2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9\": container with ID starting with 2302a9c84aa2b1aa70b393ffa2892f9c2d02641f32fb3267af7ee150d0c9cfe9 not found: ID does not exist"
Jul 24 14:53:34.535206 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.535145    2574 scope.go:117] "RemoveContainer" containerID="d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29"
Jul 24 14:53:34.543876 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.543684    2574 scope.go:117] "RemoveContainer" containerID="d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29"
Jul 24 14:53:34.544454 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.544335    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"]
Jul 24 14:53:34.546514 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:53:34.546268    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29\": container with ID starting with d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29 not found: ID does not exist" containerID="d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29"
Jul 24 14:53:34.546514 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.546303    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29"} err="failed to get container status \"d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29\": rpc error: code = NotFound desc = could not find container \"d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29\": container with ID starting with d4a6345e5a85f5fc87ce3a86ab84e61036a1670ee75bebf860642eb26c311f29 not found: ID does not exist"
Jul 24 14:53:34.548955 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.548935    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b842b2f-7f9d97958f-zvvcm"]
Jul 24 14:53:34.562793 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.562768    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"]
Jul 24 14:53:34.569533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.569510    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6b842b2f-84456ff4bd-brj2t"]
Jul 24 14:53:34.584265 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.584238    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"]
Jul 24 14:53:34.588134 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.588109    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6b842b2f-54cd794b88-njq6q"]
Jul 24 14:53:34.606585 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.606558    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf6h4\" (UniqueName: \"kubernetes.io/projected/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-kube-api-access-tf6h4\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:53:34.606585 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.606582    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq94z\" (UniqueName: \"kubernetes.io/projected/7477ffc6-9321-42d8-975e-a585c4bc0dd2-kube-api-access-rq94z\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:53:34.606719 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.606598    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:53:34.606719 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:34.606610    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7477ffc6-9321-42d8-975e-a585c4bc0dd2-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:53:36.018828 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:36.018756    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7477ffc6-9321-42d8-975e-a585c4bc0dd2" path="/var/lib/kubelet/pods/7477ffc6-9321-42d8-975e-a585c4bc0dd2/volumes"
Jul 24 14:53:36.019252 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:36.019236    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f" path="/var/lib/kubelet/pods/dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f/volumes"
Jul 24 14:53:36.019593 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:36.019581    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff18a005-b77b-484d-93e7-9ade7b5cddbe" path="/var/lib/kubelet/pods/ff18a005-b77b-484d-93e7-9ade7b5cddbe/volumes"
Jul 24 14:53:43.862369 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862338    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"]
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862637    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff18a005-b77b-484d-93e7-9ade7b5cddbe" containerName="maas-api"
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862647    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff18a005-b77b-484d-93e7-9ade7b5cddbe" containerName="maas-api"
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862660    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f" containerName="payload-pre-processing"
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862666    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f" containerName="payload-pre-processing"
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862676    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7477ffc6-9321-42d8-975e-a585c4bc0dd2" containerName="payload-processing"
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862682    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7477ffc6-9321-42d8-975e-a585c4bc0dd2" containerName="payload-processing"
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862753    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff18a005-b77b-484d-93e7-9ade7b5cddbe" containerName="maas-api"
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862762    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd4756a-3e6c-45aa-b493-ddeb3d5f0b5f" containerName="payload-pre-processing"
Jul 24 14:53:43.862817 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.862769    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7477ffc6-9321-42d8-975e-a585c4bc0dd2" containerName="payload-processing"
Jul 24 14:53:43.865692 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.865677    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:43.868369 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.868351    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ab2fb2a0-serving-cert\""
Jul 24 14:53:43.869624 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.869597    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 14:53:43.879841 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.879817    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"]
Jul 24 14:53:43.988359 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.988326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/393da991-bf11-419d-9d94-f45228d02ed0-maas-api-tls\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:43.988536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.988382    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/393da991-bf11-419d-9d94-f45228d02ed0-openshift-service-ca\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:43.988536 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:43.988411    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtf84\" (UniqueName: \"kubernetes.io/projected/393da991-bf11-419d-9d94-f45228d02ed0-kube-api-access-dtf84\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:44.089048 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.088993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/393da991-bf11-419d-9d94-f45228d02ed0-maas-api-tls\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:44.089228 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.089090    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/393da991-bf11-419d-9d94-f45228d02ed0-openshift-service-ca\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:44.089228 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.089110    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtf84\" (UniqueName: \"kubernetes.io/projected/393da991-bf11-419d-9d94-f45228d02ed0-kube-api-access-dtf84\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:44.089819 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.089801    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/393da991-bf11-419d-9d94-f45228d02ed0-openshift-service-ca\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:44.091543 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.091524    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/393da991-bf11-419d-9d94-f45228d02ed0-maas-api-tls\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:44.109671 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.109647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtf84\" (UniqueName: \"kubernetes.io/projected/393da991-bf11-419d-9d94-f45228d02ed0-kube-api-access-dtf84\") pod \"maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:44.175312 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.175272    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:44.317791 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.317744    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"]
Jul 24 14:53:44.319053 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:53:44.319006    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393da991_bf11_419d_9d94_f45228d02ed0.slice/crio-ff7c1454c8943be308050ffe45a5422025cadfc3e8765b880593a4593460a515 WatchSource:0}: Error finding container ff7c1454c8943be308050ffe45a5422025cadfc3e8765b880593a4593460a515: Status 404 returned error can't find the container with id ff7c1454c8943be308050ffe45a5422025cadfc3e8765b880593a4593460a515
Jul 24 14:53:44.572112 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.572005    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc" event={"ID":"393da991-bf11-419d-9d94-f45228d02ed0","Type":"ContainerStarted","Data":"ff7c1454c8943be308050ffe45a5422025cadfc3e8765b880593a4593460a515"}
Jul 24 14:53:44.671523 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.671491    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"]
Jul 24 14:53:44.675911 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.675895    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:44.678315 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.678291    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-ab2fb2a0\""
Jul 24 14:53:44.685435 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.685411    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"]
Jul 24 14:53:44.795274 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.795242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86sht\" (UniqueName: \"kubernetes.io/projected/bb9be1bf-4993-4d26-b667-4acaa25dbd38-kube-api-access-86sht\") pod \"payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b\" (UID: \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:44.795442 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.795415    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb9be1bf-4993-4d26-b667-4acaa25dbd38-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b\" (UID: \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:44.828905 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.828818    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"]
Jul 24 14:53:44.832160 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.832137    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:44.835481 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.835463    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-ab2fb2a0-dockercfg-bqsrw\""
Jul 24 14:53:44.846360 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.846336    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"]
Jul 24 14:53:44.896428 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.896384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb9be1bf-4993-4d26-b667-4acaa25dbd38-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b\" (UID: \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:44.896857 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.896475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86sht\" (UniqueName: \"kubernetes.io/projected/bb9be1bf-4993-4d26-b667-4acaa25dbd38-kube-api-access-86sht\") pod \"payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b\" (UID: \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:44.896857 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.896514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-plugins-config-volume\") pod \"payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882\" (UID: \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\") " pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:44.896857 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.896582    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8wht\" (UniqueName: \"kubernetes.io/projected/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-kube-api-access-p8wht\") pod \"payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882\" (UID: \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\") " pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:44.897136 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.897116    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb9be1bf-4993-4d26-b667-4acaa25dbd38-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b\" (UID: \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:44.906847 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.906813    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86sht\" (UniqueName: \"kubernetes.io/projected/bb9be1bf-4993-4d26-b667-4acaa25dbd38-kube-api-access-86sht\") pod \"payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b\" (UID: \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:44.986609 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.986579    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:44.997586 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.997559    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-plugins-config-volume\") pod \"payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882\" (UID: \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\") " pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:44.997665 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.997620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8wht\" (UniqueName: \"kubernetes.io/projected/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-kube-api-access-p8wht\") pod \"payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882\" (UID: \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\") " pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:44.998291 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:44.998269    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-plugins-config-volume\") pod \"payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882\" (UID: \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\") " pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:45.068269 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.068242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8wht\" (UniqueName: \"kubernetes.io/projected/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-kube-api-access-p8wht\") pod \"payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882\" (UID: \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\") " pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:45.142843 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.142817    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:45.191908 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.191876    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"]
Jul 24 14:53:45.192814 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:53:45.192789    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9be1bf_4993_4d26_b667_4acaa25dbd38.slice/crio-34add2f000144469da4a8fcd23dc31ddafc9cc9160bba318ad6ef07e0db8f747 WatchSource:0}: Error finding container 34add2f000144469da4a8fcd23dc31ddafc9cc9160bba318ad6ef07e0db8f747: Status 404 returned error can't find the container with id 34add2f000144469da4a8fcd23dc31ddafc9cc9160bba318ad6ef07e0db8f747
Jul 24 14:53:45.315560 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.315527    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"]
Jul 24 14:53:45.316665 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:53:45.316640    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd8b2b6_a57f_44cf_8fda_7525b48902c0.slice/crio-b1dcb87aa9e817b96dfbd9125bef00df764741f0c0e5580484335f4cebffcff2 WatchSource:0}: Error finding container b1dcb87aa9e817b96dfbd9125bef00df764741f0c0e5580484335f4cebffcff2: Status 404 returned error can't find the container with id b1dcb87aa9e817b96dfbd9125bef00df764741f0c0e5580484335f4cebffcff2
Jul 24 14:53:45.578548 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.578516    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b" event={"ID":"bb9be1bf-4993-4d26-b667-4acaa25dbd38","Type":"ContainerStarted","Data":"e26c09e68cf56810d10ace0a64417dd9215f427c66dbd193d1a099b042da3a47"}
Jul 24 14:53:45.578757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.578580    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:53:45.578757 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.578604    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b" event={"ID":"bb9be1bf-4993-4d26-b667-4acaa25dbd38","Type":"ContainerStarted","Data":"34add2f000144469da4a8fcd23dc31ddafc9cc9160bba318ad6ef07e0db8f747"}
Jul 24 14:53:45.580218 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.580192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882" event={"ID":"dcd8b2b6-a57f-44cf-8fda-7525b48902c0","Type":"ContainerStarted","Data":"97f759b7b7b6f1c325868e64a5afbbcd12d8a5ce49458c13c0d9116285c6502f"}
Jul 24 14:53:45.580338 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.580246    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:45.580338 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.580270    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882" event={"ID":"dcd8b2b6-a57f-44cf-8fda-7525b48902c0","Type":"ContainerStarted","Data":"b1dcb87aa9e817b96dfbd9125bef00df764741f0c0e5580484335f4cebffcff2"}
Jul 24 14:53:45.581916 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.581889    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc" event={"ID":"393da991-bf11-419d-9d94-f45228d02ed0","Type":"ContainerStarted","Data":"6e63c7a2aa4760f9c1ef47f3d0681c11df7891f1f4d39dd222bc4301f37fd3e1"}
Jul 24 14:53:45.582055 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.581999    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:45.609239 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.609136    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b" podStartSLOduration=1.6091208350000001 podStartE2EDuration="1.609120835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:53:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:53:45.606788917 +0000 UTC m=+1892.048539436" watchObservedRunningTime="2026-07-24 14:53:45.609120835 +0000 UTC m=+1892.050871354"
Jul 24 14:53:45.650735 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.650679    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc" podStartSLOduration=1.913794492 podStartE2EDuration="2.650662933s" totalImagesPullingTime="736.868441ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:53:45.650215976 +0000 UTC m=+1892.091966494" watchObservedRunningTime="2026-07-24 14:53:45.650662933 +0000 UTC m=+1892.092413484"
Jul 24 14:53:45.688264 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:45.688210    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882" podStartSLOduration=1.688194346 podStartE2EDuration="1.688194346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:53:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:53:45.68638418 +0000 UTC m=+1892.128134701" watchObservedRunningTime="2026-07-24 14:53:45.688194346 +0000 UTC m=+1892.129944864"
Jul 24 14:53:51.593366 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:51.593330    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:53:56.590182 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:56.590154    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:53:56.590589 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:53:56.590221    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:54:24.481154 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.481125    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"]
Jul 24 14:54:24.481765 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.481348    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc" podUID="393da991-bf11-419d-9d94-f45228d02ed0" containerName="maas-api" containerID="cri-o://6e63c7a2aa4760f9c1ef47f3d0681c11df7891f1f4d39dd222bc4301f37fd3e1" gracePeriod=30
Jul 24 14:54:24.558092 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.558040    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"]
Jul 24 14:54:24.558727 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.558305    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882" podUID="dcd8b2b6-a57f-44cf-8fda-7525b48902c0" containerName="payload-processing" containerID="cri-o://97f759b7b7b6f1c325868e64a5afbbcd12d8a5ce49458c13c0d9116285c6502f" gracePeriod=30
Jul 24 14:54:24.561924 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.561893    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"]
Jul 24 14:54:24.562196 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.562157    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b" podUID="bb9be1bf-4993-4d26-b667-4acaa25dbd38" containerName="payload-pre-processing" containerID="cri-o://e26c09e68cf56810d10ace0a64417dd9215f427c66dbd193d1a099b042da3a47" gracePeriod=30
Jul 24 14:54:24.798967 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.798932    2574 generic.go:356] "Generic (PLEG): container finished" podID="dcd8b2b6-a57f-44cf-8fda-7525b48902c0" containerID="97f759b7b7b6f1c325868e64a5afbbcd12d8a5ce49458c13c0d9116285c6502f" exitCode=0
Jul 24 14:54:24.799147 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.799006    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882" event={"ID":"dcd8b2b6-a57f-44cf-8fda-7525b48902c0","Type":"ContainerDied","Data":"97f759b7b7b6f1c325868e64a5afbbcd12d8a5ce49458c13c0d9116285c6502f"}
Jul 24 14:54:24.801991 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.801964    2574 generic.go:356] "Generic (PLEG): container finished" podID="393da991-bf11-419d-9d94-f45228d02ed0" containerID="6e63c7a2aa4760f9c1ef47f3d0681c11df7891f1f4d39dd222bc4301f37fd3e1" exitCode=0
Jul 24 14:54:24.802140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.802083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc" event={"ID":"393da991-bf11-419d-9d94-f45228d02ed0","Type":"ContainerDied","Data":"6e63c7a2aa4760f9c1ef47f3d0681c11df7891f1f4d39dd222bc4301f37fd3e1"}
Jul 24 14:54:24.804140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.804116    2574 generic.go:356] "Generic (PLEG): container finished" podID="bb9be1bf-4993-4d26-b667-4acaa25dbd38" containerID="e26c09e68cf56810d10ace0a64417dd9215f427c66dbd193d1a099b042da3a47" exitCode=0
Jul 24 14:54:24.804267 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.804155    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b" event={"ID":"bb9be1bf-4993-4d26-b667-4acaa25dbd38","Type":"ContainerDied","Data":"e26c09e68cf56810d10ace0a64417dd9215f427c66dbd193d1a099b042da3a47"}
Jul 24 14:54:24.823765 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.823743    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:54:24.848561 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.848542    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:54:24.850517 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.850493    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtf84\" (UniqueName: \"kubernetes.io/projected/393da991-bf11-419d-9d94-f45228d02ed0-kube-api-access-dtf84\") pod \"393da991-bf11-419d-9d94-f45228d02ed0\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") "
Jul 24 14:54:24.850626 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.850566    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/393da991-bf11-419d-9d94-f45228d02ed0-openshift-service-ca\") pod \"393da991-bf11-419d-9d94-f45228d02ed0\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") "
Jul 24 14:54:24.850626 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.850613    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/393da991-bf11-419d-9d94-f45228d02ed0-maas-api-tls\") pod \"393da991-bf11-419d-9d94-f45228d02ed0\" (UID: \"393da991-bf11-419d-9d94-f45228d02ed0\") "
Jul 24 14:54:24.850966 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.850887    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393da991-bf11-419d-9d94-f45228d02ed0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "393da991-bf11-419d-9d94-f45228d02ed0" (UID: "393da991-bf11-419d-9d94-f45228d02ed0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:54:24.851083 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.850993    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/393da991-bf11-419d-9d94-f45228d02ed0-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:54:24.853353 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.853314    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/393da991-bf11-419d-9d94-f45228d02ed0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "393da991-bf11-419d-9d94-f45228d02ed0" (UID: "393da991-bf11-419d-9d94-f45228d02ed0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:54:24.853504 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.853480    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393da991-bf11-419d-9d94-f45228d02ed0-kube-api-access-dtf84" (OuterVolumeSpecName: "kube-api-access-dtf84") pod "393da991-bf11-419d-9d94-f45228d02ed0" (UID: "393da991-bf11-419d-9d94-f45228d02ed0"). InnerVolumeSpecName "kube-api-access-dtf84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:54:24.855565 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.855542    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:54:24.951837 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.951802    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-plugins-config-volume\") pod \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\" (UID: \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\") "
Jul 24 14:54:24.952065 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.951854    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb9be1bf-4993-4d26-b667-4acaa25dbd38-plugins-config-volume\") pod \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\" (UID: \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\") "
Jul 24 14:54:24.952065 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.951890    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8wht\" (UniqueName: \"kubernetes.io/projected/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-kube-api-access-p8wht\") pod \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\" (UID: \"dcd8b2b6-a57f-44cf-8fda-7525b48902c0\") "
Jul 24 14:54:24.952065 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.951947    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86sht\" (UniqueName: \"kubernetes.io/projected/bb9be1bf-4993-4d26-b667-4acaa25dbd38-kube-api-access-86sht\") pod \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\" (UID: \"bb9be1bf-4993-4d26-b667-4acaa25dbd38\") "
Jul 24 14:54:24.952268 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.952113    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtf84\" (UniqueName: \"kubernetes.io/projected/393da991-bf11-419d-9d94-f45228d02ed0-kube-api-access-dtf84\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:54:24.952268 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.952128    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/393da991-bf11-419d-9d94-f45228d02ed0-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:54:24.952366 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.952312    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dcd8b2b6-a57f-44cf-8fda-7525b48902c0" (UID: "dcd8b2b6-a57f-44cf-8fda-7525b48902c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:54:24.952405 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.952363    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb9be1bf-4993-4d26-b667-4acaa25dbd38-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bb9be1bf-4993-4d26-b667-4acaa25dbd38" (UID: "bb9be1bf-4993-4d26-b667-4acaa25dbd38"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:54:24.954148 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.954122    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb9be1bf-4993-4d26-b667-4acaa25dbd38-kube-api-access-86sht" (OuterVolumeSpecName: "kube-api-access-86sht") pod "bb9be1bf-4993-4d26-b667-4acaa25dbd38" (UID: "bb9be1bf-4993-4d26-b667-4acaa25dbd38"). InnerVolumeSpecName "kube-api-access-86sht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:54:24.954220 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:24.954159    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-kube-api-access-p8wht" (OuterVolumeSpecName: "kube-api-access-p8wht") pod "dcd8b2b6-a57f-44cf-8fda-7525b48902c0" (UID: "dcd8b2b6-a57f-44cf-8fda-7525b48902c0"). InnerVolumeSpecName "kube-api-access-p8wht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:54:25.053297 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.053206    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:54:25.053297 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.053238    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb9be1bf-4993-4d26-b667-4acaa25dbd38-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:54:25.053297 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.053248    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8wht\" (UniqueName: \"kubernetes.io/projected/dcd8b2b6-a57f-44cf-8fda-7525b48902c0-kube-api-access-p8wht\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:54:25.053297 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.053256    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86sht\" (UniqueName: \"kubernetes.io/projected/bb9be1bf-4993-4d26-b667-4acaa25dbd38-kube-api-access-86sht\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:54:25.811960 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.811873    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"
Jul 24 14:54:25.811960 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.811887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882" event={"ID":"dcd8b2b6-a57f-44cf-8fda-7525b48902c0","Type":"ContainerDied","Data":"b1dcb87aa9e817b96dfbd9125bef00df764741f0c0e5580484335f4cebffcff2"}
Jul 24 14:54:25.811960 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.811945    2574 scope.go:117] "RemoveContainer" containerID="97f759b7b7b6f1c325868e64a5afbbcd12d8a5ce49458c13c0d9116285c6502f"
Jul 24 14:54:25.813239 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.813204    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"
Jul 24 14:54:25.813306 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.813233    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc" event={"ID":"393da991-bf11-419d-9d94-f45228d02ed0","Type":"ContainerDied","Data":"ff7c1454c8943be308050ffe45a5422025cadfc3e8765b880593a4593460a515"}
Jul 24 14:54:25.814678 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.814656    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b" event={"ID":"bb9be1bf-4993-4d26-b667-4acaa25dbd38","Type":"ContainerDied","Data":"34add2f000144469da4a8fcd23dc31ddafc9cc9160bba318ad6ef07e0db8f747"}
Jul 24 14:54:25.814800 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.814697    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"
Jul 24 14:54:25.821085 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.821068    2574 scope.go:117] "RemoveContainer" containerID="6e63c7a2aa4760f9c1ef47f3d0681c11df7891f1f4d39dd222bc4301f37fd3e1"
Jul 24 14:54:25.830095 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.830078    2574 scope.go:117] "RemoveContainer" containerID="e26c09e68cf56810d10ace0a64417dd9215f427c66dbd193d1a099b042da3a47"
Jul 24 14:54:25.849730 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.849704    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"]
Jul 24 14:54:25.853753 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.853727    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-ab2fb2a0-65964d98f6-7vm2b"]
Jul 24 14:54:25.866398 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.866371    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"]
Jul 24 14:54:25.873787 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.873759    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-ab2fb2a0-555f778d4b-78882"]
Jul 24 14:54:25.887599 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.887570    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"]
Jul 24 14:54:25.893367 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:25.893343    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ab2fb2a0-84cf48555b-qm9rc"]
Jul 24 14:54:26.019020 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:26.018985    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="393da991-bf11-419d-9d94-f45228d02ed0" path="/var/lib/kubelet/pods/393da991-bf11-419d-9d94-f45228d02ed0/volumes"
Jul 24 14:54:26.019381 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:26.019368    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb9be1bf-4993-4d26-b667-4acaa25dbd38" path="/var/lib/kubelet/pods/bb9be1bf-4993-4d26-b667-4acaa25dbd38/volumes"
Jul 24 14:54:26.019678 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:54:26.019667    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd8b2b6-a57f-44cf-8fda-7525b48902c0" path="/var/lib/kubelet/pods/dcd8b2b6-a57f-44cf-8fda-7525b48902c0/volumes"
Jul 24 14:56:15.437359 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437318    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"]
Jul 24 14:56:15.437831 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437803    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393da991-bf11-419d-9d94-f45228d02ed0" containerName="maas-api"
Jul 24 14:56:15.437831 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437819    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="393da991-bf11-419d-9d94-f45228d02ed0" containerName="maas-api"
Jul 24 14:56:15.437907 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437831    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9be1bf-4993-4d26-b667-4acaa25dbd38" containerName="payload-pre-processing"
Jul 24 14:56:15.437907 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437840    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9be1bf-4993-4d26-b667-4acaa25dbd38" containerName="payload-pre-processing"
Jul 24 14:56:15.437907 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437864    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd8b2b6-a57f-44cf-8fda-7525b48902c0" containerName="payload-processing"
Jul 24 14:56:15.437907 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437875    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd8b2b6-a57f-44cf-8fda-7525b48902c0" containerName="payload-processing"
Jul 24 14:56:15.438058 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437949    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcd8b2b6-a57f-44cf-8fda-7525b48902c0" containerName="payload-processing"
Jul 24 14:56:15.438058 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437962    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="393da991-bf11-419d-9d94-f45228d02ed0" containerName="maas-api"
Jul 24 14:56:15.438058 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.437971    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb9be1bf-4993-4d26-b667-4acaa25dbd38" containerName="payload-pre-processing"
Jul 24 14:56:15.441260 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.441235    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:15.444838 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.444814    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d768479c-serving-cert\""
Jul 24 14:56:15.444987 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.444817    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 14:56:15.454957 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.454930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"]
Jul 24 14:56:15.487238 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.487205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:15.487238 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.487238    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60d411b-9994-4630-b6b7-998ec5b15324-openshift-service-ca\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:15.487447 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.487294    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x6h9\" (UniqueName: \"kubernetes.io/projected/a60d411b-9994-4630-b6b7-998ec5b15324-kube-api-access-4x6h9\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:15.588611 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.588565    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x6h9\" (UniqueName: \"kubernetes.io/projected/a60d411b-9994-4630-b6b7-998ec5b15324-kube-api-access-4x6h9\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:15.588793 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.588646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:15.588793 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.588671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60d411b-9994-4630-b6b7-998ec5b15324-openshift-service-ca\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:15.588867 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:56:15.588792    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-serving-cert: secret "maas-api-e2e-mt-d768479c-serving-cert" not found
Jul 24 14:56:15.588903 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:56:15.588875    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls podName:a60d411b-9994-4630-b6b7-998ec5b15324 nodeName:}" failed. No retries permitted until 2026-07-24 14:56:16.088854175 +0000 UTC m=+2042.530604688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls") pod "maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8" (UID: "a60d411b-9994-4630-b6b7-998ec5b15324") : secret "maas-api-e2e-mt-d768479c-serving-cert" not found
Jul 24 14:56:15.589355 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.589331    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60d411b-9994-4630-b6b7-998ec5b15324-openshift-service-ca\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:15.598806 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:15.598778    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x6h9\" (UniqueName: \"kubernetes.io/projected/a60d411b-9994-4630-b6b7-998ec5b15324-kube-api-access-4x6h9\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:16.094782 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.094746    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:16.097384 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.097351    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls\") pod \"maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:16.206249 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.206215    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"]
Jul 24 14:56:16.209779 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.209761    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:16.219039 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.219006    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d768479c-dockercfg-n5vtq\""
Jul 24 14:56:16.219330 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.219313    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d768479c\""
Jul 24 14:56:16.245854 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.245826    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"]
Jul 24 14:56:16.296320 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.296291    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01adadf4-2b1b-4017-9d49-0845db97e11d-plugins-config-volume\") pod \"payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn\" (UID: \"01adadf4-2b1b-4017-9d49-0845db97e11d\") " pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:16.296514 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.296353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr55q\" (UniqueName: \"kubernetes.io/projected/01adadf4-2b1b-4017-9d49-0845db97e11d-kube-api-access-fr55q\") pod \"payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn\" (UID: \"01adadf4-2b1b-4017-9d49-0845db97e11d\") " pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:16.353641 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.353564    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:16.397766 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.397733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr55q\" (UniqueName: \"kubernetes.io/projected/01adadf4-2b1b-4017-9d49-0845db97e11d-kube-api-access-fr55q\") pod \"payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn\" (UID: \"01adadf4-2b1b-4017-9d49-0845db97e11d\") " pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:16.397917 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.397804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01adadf4-2b1b-4017-9d49-0845db97e11d-plugins-config-volume\") pod \"payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn\" (UID: \"01adadf4-2b1b-4017-9d49-0845db97e11d\") " pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:16.398503 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.398481    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01adadf4-2b1b-4017-9d49-0845db97e11d-plugins-config-volume\") pod \"payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn\" (UID: \"01adadf4-2b1b-4017-9d49-0845db97e11d\") " pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:16.410588 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.410514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr55q\" (UniqueName: \"kubernetes.io/projected/01adadf4-2b1b-4017-9d49-0845db97e11d-kube-api-access-fr55q\") pod \"payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn\" (UID: \"01adadf4-2b1b-4017-9d49-0845db97e11d\") " pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:16.497438 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.497410    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"]
Jul 24 14:56:16.499566 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:56:16.499541    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60d411b_9994_4630_b6b7_998ec5b15324.slice/crio-cdf1af0510e5aefb562fed9ee10c950f7831ecf7918dfa9f07de57915e6a9348 WatchSource:0}: Error finding container cdf1af0510e5aefb562fed9ee10c950f7831ecf7918dfa9f07de57915e6a9348: Status 404 returned error can't find the container with id cdf1af0510e5aefb562fed9ee10c950f7831ecf7918dfa9f07de57915e6a9348
Jul 24 14:56:16.520074 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.520045    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:16.660584 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:16.660555    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"]
Jul 24 14:56:16.662006 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:56:16.661982    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01adadf4_2b1b_4017_9d49_0845db97e11d.slice/crio-de3fa3295fcdee4fa8acf083db344ebb6609208800fe79da91826550982f087e WatchSource:0}: Error finding container de3fa3295fcdee4fa8acf083db344ebb6609208800fe79da91826550982f087e: Status 404 returned error can't find the container with id de3fa3295fcdee4fa8acf083db344ebb6609208800fe79da91826550982f087e
Jul 24 14:56:17.371329 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:17.371290    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn" event={"ID":"01adadf4-2b1b-4017-9d49-0845db97e11d","Type":"ContainerStarted","Data":"2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7"}
Jul 24 14:56:17.371532 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:17.371357    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn" event={"ID":"01adadf4-2b1b-4017-9d49-0845db97e11d","Type":"ContainerStarted","Data":"de3fa3295fcdee4fa8acf083db344ebb6609208800fe79da91826550982f087e"}
Jul 24 14:56:17.371532 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:17.371395    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:17.372633 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:17.372609    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8" event={"ID":"a60d411b-9994-4630-b6b7-998ec5b15324","Type":"ContainerStarted","Data":"cdf1af0510e5aefb562fed9ee10c950f7831ecf7918dfa9f07de57915e6a9348"}
Jul 24 14:56:17.396181 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:17.396133    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn" podStartSLOduration=1.396112003 podStartE2EDuration="1.396112003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:17.394515453 +0000 UTC m=+2043.836265972" watchObservedRunningTime="2026-07-24 14:56:17.396112003 +0000 UTC m=+2043.837862555"
Jul 24 14:56:18.378994 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:18.378958    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8" event={"ID":"a60d411b-9994-4630-b6b7-998ec5b15324","Type":"ContainerStarted","Data":"2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92"}
Jul 24 14:56:18.379475 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:18.379195    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:18.400697 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:18.400644    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8" podStartSLOduration=1.7326032439999999 podStartE2EDuration="3.400630315s" totalImagesPullingTime="1.668027071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:18.399398524 +0000 UTC m=+2044.841149077" watchObservedRunningTime="2026-07-24 14:56:18.400630315 +0000 UTC m=+2044.842380834"
Jul 24 14:56:24.389123 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:24.389091    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:28.380721 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:28.380694    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:38.824935 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:38.824783    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"]
Jul 24 14:56:38.825408 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:38.825069    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8" podUID="a60d411b-9994-4630-b6b7-998ec5b15324" containerName="maas-api" containerID="cri-o://2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92" gracePeriod=30
Jul 24 14:56:38.889254 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:38.889216    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"]
Jul 24 14:56:38.889538 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:38.889496    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn" podUID="01adadf4-2b1b-4017-9d49-0845db97e11d" containerName="payload-processing" containerID="cri-o://2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7" gracePeriod=30
Jul 24 14:56:39.155342 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.155314    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:39.172493 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.172469    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:39.305111 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.305072    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60d411b-9994-4630-b6b7-998ec5b15324-openshift-service-ca\") pod \"a60d411b-9994-4630-b6b7-998ec5b15324\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") "
Jul 24 14:56:39.305318 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.305127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x6h9\" (UniqueName: \"kubernetes.io/projected/a60d411b-9994-4630-b6b7-998ec5b15324-kube-api-access-4x6h9\") pod \"a60d411b-9994-4630-b6b7-998ec5b15324\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") "
Jul 24 14:56:39.305318 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.305170    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls\") pod \"a60d411b-9994-4630-b6b7-998ec5b15324\" (UID: \"a60d411b-9994-4630-b6b7-998ec5b15324\") "
Jul 24 14:56:39.305460 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.305345    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01adadf4-2b1b-4017-9d49-0845db97e11d-plugins-config-volume\") pod \"01adadf4-2b1b-4017-9d49-0845db97e11d\" (UID: \"01adadf4-2b1b-4017-9d49-0845db97e11d\") "
Jul 24 14:56:39.305460 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.305395    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr55q\" (UniqueName: \"kubernetes.io/projected/01adadf4-2b1b-4017-9d49-0845db97e11d-kube-api-access-fr55q\") pod \"01adadf4-2b1b-4017-9d49-0845db97e11d\" (UID: \"01adadf4-2b1b-4017-9d49-0845db97e11d\") "
Jul 24 14:56:39.305643 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.305606    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a60d411b-9994-4630-b6b7-998ec5b15324-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a60d411b-9994-4630-b6b7-998ec5b15324" (UID: "a60d411b-9994-4630-b6b7-998ec5b15324"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:56:39.305759 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.305704    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01adadf4-2b1b-4017-9d49-0845db97e11d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01adadf4-2b1b-4017-9d49-0845db97e11d" (UID: "01adadf4-2b1b-4017-9d49-0845db97e11d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:56:39.305759 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.305715    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a60d411b-9994-4630-b6b7-998ec5b15324-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:56:39.307379 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.307355    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a60d411b-9994-4630-b6b7-998ec5b15324" (UID: "a60d411b-9994-4630-b6b7-998ec5b15324"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:56:39.307480 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.307378    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60d411b-9994-4630-b6b7-998ec5b15324-kube-api-access-4x6h9" (OuterVolumeSpecName: "kube-api-access-4x6h9") pod "a60d411b-9994-4630-b6b7-998ec5b15324" (UID: "a60d411b-9994-4630-b6b7-998ec5b15324"). InnerVolumeSpecName "kube-api-access-4x6h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:56:39.307480 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.307405    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01adadf4-2b1b-4017-9d49-0845db97e11d-kube-api-access-fr55q" (OuterVolumeSpecName: "kube-api-access-fr55q") pod "01adadf4-2b1b-4017-9d49-0845db97e11d" (UID: "01adadf4-2b1b-4017-9d49-0845db97e11d"). InnerVolumeSpecName "kube-api-access-fr55q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:56:39.406507 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.406423    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x6h9\" (UniqueName: \"kubernetes.io/projected/a60d411b-9994-4630-b6b7-998ec5b15324-kube-api-access-4x6h9\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:56:39.406507 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.406453    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a60d411b-9994-4630-b6b7-998ec5b15324-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:56:39.406507 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.406464    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01adadf4-2b1b-4017-9d49-0845db97e11d-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:56:39.406507 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.406473    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr55q\" (UniqueName: \"kubernetes.io/projected/01adadf4-2b1b-4017-9d49-0845db97e11d-kube-api-access-fr55q\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:56:39.488715 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.488680    2574 generic.go:356] "Generic (PLEG): container finished" podID="a60d411b-9994-4630-b6b7-998ec5b15324" containerID="2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92" exitCode=0
Jul 24 14:56:39.488898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.488726    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"
Jul 24 14:56:39.488898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.488768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8" event={"ID":"a60d411b-9994-4630-b6b7-998ec5b15324","Type":"ContainerDied","Data":"2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92"}
Jul 24 14:56:39.488898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.488823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8" event={"ID":"a60d411b-9994-4630-b6b7-998ec5b15324","Type":"ContainerDied","Data":"cdf1af0510e5aefb562fed9ee10c950f7831ecf7918dfa9f07de57915e6a9348"}
Jul 24 14:56:39.488898 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.488848    2574 scope.go:117] "RemoveContainer" containerID="2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92"
Jul 24 14:56:39.490129 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.490103    2574 generic.go:356] "Generic (PLEG): container finished" podID="01adadf4-2b1b-4017-9d49-0845db97e11d" containerID="2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7" exitCode=0
Jul 24 14:56:39.490309 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.490140    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn" event={"ID":"01adadf4-2b1b-4017-9d49-0845db97e11d","Type":"ContainerDied","Data":"2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7"}
Jul 24 14:56:39.490309 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.490173    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn" event={"ID":"01adadf4-2b1b-4017-9d49-0845db97e11d","Type":"ContainerDied","Data":"de3fa3295fcdee4fa8acf083db344ebb6609208800fe79da91826550982f087e"}
Jul 24 14:56:39.490309 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.490143    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"
Jul 24 14:56:39.498562 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.498539    2574 scope.go:117] "RemoveContainer" containerID="2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92"
Jul 24 14:56:39.498838 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:56:39.498808    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92\": container with ID starting with 2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92 not found: ID does not exist" containerID="2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92"
Jul 24 14:56:39.498925 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.498849    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92"} err="failed to get container status \"2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92\": rpc error: code = NotFound desc = could not find container \"2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92\": container with ID starting with 2e84eefb40d5e3aaa9538518ce50bf42ce69370de159a17b61cc9a5c39e91c92 not found: ID does not exist"
Jul 24 14:56:39.498925 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.498876    2574 scope.go:117] "RemoveContainer" containerID="2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7"
Jul 24 14:56:39.506750 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.506735    2574 scope.go:117] "RemoveContainer" containerID="2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7"
Jul 24 14:56:39.507002 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:56:39.506980    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7\": container with ID starting with 2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7 not found: ID does not exist" containerID="2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7"
Jul 24 14:56:39.507096 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.507008    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7"} err="failed to get container status \"2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7\": rpc error: code = NotFound desc = could not find container \"2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7\": container with ID starting with 2f5d7ea69ae6cc8caa60ed07a6914b4a3c85976c3d4f51098b2c01adabc146b7 not found: ID does not exist"
Jul 24 14:56:39.533466 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.533435    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"]
Jul 24 14:56:39.542671 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.542640    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d768479c-775fbbb4b6-c2rs8"]
Jul 24 14:56:39.571249 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.571217    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"]
Jul 24 14:56:39.582381 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:39.582353    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d768479c-57dcfd8ccd-wcbvn"]
Jul 24 14:56:40.018878 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:40.018843    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01adadf4-2b1b-4017-9d49-0845db97e11d" path="/var/lib/kubelet/pods/01adadf4-2b1b-4017-9d49-0845db97e11d/volumes"
Jul 24 14:56:40.019265 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:56:40.019234    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a60d411b-9994-4630-b6b7-998ec5b15324" path="/var/lib/kubelet/pods/a60d411b-9994-4630-b6b7-998ec5b15324/volumes"
Jul 24 14:57:16.499891 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.499847    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"]
Jul 24 14:57:16.500455 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.500193    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01adadf4-2b1b-4017-9d49-0845db97e11d" containerName="payload-processing"
Jul 24 14:57:16.500455 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.500205    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="01adadf4-2b1b-4017-9d49-0845db97e11d" containerName="payload-processing"
Jul 24 14:57:16.500455 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.500216    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60d411b-9994-4630-b6b7-998ec5b15324" containerName="maas-api"
Jul 24 14:57:16.500455 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.500222    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60d411b-9994-4630-b6b7-998ec5b15324" containerName="maas-api"
Jul 24 14:57:16.500455 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.500290    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="01adadf4-2b1b-4017-9d49-0845db97e11d" containerName="payload-processing"
Jul 24 14:57:16.500455 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.500302    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60d411b-9994-4630-b6b7-998ec5b15324" containerName="maas-api"
Jul 24 14:57:16.504598 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.504572    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.507398 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.507371    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0ac5a605-serving-cert\""
Jul 24 14:57:16.507535 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.507480    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 14:57:16.517102 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.516949    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"]
Jul 24 14:57:16.617166 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.617123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-openshift-service-ca\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.617360 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.617223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpmh\" (UniqueName: \"kubernetes.io/projected/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-kube-api-access-2hpmh\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.617360 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.617259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-maas-api-tls\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.718356 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.718323    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-openshift-service-ca\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.718546 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.718392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpmh\" (UniqueName: \"kubernetes.io/projected/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-kube-api-access-2hpmh\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.718546 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.718437    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-maas-api-tls\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.719129 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.719111    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-openshift-service-ca\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.720972 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.720945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-maas-api-tls\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.728145 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.728118    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpmh\" (UniqueName: \"kubernetes.io/projected/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-kube-api-access-2hpmh\") pod \"maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.818083 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.817954    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:16.960425 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.960393    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"]
Jul 24 14:57:16.962438 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:57:16.962410    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4d7ac3_28d8_4f38_9271_8d06a5089d71.slice/crio-15732a0d98326e010a9ada799f87a696310d4c0b993e04547cd45912c4e8ab7a WatchSource:0}: Error finding container 15732a0d98326e010a9ada799f87a696310d4c0b993e04547cd45912c4e8ab7a: Status 404 returned error can't find the container with id 15732a0d98326e010a9ada799f87a696310d4c0b993e04547cd45912c4e8ab7a
Jul 24 14:57:16.963798 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:16.963781    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:57:17.288169 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.288134    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"]
Jul 24 14:57:17.292486 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.292458    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:17.295369 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.295341    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0ac5a605\""
Jul 24 14:57:17.295511 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.295343    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0ac5a605-dockercfg-hmxp8\""
Jul 24 14:57:17.305174 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.305137    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"]
Jul 24 14:57:17.426003 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.425966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldgl\" (UniqueName: \"kubernetes.io/projected/dd68fc8f-2953-4a66-b002-c20834b12a32-kube-api-access-5ldgl\") pod \"payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f\" (UID: \"dd68fc8f-2953-4a66-b002-c20834b12a32\") " pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:17.426192 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.426100    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd68fc8f-2953-4a66-b002-c20834b12a32-plugins-config-volume\") pod \"payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f\" (UID: \"dd68fc8f-2953-4a66-b002-c20834b12a32\") " pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:17.527546 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.527501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd68fc8f-2953-4a66-b002-c20834b12a32-plugins-config-volume\") pod \"payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f\" (UID: \"dd68fc8f-2953-4a66-b002-c20834b12a32\") " pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:17.528022 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.527589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldgl\" (UniqueName: \"kubernetes.io/projected/dd68fc8f-2953-4a66-b002-c20834b12a32-kube-api-access-5ldgl\") pod \"payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f\" (UID: \"dd68fc8f-2953-4a66-b002-c20834b12a32\") " pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:17.528398 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.528378    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd68fc8f-2953-4a66-b002-c20834b12a32-plugins-config-volume\") pod \"payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f\" (UID: \"dd68fc8f-2953-4a66-b002-c20834b12a32\") " pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:17.537261 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.537233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldgl\" (UniqueName: \"kubernetes.io/projected/dd68fc8f-2953-4a66-b002-c20834b12a32-kube-api-access-5ldgl\") pod \"payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f\" (UID: \"dd68fc8f-2953-4a66-b002-c20834b12a32\") " pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:17.603558 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.603476    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:17.686466 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.686430    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z" event={"ID":"fe4d7ac3-28d8-4f38-9271-8d06a5089d71","Type":"ContainerStarted","Data":"95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003"}
Jul 24 14:57:17.686636 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.686515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z" event={"ID":"fe4d7ac3-28d8-4f38-9271-8d06a5089d71","Type":"ContainerStarted","Data":"15732a0d98326e010a9ada799f87a696310d4c0b993e04547cd45912c4e8ab7a"}
Jul 24 14:57:17.686636 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.686552    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:17.708655 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.708593    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z" podStartSLOduration=1.286720488 podStartE2EDuration="1.708574983s" totalImagesPullingTime="421.854495ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:17.70600652 +0000 UTC m=+2104.147757087" watchObservedRunningTime="2026-07-24 14:57:17.708574983 +0000 UTC m=+2104.150325501"
Jul 24 14:57:17.749358 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:17.749331    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"]
Jul 24 14:57:17.750967 ip-10-0-134-104 kubenswrapper[2574]: W0724 14:57:17.750941    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd68fc8f_2953_4a66_b002_c20834b12a32.slice/crio-1b7070024636093732c17b6658dc28836de2df55651ab59853deef9c9ec99afc WatchSource:0}: Error finding container 1b7070024636093732c17b6658dc28836de2df55651ab59853deef9c9ec99afc: Status 404 returned error can't find the container with id 1b7070024636093732c17b6658dc28836de2df55651ab59853deef9c9ec99afc
Jul 24 14:57:18.692942 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:18.692907    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f" event={"ID":"dd68fc8f-2953-4a66-b002-c20834b12a32","Type":"ContainerStarted","Data":"b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa"}
Jul 24 14:57:18.693416 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:18.693125    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:57:18.693416 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:18.693179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f" event={"ID":"dd68fc8f-2953-4a66-b002-c20834b12a32","Type":"ContainerStarted","Data":"1b7070024636093732c17b6658dc28836de2df55651ab59853deef9c9ec99afc"}
Jul 24 14:57:18.712864 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:18.712807    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f" podStartSLOduration=1.7127886879999998 podStartE2EDuration="1.712788688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:18.712350404 +0000 UTC m=+2105.154100924" watchObservedRunningTime="2026-07-24 14:57:18.712788688 +0000 UTC m=+2105.154539207"
Jul 24 14:57:23.699868 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:23.699837    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:57:29.701240 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:57:29.701208    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:58:32.055255 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.055219    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"]
Jul 24 14:58:32.068723 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.068687    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z" podUID="fe4d7ac3-28d8-4f38-9271-8d06a5089d71" containerName="maas-api" containerID="cri-o://95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003" gracePeriod=30
Jul 24 14:58:32.122516 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.122480    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"]
Jul 24 14:58:32.122779 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.122754    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f" podUID="dd68fc8f-2953-4a66-b002-c20834b12a32" containerName="payload-processing" containerID="cri-o://b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa" gracePeriod=30
Jul 24 14:58:32.375657 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.375631    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:58:32.407140 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.407116    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:58:32.413437 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.413405    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-maas-api-tls\") pod \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") "
Jul 24 14:58:32.413583 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.413468    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-openshift-service-ca\") pod \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") "
Jul 24 14:58:32.413650 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.413619    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hpmh\" (UniqueName: \"kubernetes.io/projected/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-kube-api-access-2hpmh\") pod \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\" (UID: \"fe4d7ac3-28d8-4f38-9271-8d06a5089d71\") "
Jul 24 14:58:32.413804 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.413784    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe4d7ac3-28d8-4f38-9271-8d06a5089d71" (UID: "fe4d7ac3-28d8-4f38-9271-8d06a5089d71"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:58:32.413929 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.413910    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:58:32.415507 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.415483    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe4d7ac3-28d8-4f38-9271-8d06a5089d71" (UID: "fe4d7ac3-28d8-4f38-9271-8d06a5089d71"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:58:32.415693 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.415670    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-kube-api-access-2hpmh" (OuterVolumeSpecName: "kube-api-access-2hpmh") pod "fe4d7ac3-28d8-4f38-9271-8d06a5089d71" (UID: "fe4d7ac3-28d8-4f38-9271-8d06a5089d71"). InnerVolumeSpecName "kube-api-access-2hpmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:58:32.514890 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.514850    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd68fc8f-2953-4a66-b002-c20834b12a32-plugins-config-volume\") pod \"dd68fc8f-2953-4a66-b002-c20834b12a32\" (UID: \"dd68fc8f-2953-4a66-b002-c20834b12a32\") "
Jul 24 14:58:32.515141 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.514905    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ldgl\" (UniqueName: \"kubernetes.io/projected/dd68fc8f-2953-4a66-b002-c20834b12a32-kube-api-access-5ldgl\") pod \"dd68fc8f-2953-4a66-b002-c20834b12a32\" (UID: \"dd68fc8f-2953-4a66-b002-c20834b12a32\") "
Jul 24 14:58:32.515141 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.515061    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:58:32.515141 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.515076    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hpmh\" (UniqueName: \"kubernetes.io/projected/fe4d7ac3-28d8-4f38-9271-8d06a5089d71-kube-api-access-2hpmh\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:58:32.515389 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.515361    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd68fc8f-2953-4a66-b002-c20834b12a32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd68fc8f-2953-4a66-b002-c20834b12a32" (UID: "dd68fc8f-2953-4a66-b002-c20834b12a32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:58:32.516997 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.516978    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd68fc8f-2953-4a66-b002-c20834b12a32-kube-api-access-5ldgl" (OuterVolumeSpecName: "kube-api-access-5ldgl") pod "dd68fc8f-2953-4a66-b002-c20834b12a32" (UID: "dd68fc8f-2953-4a66-b002-c20834b12a32"). InnerVolumeSpecName "kube-api-access-5ldgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:58:32.615653 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.615567    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd68fc8f-2953-4a66-b002-c20834b12a32-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:58:32.615653 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:32.615606    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ldgl\" (UniqueName: \"kubernetes.io/projected/dd68fc8f-2953-4a66-b002-c20834b12a32-kube-api-access-5ldgl\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 14:58:33.075282 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.075252    2574 generic.go:356] "Generic (PLEG): container finished" podID="dd68fc8f-2953-4a66-b002-c20834b12a32" containerID="b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa" exitCode=0
Jul 24 14:58:33.075727 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.075301    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"
Jul 24 14:58:33.075727 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.075346    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f" event={"ID":"dd68fc8f-2953-4a66-b002-c20834b12a32","Type":"ContainerDied","Data":"b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa"}
Jul 24 14:58:33.075727 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.075407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f" event={"ID":"dd68fc8f-2953-4a66-b002-c20834b12a32","Type":"ContainerDied","Data":"1b7070024636093732c17b6658dc28836de2df55651ab59853deef9c9ec99afc"}
Jul 24 14:58:33.075727 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.075436    2574 scope.go:117] "RemoveContainer" containerID="b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa"
Jul 24 14:58:33.077232 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.077209    2574 generic.go:356] "Generic (PLEG): container finished" podID="fe4d7ac3-28d8-4f38-9271-8d06a5089d71" containerID="95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003" exitCode=0
Jul 24 14:58:33.077332 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.077255    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"
Jul 24 14:58:33.077387 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.077346    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z" event={"ID":"fe4d7ac3-28d8-4f38-9271-8d06a5089d71","Type":"ContainerDied","Data":"95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003"}
Jul 24 14:58:33.077440 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.077404    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z" event={"ID":"fe4d7ac3-28d8-4f38-9271-8d06a5089d71","Type":"ContainerDied","Data":"15732a0d98326e010a9ada799f87a696310d4c0b993e04547cd45912c4e8ab7a"}
Jul 24 14:58:33.088168 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.088152    2574 scope.go:117] "RemoveContainer" containerID="b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa"
Jul 24 14:58:33.088471 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:58:33.088453    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa\": container with ID starting with b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa not found: ID does not exist" containerID="b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa"
Jul 24 14:58:33.088533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.088481    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa"} err="failed to get container status \"b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa\": rpc error: code = NotFound desc = could not find container \"b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa\": container with ID starting with b52468d16b440b34d540f17012e5606e48e64d6ffa7fe7ad3e3c20397771bdfa not found: ID does not exist"
Jul 24 14:58:33.088533 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.088498    2574 scope.go:117] "RemoveContainer" containerID="95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003"
Jul 24 14:58:33.096630 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.096612    2574 scope.go:117] "RemoveContainer" containerID="95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003"
Jul 24 14:58:33.096910 ip-10-0-134-104 kubenswrapper[2574]: E0724 14:58:33.096890    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003\": container with ID starting with 95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003 not found: ID does not exist" containerID="95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003"
Jul 24 14:58:33.096974 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.096921    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003"} err="failed to get container status \"95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003\": rpc error: code = NotFound desc = could not find container \"95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003\": container with ID starting with 95877e013c308f6580f68437423997df2ad7918a0bd7bbfd547a1de8bcaaf003 not found: ID does not exist"
Jul 24 14:58:33.103850 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.103823    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"]
Jul 24 14:58:33.108691 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.108663    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ac5a605-6d6dcf66b6-bvl2f"]
Jul 24 14:58:33.123443 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.123414    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"]
Jul 24 14:58:33.129270 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:33.129242    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ac5a605-6c7b6f5975-fnl7z"]
Jul 24 14:58:34.018805 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:34.018772    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd68fc8f-2953-4a66-b002-c20834b12a32" path="/var/lib/kubelet/pods/dd68fc8f-2953-4a66-b002-c20834b12a32/volumes"
Jul 24 14:58:34.019175 ip-10-0-134-104 kubenswrapper[2574]: I0724 14:58:34.019160    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4d7ac3-28d8-4f38-9271-8d06a5089d71" path="/var/lib/kubelet/pods/fe4d7ac3-28d8-4f38-9271-8d06a5089d71/volumes"
Jul 24 15:00:31.588527 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.588490    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"]
Jul 24 15:00:31.589101 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.588836    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4d7ac3-28d8-4f38-9271-8d06a5089d71" containerName="maas-api"
Jul 24 15:00:31.589101 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.588849    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4d7ac3-28d8-4f38-9271-8d06a5089d71" containerName="maas-api"
Jul 24 15:00:31.589101 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.588856    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd68fc8f-2953-4a66-b002-c20834b12a32" containerName="payload-processing"
Jul 24 15:00:31.589101 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.588862    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd68fc8f-2953-4a66-b002-c20834b12a32" containerName="payload-processing"
Jul 24 15:00:31.589101 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.588967    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd68fc8f-2953-4a66-b002-c20834b12a32" containerName="payload-processing"
Jul 24 15:00:31.589101 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.588979    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4d7ac3-28d8-4f38-9271-8d06a5089d71" containerName="maas-api"
Jul 24 15:00:31.592215 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.592186    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.594575 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.594549    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-51d655-serving-cert\""
Jul 24 15:00:31.594691 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.594653    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 15:00:31.605824 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.605800    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"]
Jul 24 15:00:31.656298 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.656256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e841b3a-73bb-488c-8899-7254a76a4991-openshift-service-ca\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.656489 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.656360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb8zd\" (UniqueName: \"kubernetes.io/projected/8e841b3a-73bb-488c-8899-7254a76a4991-kube-api-access-mb8zd\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.656489 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.656417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e841b3a-73bb-488c-8899-7254a76a4991-maas-api-tls\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.757400 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.757359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb8zd\" (UniqueName: \"kubernetes.io/projected/8e841b3a-73bb-488c-8899-7254a76a4991-kube-api-access-mb8zd\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.757400 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.757409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e841b3a-73bb-488c-8899-7254a76a4991-maas-api-tls\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.757680 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.757453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e841b3a-73bb-488c-8899-7254a76a4991-openshift-service-ca\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.758133 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.758110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e841b3a-73bb-488c-8899-7254a76a4991-openshift-service-ca\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.759942 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.759920    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e841b3a-73bb-488c-8899-7254a76a4991-maas-api-tls\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.767290 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.767266    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb8zd\" (UniqueName: \"kubernetes.io/projected/8e841b3a-73bb-488c-8899-7254a76a4991-kube-api-access-mb8zd\") pod \"maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:31.902914 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:31.902822    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:32.045729 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.045701    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"]
Jul 24 15:00:32.047411 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:00:32.047382    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e841b3a_73bb_488c_8899_7254a76a4991.slice/crio-1e282ec8dc45a4998d67b2347f38ffbf3eaafe38f65b1cf51af1233c698ab20f WatchSource:0}: Error finding container 1e282ec8dc45a4998d67b2347f38ffbf3eaafe38f65b1cf51af1233c698ab20f: Status 404 returned error can't find the container with id 1e282ec8dc45a4998d67b2347f38ffbf3eaafe38f65b1cf51af1233c698ab20f
Jul 24 15:00:32.362267 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.362226    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"]
Jul 24 15:00:32.366781 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.366759    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:32.369494 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.369472    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-51d655\""
Jul 24 15:00:32.369690 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.369673    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-51d655-dockercfg-dsz7j\""
Jul 24 15:00:32.381687 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.381660    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"]
Jul 24 15:00:32.464177 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.464139    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkztn\" (UniqueName: \"kubernetes.io/projected/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-kube-api-access-bkztn\") pod \"payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6\" (UID: \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\") " pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:32.464177 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.464178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6\" (UID: \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\") " pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:32.565493 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.565455    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkztn\" (UniqueName: \"kubernetes.io/projected/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-kube-api-access-bkztn\") pod \"payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6\" (UID: \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\") " pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:32.565493 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.565493    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6\" (UID: \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\") " pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:32.566177 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.566159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6\" (UID: \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\") " pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:32.575359 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.575337    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkztn\" (UniqueName: \"kubernetes.io/projected/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-kube-api-access-bkztn\") pod \"payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6\" (UID: \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\") " pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:32.670667 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.670632    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb" event={"ID":"8e841b3a-73bb-488c-8899-7254a76a4991","Type":"ContainerStarted","Data":"1e282ec8dc45a4998d67b2347f38ffbf3eaafe38f65b1cf51af1233c698ab20f"}
Jul 24 15:00:32.677800 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.677771    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:32.817775 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:32.817746    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"]
Jul 24 15:00:32.819419 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:00:32.819396    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc560d22_8e1e_4e94_b0e5_3ff77a5bf553.slice/crio-a1ff05329bea67e487f81a77097712cc68cb78f7ecd1ba97436bd7a542573145 WatchSource:0}: Error finding container a1ff05329bea67e487f81a77097712cc68cb78f7ecd1ba97436bd7a542573145: Status 404 returned error can't find the container with id a1ff05329bea67e487f81a77097712cc68cb78f7ecd1ba97436bd7a542573145
Jul 24 15:00:33.677484 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:33.677440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6" event={"ID":"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553","Type":"ContainerStarted","Data":"5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc"}
Jul 24 15:00:33.677955 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:33.677509    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6" event={"ID":"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553","Type":"ContainerStarted","Data":"a1ff05329bea67e487f81a77097712cc68cb78f7ecd1ba97436bd7a542573145"}
Jul 24 15:00:33.677955 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:33.677622    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:33.678888 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:33.678866    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb" event={"ID":"8e841b3a-73bb-488c-8899-7254a76a4991","Type":"ContainerStarted","Data":"7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070"}
Jul 24 15:00:33.678999 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:33.678983    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:33.697774 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:33.697718    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6" podStartSLOduration=1.697698918 podStartE2EDuration="1.697698918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:33.69533817 +0000 UTC m=+2300.137088725" watchObservedRunningTime="2026-07-24 15:00:33.697698918 +0000 UTC m=+2300.139449436"
Jul 24 15:00:33.716525 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:33.716473    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb" podStartSLOduration=1.8759121319999998 podStartE2EDuration="2.716452438s" totalImagesPullingTime="840.540306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:33.714369471 +0000 UTC m=+2300.156119990" watchObservedRunningTime="2026-07-24 15:00:33.716452438 +0000 UTC m=+2300.158202960"
Jul 24 15:00:39.690338 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:39.690304    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:00:39.769213 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:39.769171    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"]
Jul 24 15:00:39.773376 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:39.773352    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:39.776412 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:39.776391    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ba2a78-serving-cert\""
Jul 24 15:00:39.792992 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:39.792963    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"]
Jul 24 15:00:39.931094 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:39.931059    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f1c5dd-5eb0-4315-aaa4-95e01388436d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:39.931281 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:39.931193    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbjs\" (UniqueName: \"kubernetes.io/projected/93f1c5dd-5eb0-4315-aaa4-95e01388436d-kube-api-access-jqbjs\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:39.931281 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:39.931222    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f1c5dd-5eb0-4315-aaa4-95e01388436d-maas-api-tls\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:40.032259 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.032173    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f1c5dd-5eb0-4315-aaa4-95e01388436d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:40.032413 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.032285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbjs\" (UniqueName: \"kubernetes.io/projected/93f1c5dd-5eb0-4315-aaa4-95e01388436d-kube-api-access-jqbjs\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:40.032413 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.032315    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f1c5dd-5eb0-4315-aaa4-95e01388436d-maas-api-tls\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:40.032976 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.032948    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f1c5dd-5eb0-4315-aaa4-95e01388436d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:40.034776 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.034755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f1c5dd-5eb0-4315-aaa4-95e01388436d-maas-api-tls\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:40.043333 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.043307    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbjs\" (UniqueName: \"kubernetes.io/projected/93f1c5dd-5eb0-4315-aaa4-95e01388436d-kube-api-access-jqbjs\") pod \"maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:40.083311 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.083268    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:40.231996 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.231966    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"]
Jul 24 15:00:40.233880 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:00:40.233851    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f1c5dd_5eb0_4315_aaa4_95e01388436d.slice/crio-36c2984aa5c41a49fb52a311a82e2b8ea17b21fa51fcb5b375fbc151c206de6a WatchSource:0}: Error finding container 36c2984aa5c41a49fb52a311a82e2b8ea17b21fa51fcb5b375fbc151c206de6a: Status 404 returned error can't find the container with id 36c2984aa5c41a49fb52a311a82e2b8ea17b21fa51fcb5b375fbc151c206de6a
Jul 24 15:00:40.473511 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.473479    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"]
Jul 24 15:00:40.478112 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.478088    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:40.480775 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.480750    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-ba2a78-dockercfg-w9th7\""
Jul 24 15:00:40.480909 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.480761    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-ba2a78\""
Jul 24 15:00:40.488383 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.488358    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"]
Jul 24 15:00:40.494165 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.494143    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"]
Jul 24 15:00:40.497900 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.497876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:40.509971 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.509938    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"]
Jul 24 15:00:40.639750 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.639716    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6sjk\" (UniqueName: \"kubernetes.io/projected/e619512e-7463-43c0-b341-f6864c283e1a-kube-api-access-p6sjk\") pod \"payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c\" (UID: \"e619512e-7463-43c0-b341-f6864c283e1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:40.639932 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.639775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxl8g\" (UniqueName: \"kubernetes.io/projected/7eec40ae-c508-485a-819b-ae474865f51c-kube-api-access-rxl8g\") pod \"payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9\" (UID: \"7eec40ae-c508-485a-819b-ae474865f51c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:40.639932 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.639841    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eec40ae-c508-485a-819b-ae474865f51c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9\" (UID: \"7eec40ae-c508-485a-819b-ae474865f51c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:40.639932 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.639919    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e619512e-7463-43c0-b341-f6864c283e1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c\" (UID: \"e619512e-7463-43c0-b341-f6864c283e1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:40.715263 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.715226    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx" event={"ID":"93f1c5dd-5eb0-4315-aaa4-95e01388436d","Type":"ContainerStarted","Data":"36c2984aa5c41a49fb52a311a82e2b8ea17b21fa51fcb5b375fbc151c206de6a"}
Jul 24 15:00:40.740783 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.740686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6sjk\" (UniqueName: \"kubernetes.io/projected/e619512e-7463-43c0-b341-f6864c283e1a-kube-api-access-p6sjk\") pod \"payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c\" (UID: \"e619512e-7463-43c0-b341-f6864c283e1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:40.740783 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.740751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxl8g\" (UniqueName: \"kubernetes.io/projected/7eec40ae-c508-485a-819b-ae474865f51c-kube-api-access-rxl8g\") pod \"payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9\" (UID: \"7eec40ae-c508-485a-819b-ae474865f51c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:40.740783 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.740775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eec40ae-c508-485a-819b-ae474865f51c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9\" (UID: \"7eec40ae-c508-485a-819b-ae474865f51c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:40.741096 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.740801    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e619512e-7463-43c0-b341-f6864c283e1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c\" (UID: \"e619512e-7463-43c0-b341-f6864c283e1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:40.741572 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.741553    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eec40ae-c508-485a-819b-ae474865f51c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9\" (UID: \"7eec40ae-c508-485a-819b-ae474865f51c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:40.741572 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.741564    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e619512e-7463-43c0-b341-f6864c283e1a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c\" (UID: \"e619512e-7463-43c0-b341-f6864c283e1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:40.749853 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.749818    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxl8g\" (UniqueName: \"kubernetes.io/projected/7eec40ae-c508-485a-819b-ae474865f51c-kube-api-access-rxl8g\") pod \"payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9\" (UID: \"7eec40ae-c508-485a-819b-ae474865f51c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:40.749967 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.749876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6sjk\" (UniqueName: \"kubernetes.io/projected/e619512e-7463-43c0-b341-f6864c283e1a-kube-api-access-p6sjk\") pod \"payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c\" (UID: \"e619512e-7463-43c0-b341-f6864c283e1a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:40.790818 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.790776    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:40.809663 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.809635    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:40.937871 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.937839    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"]
Jul 24 15:00:40.938930 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:00:40.938907    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode619512e_7463_43c0_b341_f6864c283e1a.slice/crio-91b25f485fab1654222d9b2f330faac065cd576e6eac764a3eb86b94235d4109 WatchSource:0}: Error finding container 91b25f485fab1654222d9b2f330faac065cd576e6eac764a3eb86b94235d4109: Status 404 returned error can't find the container with id 91b25f485fab1654222d9b2f330faac065cd576e6eac764a3eb86b94235d4109
Jul 24 15:00:40.961162 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:40.961131    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"]
Jul 24 15:00:40.961706 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:00:40.961683    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eec40ae_c508_485a_819b_ae474865f51c.slice/crio-0560d708662592a9dae8df00308e033e9c922848e8d941e5cee477137e408788 WatchSource:0}: Error finding container 0560d708662592a9dae8df00308e033e9c922848e8d941e5cee477137e408788: Status 404 returned error can't find the container with id 0560d708662592a9dae8df00308e033e9c922848e8d941e5cee477137e408788
Jul 24 15:00:41.722376 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.722338    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9" event={"ID":"7eec40ae-c508-485a-819b-ae474865f51c","Type":"ContainerStarted","Data":"27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77"}
Jul 24 15:00:41.722835 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.722425    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9" event={"ID":"7eec40ae-c508-485a-819b-ae474865f51c","Type":"ContainerStarted","Data":"0560d708662592a9dae8df00308e033e9c922848e8d941e5cee477137e408788"}
Jul 24 15:00:41.722835 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.722454    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:00:41.724093 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.724063    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c" event={"ID":"e619512e-7463-43c0-b341-f6864c283e1a","Type":"ContainerStarted","Data":"6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc"}
Jul 24 15:00:41.724216 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.724124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:41.724216 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.724148    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c" event={"ID":"e619512e-7463-43c0-b341-f6864c283e1a","Type":"ContainerStarted","Data":"91b25f485fab1654222d9b2f330faac065cd576e6eac764a3eb86b94235d4109"}
Jul 24 15:00:41.725632 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.725604    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx" event={"ID":"93f1c5dd-5eb0-4315-aaa4-95e01388436d","Type":"ContainerStarted","Data":"2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1"}
Jul 24 15:00:41.725737 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.725689    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:41.751213 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.751128    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9" podStartSLOduration=1.751108503 podStartE2EDuration="1.751108503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:41.750436262 +0000 UTC m=+2308.192186782" watchObservedRunningTime="2026-07-24 15:00:41.751108503 +0000 UTC m=+2308.192859015"
Jul 24 15:00:41.792883 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.792825    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx" podStartSLOduration=1.864711029 podStartE2EDuration="2.792810335s" totalImagesPullingTime="928.099306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:41.791228696 +0000 UTC m=+2308.232979221" watchObservedRunningTime="2026-07-24 15:00:41.792810335 +0000 UTC m=+2308.234560853"
Jul 24 15:00:41.814296 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:41.814242    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c" podStartSLOduration=1.8142272130000001 podStartE2EDuration="1.814227213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:41.813141396 +0000 UTC m=+2308.254891916" watchObservedRunningTime="2026-07-24 15:00:41.814227213 +0000 UTC m=+2308.255977787"
Jul 24 15:00:44.686799 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:44.686771    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:00:47.736372 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:47.736340    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:00:52.732084 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:52.732050    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:00:52.732498 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:00:52.732133    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:02:21.143694 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.143646    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"]
Jul 24 15:02:21.146332 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.144070    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb" podUID="8e841b3a-73bb-488c-8899-7254a76a4991" containerName="maas-api" containerID="cri-o://7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070" gracePeriod=30
Jul 24 15:02:21.203098 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.203056    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"]
Jul 24 15:02:21.203354 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.203326    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6" podUID="fc560d22-8e1e-4e94-b0e5-3ff77a5bf553" containerName="payload-processing" containerID="cri-o://5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc" gracePeriod=30
Jul 24 15:02:21.457919 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.457892    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:02:21.493722 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.493697    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:02:21.550562 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.550531    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb8zd\" (UniqueName: \"kubernetes.io/projected/8e841b3a-73bb-488c-8899-7254a76a4991-kube-api-access-mb8zd\") pod \"8e841b3a-73bb-488c-8899-7254a76a4991\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") "
Jul 24 15:02:21.550718 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.550581    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e841b3a-73bb-488c-8899-7254a76a4991-openshift-service-ca\") pod \"8e841b3a-73bb-488c-8899-7254a76a4991\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") "
Jul 24 15:02:21.550718 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.550696    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e841b3a-73bb-488c-8899-7254a76a4991-maas-api-tls\") pod \"8e841b3a-73bb-488c-8899-7254a76a4991\" (UID: \"8e841b3a-73bb-488c-8899-7254a76a4991\") "
Jul 24 15:02:21.550919 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.550896    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e841b3a-73bb-488c-8899-7254a76a4991-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e841b3a-73bb-488c-8899-7254a76a4991" (UID: "8e841b3a-73bb-488c-8899-7254a76a4991"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:02:21.552702 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.552673    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e841b3a-73bb-488c-8899-7254a76a4991-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e841b3a-73bb-488c-8899-7254a76a4991" (UID: "8e841b3a-73bb-488c-8899-7254a76a4991"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:02:21.552789 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.552728    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e841b3a-73bb-488c-8899-7254a76a4991-kube-api-access-mb8zd" (OuterVolumeSpecName: "kube-api-access-mb8zd") pod "8e841b3a-73bb-488c-8899-7254a76a4991" (UID: "8e841b3a-73bb-488c-8899-7254a76a4991"). InnerVolumeSpecName "kube-api-access-mb8zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:02:21.652258 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.652214    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-plugins-config-volume\") pod \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\" (UID: \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\") "
Jul 24 15:02:21.652424 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.652303    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkztn\" (UniqueName: \"kubernetes.io/projected/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-kube-api-access-bkztn\") pod \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\" (UID: \"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553\") "
Jul 24 15:02:21.652546 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.652530    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e841b3a-73bb-488c-8899-7254a76a4991-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:21.652606 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.652552    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb8zd\" (UniqueName: \"kubernetes.io/projected/8e841b3a-73bb-488c-8899-7254a76a4991-kube-api-access-mb8zd\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:21.652606 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.652557    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc560d22-8e1e-4e94-b0e5-3ff77a5bf553" (UID: "fc560d22-8e1e-4e94-b0e5-3ff77a5bf553"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:02:21.652606 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.652568    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e841b3a-73bb-488c-8899-7254a76a4991-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:21.654375 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.654354    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-kube-api-access-bkztn" (OuterVolumeSpecName: "kube-api-access-bkztn") pod "fc560d22-8e1e-4e94-b0e5-3ff77a5bf553" (UID: "fc560d22-8e1e-4e94-b0e5-3ff77a5bf553"). InnerVolumeSpecName "kube-api-access-bkztn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:02:21.753497 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.753406    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:21.753497 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:21.753436    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkztn\" (UniqueName: \"kubernetes.io/projected/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553-kube-api-access-bkztn\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:22.249593 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.249555    2574 generic.go:356] "Generic (PLEG): container finished" podID="8e841b3a-73bb-488c-8899-7254a76a4991" containerID="7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070" exitCode=0
Jul 24 15:02:22.250058 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.249606    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"
Jul 24 15:02:22.250058 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.249637    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb" event={"ID":"8e841b3a-73bb-488c-8899-7254a76a4991","Type":"ContainerDied","Data":"7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070"}
Jul 24 15:02:22.250058 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.249688    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb" event={"ID":"8e841b3a-73bb-488c-8899-7254a76a4991","Type":"ContainerDied","Data":"1e282ec8dc45a4998d67b2347f38ffbf3eaafe38f65b1cf51af1233c698ab20f"}
Jul 24 15:02:22.250058 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.249710    2574 scope.go:117] "RemoveContainer" containerID="7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070"
Jul 24 15:02:22.251131 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.251009    2574 generic.go:356] "Generic (PLEG): container finished" podID="fc560d22-8e1e-4e94-b0e5-3ff77a5bf553" containerID="5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc" exitCode=0
Jul 24 15:02:22.251131 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.251068    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6" event={"ID":"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553","Type":"ContainerDied","Data":"5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc"}
Jul 24 15:02:22.251131 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.251109    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6" event={"ID":"fc560d22-8e1e-4e94-b0e5-3ff77a5bf553","Type":"ContainerDied","Data":"a1ff05329bea67e487f81a77097712cc68cb78f7ecd1ba97436bd7a542573145"}
Jul 24 15:02:22.251259 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.251135    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"
Jul 24 15:02:22.259304 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.259284    2574 scope.go:117] "RemoveContainer" containerID="7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070"
Jul 24 15:02:22.259576 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:02:22.259559    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070\": container with ID starting with 7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070 not found: ID does not exist" containerID="7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070"
Jul 24 15:02:22.259652 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.259583    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070"} err="failed to get container status \"7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070\": rpc error: code = NotFound desc = could not find container \"7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070\": container with ID starting with 7c8c1e6a17dbeedb5e416af17464bdbe72a40febe8da7f6e78f44117d2836070 not found: ID does not exist"
Jul 24 15:02:22.259652 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.259600    2574 scope.go:117] "RemoveContainer" containerID="5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc"
Jul 24 15:02:22.267724 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.267702    2574 scope.go:117] "RemoveContainer" containerID="5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc"
Jul 24 15:02:22.267998 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:02:22.267978    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc\": container with ID starting with 5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc not found: ID does not exist" containerID="5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc"
Jul 24 15:02:22.268095 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.268000    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc"} err="failed to get container status \"5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc\": rpc error: code = NotFound desc = could not find container \"5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc\": container with ID starting with 5a9bc1d4a671df7bb7aa564c8d2587a456d0cab19357c331f32e234d84c850dc not found: ID does not exist"
Jul 24 15:02:22.271946 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.271925    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"]
Jul 24 15:02:22.279810 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.279748    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-51d655-7cfbf4d486-x4px6"]
Jul 24 15:02:22.292556 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.292530    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"]
Jul 24 15:02:22.295007 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:22.294984    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-51d655-7bc6c646f8-9pkhb"]
Jul 24 15:02:24.019748 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:24.019716    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e841b3a-73bb-488c-8899-7254a76a4991" path="/var/lib/kubelet/pods/8e841b3a-73bb-488c-8899-7254a76a4991/volumes"
Jul 24 15:02:24.020158 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:24.020086    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc560d22-8e1e-4e94-b0e5-3ff77a5bf553" path="/var/lib/kubelet/pods/fc560d22-8e1e-4e94-b0e5-3ff77a5bf553/volumes"
Jul 24 15:02:45.375341 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.375255    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"]
Jul 24 15:02:45.375870 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.375472    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx" podUID="93f1c5dd-5eb0-4315-aaa4-95e01388436d" containerName="maas-api" containerID="cri-o://2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1" gracePeriod=30
Jul 24 15:02:45.421628 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.421589    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"]
Jul 24 15:02:45.422100 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.421847    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9" podUID="7eec40ae-c508-485a-819b-ae474865f51c" containerName="payload-processing" containerID="cri-o://27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77" gracePeriod=30
Jul 24 15:02:45.435293 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.435258    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"]
Jul 24 15:02:45.435628 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.435513    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c" podUID="e619512e-7463-43c0-b341-f6864c283e1a" containerName="payload-pre-processing" containerID="cri-o://6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc" gracePeriod=30
Jul 24 15:02:45.694061 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.694014    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:02:45.721264 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.721245    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:02:45.726981 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.726952    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:02:45.765952 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.765917    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f1c5dd-5eb0-4315-aaa4-95e01388436d-openshift-service-ca\") pod \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") "
Jul 24 15:02:45.766148 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.765960    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxl8g\" (UniqueName: \"kubernetes.io/projected/7eec40ae-c508-485a-819b-ae474865f51c-kube-api-access-rxl8g\") pod \"7eec40ae-c508-485a-819b-ae474865f51c\" (UID: \"7eec40ae-c508-485a-819b-ae474865f51c\") "
Jul 24 15:02:45.766148 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.765992    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e619512e-7463-43c0-b341-f6864c283e1a-plugins-config-volume\") pod \"e619512e-7463-43c0-b341-f6864c283e1a\" (UID: \"e619512e-7463-43c0-b341-f6864c283e1a\") "
Jul 24 15:02:45.766148 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.766064    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqbjs\" (UniqueName: \"kubernetes.io/projected/93f1c5dd-5eb0-4315-aaa4-95e01388436d-kube-api-access-jqbjs\") pod \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") "
Jul 24 15:02:45.766148 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.766143    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eec40ae-c508-485a-819b-ae474865f51c-plugins-config-volume\") pod \"7eec40ae-c508-485a-819b-ae474865f51c\" (UID: \"7eec40ae-c508-485a-819b-ae474865f51c\") "
Jul 24 15:02:45.766379 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.766183    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6sjk\" (UniqueName: \"kubernetes.io/projected/e619512e-7463-43c0-b341-f6864c283e1a-kube-api-access-p6sjk\") pod \"e619512e-7463-43c0-b341-f6864c283e1a\" (UID: \"e619512e-7463-43c0-b341-f6864c283e1a\") "
Jul 24 15:02:45.766379 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.766212    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f1c5dd-5eb0-4315-aaa4-95e01388436d-maas-api-tls\") pod \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\" (UID: \"93f1c5dd-5eb0-4315-aaa4-95e01388436d\") "
Jul 24 15:02:45.766379 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.766338    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f1c5dd-5eb0-4315-aaa4-95e01388436d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93f1c5dd-5eb0-4315-aaa4-95e01388436d" (UID: "93f1c5dd-5eb0-4315-aaa4-95e01388436d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:02:45.766628 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.766598    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93f1c5dd-5eb0-4315-aaa4-95e01388436d-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:45.766628 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.766375    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e619512e-7463-43c0-b341-f6864c283e1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e619512e-7463-43c0-b341-f6864c283e1a" (UID: "e619512e-7463-43c0-b341-f6864c283e1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:02:45.766822 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.766753    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eec40ae-c508-485a-819b-ae474865f51c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7eec40ae-c508-485a-819b-ae474865f51c" (UID: "7eec40ae-c508-485a-819b-ae474865f51c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:02:45.768641 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.768607    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f1c5dd-5eb0-4315-aaa4-95e01388436d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93f1c5dd-5eb0-4315-aaa4-95e01388436d" (UID: "93f1c5dd-5eb0-4315-aaa4-95e01388436d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:02:45.769235 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.769201    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f1c5dd-5eb0-4315-aaa4-95e01388436d-kube-api-access-jqbjs" (OuterVolumeSpecName: "kube-api-access-jqbjs") pod "93f1c5dd-5eb0-4315-aaa4-95e01388436d" (UID: "93f1c5dd-5eb0-4315-aaa4-95e01388436d"). InnerVolumeSpecName "kube-api-access-jqbjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:02:45.769849 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.769814    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eec40ae-c508-485a-819b-ae474865f51c-kube-api-access-rxl8g" (OuterVolumeSpecName: "kube-api-access-rxl8g") pod "7eec40ae-c508-485a-819b-ae474865f51c" (UID: "7eec40ae-c508-485a-819b-ae474865f51c"). InnerVolumeSpecName "kube-api-access-rxl8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:02:45.769956 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.769917    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e619512e-7463-43c0-b341-f6864c283e1a-kube-api-access-p6sjk" (OuterVolumeSpecName: "kube-api-access-p6sjk") pod "e619512e-7463-43c0-b341-f6864c283e1a" (UID: "e619512e-7463-43c0-b341-f6864c283e1a"). InnerVolumeSpecName "kube-api-access-p6sjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:02:45.867144 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.867101    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxl8g\" (UniqueName: \"kubernetes.io/projected/7eec40ae-c508-485a-819b-ae474865f51c-kube-api-access-rxl8g\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:45.867144 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.867136    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e619512e-7463-43c0-b341-f6864c283e1a-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:45.867144 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.867149    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqbjs\" (UniqueName: \"kubernetes.io/projected/93f1c5dd-5eb0-4315-aaa4-95e01388436d-kube-api-access-jqbjs\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:45.867399 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.867162    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7eec40ae-c508-485a-819b-ae474865f51c-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:45.867399 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.867174    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6sjk\" (UniqueName: \"kubernetes.io/projected/e619512e-7463-43c0-b341-f6864c283e1a-kube-api-access-p6sjk\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:45.867399 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:45.867186    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93f1c5dd-5eb0-4315-aaa4-95e01388436d-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:02:46.374977 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.374891    2574 generic.go:356] "Generic (PLEG): container finished" podID="7eec40ae-c508-485a-819b-ae474865f51c" containerID="27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77" exitCode=0
Jul 24 15:02:46.374977 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.374937    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"
Jul 24 15:02:46.375208 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.374979    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9" event={"ID":"7eec40ae-c508-485a-819b-ae474865f51c","Type":"ContainerDied","Data":"27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77"}
Jul 24 15:02:46.375208 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.375057    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9" event={"ID":"7eec40ae-c508-485a-819b-ae474865f51c","Type":"ContainerDied","Data":"0560d708662592a9dae8df00308e033e9c922848e8d941e5cee477137e408788"}
Jul 24 15:02:46.375208 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.375086    2574 scope.go:117] "RemoveContainer" containerID="27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77"
Jul 24 15:02:46.376442 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.376244    2574 generic.go:356] "Generic (PLEG): container finished" podID="e619512e-7463-43c0-b341-f6864c283e1a" containerID="6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc" exitCode=0
Jul 24 15:02:46.376442 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.376270    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c" event={"ID":"e619512e-7463-43c0-b341-f6864c283e1a","Type":"ContainerDied","Data":"6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc"}
Jul 24 15:02:46.376442 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.376301    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"
Jul 24 15:02:46.376442 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.376311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c" event={"ID":"e619512e-7463-43c0-b341-f6864c283e1a","Type":"ContainerDied","Data":"91b25f485fab1654222d9b2f330faac065cd576e6eac764a3eb86b94235d4109"}
Jul 24 15:02:46.377796 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.377778    2574 generic.go:356] "Generic (PLEG): container finished" podID="93f1c5dd-5eb0-4315-aaa4-95e01388436d" containerID="2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1" exitCode=0
Jul 24 15:02:46.377906 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.377814    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"
Jul 24 15:02:46.377906 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.377819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx" event={"ID":"93f1c5dd-5eb0-4315-aaa4-95e01388436d","Type":"ContainerDied","Data":"2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1"}
Jul 24 15:02:46.377906 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.377847    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx" event={"ID":"93f1c5dd-5eb0-4315-aaa4-95e01388436d","Type":"ContainerDied","Data":"36c2984aa5c41a49fb52a311a82e2b8ea17b21fa51fcb5b375fbc151c206de6a"}
Jul 24 15:02:46.384692 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.384677    2574 scope.go:117] "RemoveContainer" containerID="27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77"
Jul 24 15:02:46.384951 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:02:46.384934    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77\": container with ID starting with 27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77 not found: ID does not exist" containerID="27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77"
Jul 24 15:02:46.385103 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.384964    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77"} err="failed to get container status \"27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77\": rpc error: code = NotFound desc = could not find container \"27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77\": container with ID starting with 27d6bbfde003869d46a8b7f2334f7fe3ec55964ffd820687ca5c515cb87e0e77 not found: ID does not exist"
Jul 24 15:02:46.385103 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.384989    2574 scope.go:117] "RemoveContainer" containerID="6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc"
Jul 24 15:02:46.397989 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.397957    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"]
Jul 24 15:02:46.403282 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.403256    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ba2a78-cb9db7ccb-wcghx"]
Jul 24 15:02:46.403812 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.403797    2574 scope.go:117] "RemoveContainer" containerID="6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc"
Jul 24 15:02:46.404203 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:02:46.404180    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc\": container with ID starting with 6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc not found: ID does not exist" containerID="6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc"
Jul 24 15:02:46.404287 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.404213    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc"} err="failed to get container status \"6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc\": rpc error: code = NotFound desc = could not find container \"6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc\": container with ID starting with 6acf2c6d6640fdcfa36694873f964293361222c6c8ed3cb2acd5b7e4b2ce62fc not found: ID does not exist"
Jul 24 15:02:46.404287 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.404234    2574 scope.go:117] "RemoveContainer" containerID="2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1"
Jul 24 15:02:46.412386 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.412367    2574 scope.go:117] "RemoveContainer" containerID="2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1"
Jul 24 15:02:46.412655 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:02:46.412634    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1\": container with ID starting with 2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1 not found: ID does not exist" containerID="2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1"
Jul 24 15:02:46.412716 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.412664    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1"} err="failed to get container status \"2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1\": rpc error: code = NotFound desc = could not find container \"2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1\": container with ID starting with 2f7ee0ed5ad32882d532c4ee0c17cc2733569132633edf4a25f422dff61822c1 not found: ID does not exist"
Jul 24 15:02:46.417607 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.417585    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"]
Jul 24 15:02:46.426487 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.426466    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ba2a78-5ccbd77968-j2g9c"]
Jul 24 15:02:46.440646 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.440622    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"]
Jul 24 15:02:46.445331 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:46.445310    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ba2a78-74bbcdc74-zcdp9"]
Jul 24 15:02:48.018876 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:48.018839    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eec40ae-c508-485a-819b-ae474865f51c" path="/var/lib/kubelet/pods/7eec40ae-c508-485a-819b-ae474865f51c/volumes"
Jul 24 15:02:48.019282 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:48.019238    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f1c5dd-5eb0-4315-aaa4-95e01388436d" path="/var/lib/kubelet/pods/93f1c5dd-5eb0-4315-aaa4-95e01388436d/volumes"
Jul 24 15:02:48.019543 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:02:48.019530    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e619512e-7463-43c0-b341-f6864c283e1a" path="/var/lib/kubelet/pods/e619512e-7463-43c0-b341-f6864c283e1a/volumes"
Jul 24 15:03:02.485717 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.485681    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"]
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486007    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f1c5dd-5eb0-4315-aaa4-95e01388436d" containerName="maas-api"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486018    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f1c5dd-5eb0-4315-aaa4-95e01388436d" containerName="maas-api"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486044    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc560d22-8e1e-4e94-b0e5-3ff77a5bf553" containerName="payload-processing"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486050    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc560d22-8e1e-4e94-b0e5-3ff77a5bf553" containerName="payload-processing"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486059    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eec40ae-c508-485a-819b-ae474865f51c" containerName="payload-processing"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486065    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eec40ae-c508-485a-819b-ae474865f51c" containerName="payload-processing"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486078    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e619512e-7463-43c0-b341-f6864c283e1a" containerName="payload-pre-processing"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486083    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e619512e-7463-43c0-b341-f6864c283e1a" containerName="payload-pre-processing"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486091    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e841b3a-73bb-488c-8899-7254a76a4991" containerName="maas-api"
Jul 24 15:03:02.486124 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486097    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e841b3a-73bb-488c-8899-7254a76a4991" containerName="maas-api"
Jul 24 15:03:02.486419 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486144    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f1c5dd-5eb0-4315-aaa4-95e01388436d" containerName="maas-api"
Jul 24 15:03:02.486419 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486151    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc560d22-8e1e-4e94-b0e5-3ff77a5bf553" containerName="payload-processing"
Jul 24 15:03:02.486419 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486158    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e619512e-7463-43c0-b341-f6864c283e1a" containerName="payload-pre-processing"
Jul 24 15:03:02.486419 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486163    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e841b3a-73bb-488c-8899-7254a76a4991" containerName="maas-api"
Jul 24 15:03:02.486419 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.486169    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eec40ae-c508-485a-819b-ae474865f51c" containerName="payload-processing"
Jul 24 15:03:02.489047 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.489008    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.492573 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.492551    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 15:03:02.492772 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.492756    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2ea794-serving-cert\""
Jul 24 15:03:02.551547 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.551513    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"]
Jul 24 15:03:02.618050 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.617998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zjzn\" (UniqueName: \"kubernetes.io/projected/0ac02ecf-2743-4b85-b12f-a6e557735d53-kube-api-access-2zjzn\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.618214 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.618117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac02ecf-2743-4b85-b12f-a6e557735d53-openshift-service-ca\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.618214 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.618156    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac02ecf-2743-4b85-b12f-a6e557735d53-maas-api-tls\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.719087 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.719052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjzn\" (UniqueName: \"kubernetes.io/projected/0ac02ecf-2743-4b85-b12f-a6e557735d53-kube-api-access-2zjzn\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.719270 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.719111    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac02ecf-2743-4b85-b12f-a6e557735d53-openshift-service-ca\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.719270 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.719141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac02ecf-2743-4b85-b12f-a6e557735d53-maas-api-tls\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.719772 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.719754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac02ecf-2743-4b85-b12f-a6e557735d53-openshift-service-ca\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.721667 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.721642    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac02ecf-2743-4b85-b12f-a6e557735d53-maas-api-tls\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.730883 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.730861    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zjzn\" (UniqueName: \"kubernetes.io/projected/0ac02ecf-2743-4b85-b12f-a6e557735d53-kube-api-access-2zjzn\") pod \"maas-api-e2e-api-a-2ea794-69c659564f-ghj65\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.799182 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.799090    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:02.950979 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.950956    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"]
Jul 24 15:03:02.953694 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:03:02.953668    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac02ecf_2743_4b85_b12f_a6e557735d53.slice/crio-1c74aae1feecd11b5a1cd8941150cb0e2b10c61448411d4a5a3a2353295aa284 WatchSource:0}: Error finding container 1c74aae1feecd11b5a1cd8941150cb0e2b10c61448411d4a5a3a2353295aa284: Status 404 returned error can't find the container with id 1c74aae1feecd11b5a1cd8941150cb0e2b10c61448411d4a5a3a2353295aa284
Jul 24 15:03:02.955242 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:02.955223    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:03:03.470570 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.470534    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65" event={"ID":"0ac02ecf-2743-4b85-b12f-a6e557735d53","Type":"ContainerStarted","Data":"1c74aae1feecd11b5a1cd8941150cb0e2b10c61448411d4a5a3a2353295aa284"}
Jul 24 15:03:03.544549 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.544517    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"]
Jul 24 15:03:03.549388 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.549362    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:03.552953 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.552925    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2ea794\""
Jul 24 15:03:03.565289 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.565252    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"]
Jul 24 15:03:03.626537 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.626500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l498c\" (UniqueName: \"kubernetes.io/projected/b479514e-0b14-4db7-b436-fd52ffd30afb-kube-api-access-l498c\") pod \"payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5\" (UID: \"b479514e-0b14-4db7-b436-fd52ffd30afb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:03.626752 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.626572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b479514e-0b14-4db7-b436-fd52ffd30afb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5\" (UID: \"b479514e-0b14-4db7-b436-fd52ffd30afb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:03.651195 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.651156    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"]
Jul 24 15:03:03.654686 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.654663    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:03.660670 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.660645    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-2ea794-dockercfg-ffjkq\""
Jul 24 15:03:03.671760 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.671585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"]
Jul 24 15:03:03.728022 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.727917    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l498c\" (UniqueName: \"kubernetes.io/projected/b479514e-0b14-4db7-b436-fd52ffd30afb-kube-api-access-l498c\") pod \"payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5\" (UID: \"b479514e-0b14-4db7-b436-fd52ffd30afb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:03.728022 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.727972    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b479514e-0b14-4db7-b436-fd52ffd30afb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5\" (UID: \"b479514e-0b14-4db7-b436-fd52ffd30afb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:03.728284 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.728059    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bbe3f19-5bf6-4899-9687-2cb3c65509be-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9\" (UID: \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\") " pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:03.728284 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.728088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chnxw\" (UniqueName: \"kubernetes.io/projected/1bbe3f19-5bf6-4899-9687-2cb3c65509be-kube-api-access-chnxw\") pod \"payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9\" (UID: \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\") " pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:03.728892 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.728870    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b479514e-0b14-4db7-b436-fd52ffd30afb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5\" (UID: \"b479514e-0b14-4db7-b436-fd52ffd30afb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:03.747686 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.747650    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l498c\" (UniqueName: \"kubernetes.io/projected/b479514e-0b14-4db7-b436-fd52ffd30afb-kube-api-access-l498c\") pod \"payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5\" (UID: \"b479514e-0b14-4db7-b436-fd52ffd30afb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:03.828903 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.828863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bbe3f19-5bf6-4899-9687-2cb3c65509be-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9\" (UID: \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\") " pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:03.828903 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.828902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chnxw\" (UniqueName: \"kubernetes.io/projected/1bbe3f19-5bf6-4899-9687-2cb3c65509be-kube-api-access-chnxw\") pod \"payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9\" (UID: \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\") " pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:03.829868 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.829844    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bbe3f19-5bf6-4899-9687-2cb3c65509be-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9\" (UID: \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\") " pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:03.844945 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.844918    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chnxw\" (UniqueName: \"kubernetes.io/projected/1bbe3f19-5bf6-4899-9687-2cb3c65509be-kube-api-access-chnxw\") pod \"payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9\" (UID: \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\") " pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:03.872932 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.872891    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:03.965352 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:03.965277    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:04.039678 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.039650    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"]
Jul 24 15:03:04.041682 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:03:04.041653    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb479514e_0b14_4db7_b436_fd52ffd30afb.slice/crio-833956ac48248d06f2581a4f3043a50d37f6b98189e438b49ad63de67569c506 WatchSource:0}: Error finding container 833956ac48248d06f2581a4f3043a50d37f6b98189e438b49ad63de67569c506: Status 404 returned error can't find the container with id 833956ac48248d06f2581a4f3043a50d37f6b98189e438b49ad63de67569c506
Jul 24 15:03:04.129121 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.129088    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"]
Jul 24 15:03:04.130218 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:03:04.130196    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbe3f19_5bf6_4899_9687_2cb3c65509be.slice/crio-e32512d0a0247cc79726b80696e9d3036919fa6fbe111f8a7a3ab43f9d7b9101 WatchSource:0}: Error finding container e32512d0a0247cc79726b80696e9d3036919fa6fbe111f8a7a3ab43f9d7b9101: Status 404 returned error can't find the container with id e32512d0a0247cc79726b80696e9d3036919fa6fbe111f8a7a3ab43f9d7b9101
Jul 24 15:03:04.478160 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.478123    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5" event={"ID":"b479514e-0b14-4db7-b436-fd52ffd30afb","Type":"ContainerStarted","Data":"7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac"}
Jul 24 15:03:04.478372 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.478184    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5" event={"ID":"b479514e-0b14-4db7-b436-fd52ffd30afb","Type":"ContainerStarted","Data":"833956ac48248d06f2581a4f3043a50d37f6b98189e438b49ad63de67569c506"}
Jul 24 15:03:04.478372 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.478241    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:04.480152 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.480124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65" event={"ID":"0ac02ecf-2743-4b85-b12f-a6e557735d53","Type":"ContainerStarted","Data":"1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c"}
Jul 24 15:03:04.480299 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.480235    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:04.481767 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.481745    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9" event={"ID":"1bbe3f19-5bf6-4899-9687-2cb3c65509be","Type":"ContainerStarted","Data":"444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512"}
Jul 24 15:03:04.481876 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.481784    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9" event={"ID":"1bbe3f19-5bf6-4899-9687-2cb3c65509be","Type":"ContainerStarted","Data":"e32512d0a0247cc79726b80696e9d3036919fa6fbe111f8a7a3ab43f9d7b9101"}
Jul 24 15:03:04.481876 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.481821    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:04.504533 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.504480    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5" podStartSLOduration=1.5044657639999999 podStartE2EDuration="1.504465764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:04.502322393 +0000 UTC m=+2450.944072912" watchObservedRunningTime="2026-07-24 15:03:04.504465764 +0000 UTC m=+2450.946216279"
Jul 24 15:03:04.525649 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.525597    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9" podStartSLOduration=1.525581207 podStartE2EDuration="1.525581207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:04.523696809 +0000 UTC m=+2450.965447331" watchObservedRunningTime="2026-07-24 15:03:04.525581207 +0000 UTC m=+2450.967331726"
Jul 24 15:03:04.548285 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:04.548236    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65" podStartSLOduration=1.9916448770000001 podStartE2EDuration="2.548220008s" totalImagesPullingTime="556.575131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:04.546068817 +0000 UTC m=+2450.987819337" watchObservedRunningTime="2026-07-24 15:03:04.548220008 +0000 UTC m=+2450.989970557"
Jul 24 15:03:10.500930 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.500899    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:10.810141 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.810048    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"]
Jul 24 15:03:10.813831 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.813808    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:10.823081 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.823057    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a1a404-serving-cert\""
Jul 24 15:03:10.838456 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.838428    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"]
Jul 24 15:03:10.893474 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.893444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93072b33-47b5-4a7d-a31e-7b814588859b-openshift-service-ca\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:10.893474 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.893476    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgtd\" (UniqueName: \"kubernetes.io/projected/93072b33-47b5-4a7d-a31e-7b814588859b-kube-api-access-5wgtd\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:10.893691 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.893520    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93072b33-47b5-4a7d-a31e-7b814588859b-maas-api-tls\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:10.994954 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.994923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93072b33-47b5-4a7d-a31e-7b814588859b-openshift-service-ca\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:10.994954 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.994956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgtd\" (UniqueName: \"kubernetes.io/projected/93072b33-47b5-4a7d-a31e-7b814588859b-kube-api-access-5wgtd\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:10.995195 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.995018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93072b33-47b5-4a7d-a31e-7b814588859b-maas-api-tls\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:10.995718 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.995692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93072b33-47b5-4a7d-a31e-7b814588859b-openshift-service-ca\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:10.997730 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:10.997704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93072b33-47b5-4a7d-a31e-7b814588859b-maas-api-tls\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:11.013952 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.013924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgtd\" (UniqueName: \"kubernetes.io/projected/93072b33-47b5-4a7d-a31e-7b814588859b-kube-api-access-5wgtd\") pod \"maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:11.124339 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.124236    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:11.269978 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.269947    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"]
Jul 24 15:03:11.272111 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:03:11.272085    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93072b33_47b5_4a7d_a31e_7b814588859b.slice/crio-ce513f650b49d5ecb669f7c1cce5f932aea89019878c488918a67dba3fa7a219 WatchSource:0}: Error finding container ce513f650b49d5ecb669f7c1cce5f932aea89019878c488918a67dba3fa7a219: Status 404 returned error can't find the container with id ce513f650b49d5ecb669f7c1cce5f932aea89019878c488918a67dba3fa7a219
Jul 24 15:03:11.527370 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.527331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr" event={"ID":"93072b33-47b5-4a7d-a31e-7b814588859b","Type":"ContainerStarted","Data":"ce513f650b49d5ecb669f7c1cce5f932aea89019878c488918a67dba3fa7a219"}
Jul 24 15:03:11.656170 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.656141    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"]
Jul 24 15:03:11.660711 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.660693    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:11.664160 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.664140    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a1a404\""
Jul 24 15:03:11.664310 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.664258    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a1a404-dockercfg-czrhz\""
Jul 24 15:03:11.673046 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.673004    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"]
Jul 24 15:03:11.803272 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.803186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njrhl\" (UniqueName: \"kubernetes.io/projected/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-kube-api-access-njrhl\") pod \"payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2\" (UID: \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:11.803411 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.803304    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2\" (UID: \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:11.904396 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.904351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2\" (UID: \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:11.904582 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.904461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njrhl\" (UniqueName: \"kubernetes.io/projected/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-kube-api-access-njrhl\") pod \"payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2\" (UID: \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:11.905139 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.905120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2\" (UID: \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:11.916316 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.916285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njrhl\" (UniqueName: \"kubernetes.io/projected/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-kube-api-access-njrhl\") pod \"payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2\" (UID: \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\") " pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:11.971277 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:11.971243    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:12.162590 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:12.162560    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"]
Jul 24 15:03:12.164149 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:03:12.164123    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f8fb87_664a_46f8_b50b_b0e40b6ffa08.slice/crio-558136fd96b2aa2033f6c99ab74961a5b7f2792abec49ec1c022490f1a6c1b50 WatchSource:0}: Error finding container 558136fd96b2aa2033f6c99ab74961a5b7f2792abec49ec1c022490f1a6c1b50: Status 404 returned error can't find the container with id 558136fd96b2aa2033f6c99ab74961a5b7f2792abec49ec1c022490f1a6c1b50
Jul 24 15:03:12.535211 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:12.535174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2" event={"ID":"27f8fb87-664a-46f8-b50b-b0e40b6ffa08","Type":"ContainerStarted","Data":"d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1"}
Jul 24 15:03:12.535676 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:12.535241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2" event={"ID":"27f8fb87-664a-46f8-b50b-b0e40b6ffa08","Type":"ContainerStarted","Data":"558136fd96b2aa2033f6c99ab74961a5b7f2792abec49ec1c022490f1a6c1b50"}
Jul 24 15:03:12.535676 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:12.535274    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:12.536935 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:12.536910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr" event={"ID":"93072b33-47b5-4a7d-a31e-7b814588859b","Type":"ContainerStarted","Data":"cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1"}
Jul 24 15:03:12.537068 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:12.536973    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:12.556796 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:12.556739    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2" podStartSLOduration=1.556718585 podStartE2EDuration="1.556718585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:12.55442632 +0000 UTC m=+2458.996176842" watchObservedRunningTime="2026-07-24 15:03:12.556718585 +0000 UTC m=+2458.998469104"
Jul 24 15:03:12.574886 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:12.574835    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr" podStartSLOduration=2.025402626 podStartE2EDuration="2.574818019s" totalImagesPullingTime="549.415393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:12.57333125 +0000 UTC m=+2459.015081770" watchObservedRunningTime="2026-07-24 15:03:12.574818019 +0000 UTC m=+2459.016568538"
Jul 24 15:03:15.497086 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:15.497055    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:15.497544 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:15.497272    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:18.549292 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:18.549264    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:03:23.544969 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:23.544939    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:03:38.562398 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.562365    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"]
Jul 24 15:03:38.562839 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.562605    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65" podUID="0ac02ecf-2743-4b85-b12f-a6e557735d53" containerName="maas-api" containerID="cri-o://1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c" gracePeriod=30
Jul 24 15:03:38.650259 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.650220    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"]
Jul 24 15:03:38.650452 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.650423    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9" podUID="1bbe3f19-5bf6-4899-9687-2cb3c65509be" containerName="payload-processing" containerID="cri-o://444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512" gracePeriod=30
Jul 24 15:03:38.658699 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.658666    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"]
Jul 24 15:03:38.658936 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.658891    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5" podUID="b479514e-0b14-4db7-b436-fd52ffd30afb" containerName="payload-pre-processing" containerID="cri-o://7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac" gracePeriod=30
Jul 24 15:03:38.909042 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.908996    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:38.941521 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.941495    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:38.948607 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.948584    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zjzn\" (UniqueName: \"kubernetes.io/projected/0ac02ecf-2743-4b85-b12f-a6e557735d53-kube-api-access-2zjzn\") pod \"0ac02ecf-2743-4b85-b12f-a6e557735d53\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") "
Jul 24 15:03:38.948721 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.948617    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac02ecf-2743-4b85-b12f-a6e557735d53-openshift-service-ca\") pod \"0ac02ecf-2743-4b85-b12f-a6e557735d53\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") "
Jul 24 15:03:38.948721 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.948658    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac02ecf-2743-4b85-b12f-a6e557735d53-maas-api-tls\") pod \"0ac02ecf-2743-4b85-b12f-a6e557735d53\" (UID: \"0ac02ecf-2743-4b85-b12f-a6e557735d53\") "
Jul 24 15:03:38.948966 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.948942    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac02ecf-2743-4b85-b12f-a6e557735d53-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ac02ecf-2743-4b85-b12f-a6e557735d53" (UID: "0ac02ecf-2743-4b85-b12f-a6e557735d53"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:03:38.949515 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.949497    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:38.950840 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.950819    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac02ecf-2743-4b85-b12f-a6e557735d53-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ac02ecf-2743-4b85-b12f-a6e557735d53" (UID: "0ac02ecf-2743-4b85-b12f-a6e557735d53"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:03:38.950905 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:38.950820    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac02ecf-2743-4b85-b12f-a6e557735d53-kube-api-access-2zjzn" (OuterVolumeSpecName: "kube-api-access-2zjzn") pod "0ac02ecf-2743-4b85-b12f-a6e557735d53" (UID: "0ac02ecf-2743-4b85-b12f-a6e557735d53"). InnerVolumeSpecName "kube-api-access-2zjzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:03:39.049714 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.049675    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bbe3f19-5bf6-4899-9687-2cb3c65509be-plugins-config-volume\") pod \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\" (UID: \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\") "
Jul 24 15:03:39.049893 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.049782    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chnxw\" (UniqueName: \"kubernetes.io/projected/1bbe3f19-5bf6-4899-9687-2cb3c65509be-kube-api-access-chnxw\") pod \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\" (UID: \"1bbe3f19-5bf6-4899-9687-2cb3c65509be\") "
Jul 24 15:03:39.049893 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.049815    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l498c\" (UniqueName: \"kubernetes.io/projected/b479514e-0b14-4db7-b436-fd52ffd30afb-kube-api-access-l498c\") pod \"b479514e-0b14-4db7-b436-fd52ffd30afb\" (UID: \"b479514e-0b14-4db7-b436-fd52ffd30afb\") "
Jul 24 15:03:39.049893 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.049832    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b479514e-0b14-4db7-b436-fd52ffd30afb-plugins-config-volume\") pod \"b479514e-0b14-4db7-b436-fd52ffd30afb\" (UID: \"b479514e-0b14-4db7-b436-fd52ffd30afb\") "
Jul 24 15:03:39.050080 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.050060    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zjzn\" (UniqueName: \"kubernetes.io/projected/0ac02ecf-2743-4b85-b12f-a6e557735d53-kube-api-access-2zjzn\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:03:39.050163 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.050085    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac02ecf-2743-4b85-b12f-a6e557735d53-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:03:39.050163 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.050100    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ac02ecf-2743-4b85-b12f-a6e557735d53-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:03:39.050163 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.050078    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bbe3f19-5bf6-4899-9687-2cb3c65509be-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1bbe3f19-5bf6-4899-9687-2cb3c65509be" (UID: "1bbe3f19-5bf6-4899-9687-2cb3c65509be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:03:39.050378 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.050356    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b479514e-0b14-4db7-b436-fd52ffd30afb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b479514e-0b14-4db7-b436-fd52ffd30afb" (UID: "b479514e-0b14-4db7-b436-fd52ffd30afb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:03:39.051978 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.051959    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b479514e-0b14-4db7-b436-fd52ffd30afb-kube-api-access-l498c" (OuterVolumeSpecName: "kube-api-access-l498c") pod "b479514e-0b14-4db7-b436-fd52ffd30afb" (UID: "b479514e-0b14-4db7-b436-fd52ffd30afb"). InnerVolumeSpecName "kube-api-access-l498c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:03:39.052063 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.051986    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bbe3f19-5bf6-4899-9687-2cb3c65509be-kube-api-access-chnxw" (OuterVolumeSpecName: "kube-api-access-chnxw") pod "1bbe3f19-5bf6-4899-9687-2cb3c65509be" (UID: "1bbe3f19-5bf6-4899-9687-2cb3c65509be"). InnerVolumeSpecName "kube-api-access-chnxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:03:39.151187 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.151098    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chnxw\" (UniqueName: \"kubernetes.io/projected/1bbe3f19-5bf6-4899-9687-2cb3c65509be-kube-api-access-chnxw\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:03:39.151187 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.151126    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l498c\" (UniqueName: \"kubernetes.io/projected/b479514e-0b14-4db7-b436-fd52ffd30afb-kube-api-access-l498c\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:03:39.151187 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.151141    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b479514e-0b14-4db7-b436-fd52ffd30afb-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:03:39.151187 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.151151    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bbe3f19-5bf6-4899-9687-2cb3c65509be-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:03:39.683403 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.683363    2574 generic.go:356] "Generic (PLEG): container finished" podID="b479514e-0b14-4db7-b436-fd52ffd30afb" containerID="7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac" exitCode=0
Jul 24 15:03:39.683861 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.683413    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"
Jul 24 15:03:39.683861 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.683414    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5" event={"ID":"b479514e-0b14-4db7-b436-fd52ffd30afb","Type":"ContainerDied","Data":"7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac"}
Jul 24 15:03:39.683861 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.683463    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5" event={"ID":"b479514e-0b14-4db7-b436-fd52ffd30afb","Type":"ContainerDied","Data":"833956ac48248d06f2581a4f3043a50d37f6b98189e438b49ad63de67569c506"}
Jul 24 15:03:39.683861 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.683485    2574 scope.go:117] "RemoveContainer" containerID="7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac"
Jul 24 15:03:39.684855 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.684808    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ac02ecf-2743-4b85-b12f-a6e557735d53" containerID="1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c" exitCode=0
Jul 24 15:03:39.684924 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.684895    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"
Jul 24 15:03:39.684924 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.684906    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65" event={"ID":"0ac02ecf-2743-4b85-b12f-a6e557735d53","Type":"ContainerDied","Data":"1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c"}
Jul 24 15:03:39.685022 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.684962    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65" event={"ID":"0ac02ecf-2743-4b85-b12f-a6e557735d53","Type":"ContainerDied","Data":"1c74aae1feecd11b5a1cd8941150cb0e2b10c61448411d4a5a3a2353295aa284"}
Jul 24 15:03:39.696789 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.696757    2574 generic.go:356] "Generic (PLEG): container finished" podID="1bbe3f19-5bf6-4899-9687-2cb3c65509be" containerID="444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512" exitCode=0
Jul 24 15:03:39.696979 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.696852    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"
Jul 24 15:03:39.697164 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.696872    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9" event={"ID":"1bbe3f19-5bf6-4899-9687-2cb3c65509be","Type":"ContainerDied","Data":"444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512"}
Jul 24 15:03:39.697280 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.697230    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9" event={"ID":"1bbe3f19-5bf6-4899-9687-2cb3c65509be","Type":"ContainerDied","Data":"e32512d0a0247cc79726b80696e9d3036919fa6fbe111f8a7a3ab43f9d7b9101"}
Jul 24 15:03:39.698189 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.698141    2574 scope.go:117] "RemoveContainer" containerID="7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac"
Jul 24 15:03:39.698516 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:03:39.698491    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac\": container with ID starting with 7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac not found: ID does not exist" containerID="7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac"
Jul 24 15:03:39.698605 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.698527    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac"} err="failed to get container status \"7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac\": rpc error: code = NotFound desc = could not find container \"7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac\": container with ID starting with 7ca60dc89af088271c6d52fe988c8d6d457a46486704255c390cdcecf0ebfeac not found: ID does not exist"
Jul 24 15:03:39.698605 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.698550    2574 scope.go:117] "RemoveContainer" containerID="1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c"
Jul 24 15:03:39.708598 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.708581    2574 scope.go:117] "RemoveContainer" containerID="1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c"
Jul 24 15:03:39.708833 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:03:39.708816    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c\": container with ID starting with 1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c not found: ID does not exist" containerID="1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c"
Jul 24 15:03:39.708886 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.708841    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c"} err="failed to get container status \"1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c\": rpc error: code = NotFound desc = could not find container \"1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c\": container with ID starting with 1027b1abb4470844dfd7c97ff0e96635ee8d9462fb96bbd6740b8614fcd9866c not found: ID does not exist"
Jul 24 15:03:39.708886 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.708857    2574 scope.go:117] "RemoveContainer" containerID="444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512"
Jul 24 15:03:39.716549 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.716535    2574 scope.go:117] "RemoveContainer" containerID="444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512"
Jul 24 15:03:39.716782 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:03:39.716767    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512\": container with ID starting with 444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512 not found: ID does not exist" containerID="444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512"
Jul 24 15:03:39.716826 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.716789    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512"} err="failed to get container status \"444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512\": rpc error: code = NotFound desc = could not find container \"444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512\": container with ID starting with 444ba75e896fc842cc1e3ba8c9328fc090eedfe9c36f211b182027a04e8f1512 not found: ID does not exist"
Jul 24 15:03:39.720421 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.720399    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"]
Jul 24 15:03:39.727123 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.727100    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ea794-69c659564f-ghj65"]
Jul 24 15:03:39.742204 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.742178    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"]
Jul 24 15:03:39.750275 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.750251    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2ea794-5b4b7897d4-hj4v9"]
Jul 24 15:03:39.763242 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.763207    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"]
Jul 24 15:03:39.768253 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:39.768230    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ea794-5dd95c8944-mhxz5"]
Jul 24 15:03:40.019058 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:40.019007    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ac02ecf-2743-4b85-b12f-a6e557735d53" path="/var/lib/kubelet/pods/0ac02ecf-2743-4b85-b12f-a6e557735d53/volumes"
Jul 24 15:03:40.019399 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:40.019386    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bbe3f19-5bf6-4899-9687-2cb3c65509be" path="/var/lib/kubelet/pods/1bbe3f19-5bf6-4899-9687-2cb3c65509be/volumes"
Jul 24 15:03:40.019715 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:03:40.019703    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b479514e-0b14-4db7-b436-fd52ffd30afb" path="/var/lib/kubelet/pods/b479514e-0b14-4db7-b436-fd52ffd30afb/volumes"
Jul 24 15:04:07.745744 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:07.745662    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"]
Jul 24 15:04:07.746359 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:07.745939    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr" podUID="93072b33-47b5-4a7d-a31e-7b814588859b" containerName="maas-api" containerID="cri-o://cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1" gracePeriod=30
Jul 24 15:04:07.811466 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:07.810952    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"]
Jul 24 15:04:07.811466 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:07.811231    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2" podUID="27f8fb87-664a-46f8-b50b-b0e40b6ffa08" containerName="payload-processing" containerID="cri-o://d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1" gracePeriod=30
Jul 24 15:04:08.057288 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.057264    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:04:08.088181 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.088160    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:04:08.118846 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.118797    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93072b33-47b5-4a7d-a31e-7b814588859b-maas-api-tls\") pod \"93072b33-47b5-4a7d-a31e-7b814588859b\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") "
Jul 24 15:04:08.118846 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.118852    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njrhl\" (UniqueName: \"kubernetes.io/projected/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-kube-api-access-njrhl\") pod \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\" (UID: \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\") "
Jul 24 15:04:08.119121 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.118879    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-plugins-config-volume\") pod \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\" (UID: \"27f8fb87-664a-46f8-b50b-b0e40b6ffa08\") "
Jul 24 15:04:08.119121 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.118905    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93072b33-47b5-4a7d-a31e-7b814588859b-openshift-service-ca\") pod \"93072b33-47b5-4a7d-a31e-7b814588859b\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") "
Jul 24 15:04:08.119121 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.118949    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wgtd\" (UniqueName: \"kubernetes.io/projected/93072b33-47b5-4a7d-a31e-7b814588859b-kube-api-access-5wgtd\") pod \"93072b33-47b5-4a7d-a31e-7b814588859b\" (UID: \"93072b33-47b5-4a7d-a31e-7b814588859b\") "
Jul 24 15:04:08.119356 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.119288    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93072b33-47b5-4a7d-a31e-7b814588859b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93072b33-47b5-4a7d-a31e-7b814588859b" (UID: "93072b33-47b5-4a7d-a31e-7b814588859b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:04:08.119356 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.119317    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27f8fb87-664a-46f8-b50b-b0e40b6ffa08" (UID: "27f8fb87-664a-46f8-b50b-b0e40b6ffa08"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:04:08.119524 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.119426    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:04:08.119524 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.119444    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93072b33-47b5-4a7d-a31e-7b814588859b-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:04:08.121076 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.121005    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93072b33-47b5-4a7d-a31e-7b814588859b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93072b33-47b5-4a7d-a31e-7b814588859b" (UID: "93072b33-47b5-4a7d-a31e-7b814588859b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:04:08.121178 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.121076    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93072b33-47b5-4a7d-a31e-7b814588859b-kube-api-access-5wgtd" (OuterVolumeSpecName: "kube-api-access-5wgtd") pod "93072b33-47b5-4a7d-a31e-7b814588859b" (UID: "93072b33-47b5-4a7d-a31e-7b814588859b"). InnerVolumeSpecName "kube-api-access-5wgtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:04:08.121484 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.121461    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-kube-api-access-njrhl" (OuterVolumeSpecName: "kube-api-access-njrhl") pod "27f8fb87-664a-46f8-b50b-b0e40b6ffa08" (UID: "27f8fb87-664a-46f8-b50b-b0e40b6ffa08"). InnerVolumeSpecName "kube-api-access-njrhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:04:08.220515 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.220473    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93072b33-47b5-4a7d-a31e-7b814588859b-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:04:08.220515 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.220512    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njrhl\" (UniqueName: \"kubernetes.io/projected/27f8fb87-664a-46f8-b50b-b0e40b6ffa08-kube-api-access-njrhl\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:04:08.220515 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.220524    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wgtd\" (UniqueName: \"kubernetes.io/projected/93072b33-47b5-4a7d-a31e-7b814588859b-kube-api-access-5wgtd\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:04:08.860905 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.860871    2574 generic.go:356] "Generic (PLEG): container finished" podID="27f8fb87-664a-46f8-b50b-b0e40b6ffa08" containerID="d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1" exitCode=0
Jul 24 15:04:08.861393 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.860926    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"
Jul 24 15:04:08.861393 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.860962    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2" event={"ID":"27f8fb87-664a-46f8-b50b-b0e40b6ffa08","Type":"ContainerDied","Data":"d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1"}
Jul 24 15:04:08.861393 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.861063    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2" event={"ID":"27f8fb87-664a-46f8-b50b-b0e40b6ffa08","Type":"ContainerDied","Data":"558136fd96b2aa2033f6c99ab74961a5b7f2792abec49ec1c022490f1a6c1b50"}
Jul 24 15:04:08.861393 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.861089    2574 scope.go:117] "RemoveContainer" containerID="d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1"
Jul 24 15:04:08.862470 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.862450    2574 generic.go:356] "Generic (PLEG): container finished" podID="93072b33-47b5-4a7d-a31e-7b814588859b" containerID="cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1" exitCode=0
Jul 24 15:04:08.862555 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.862502    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"
Jul 24 15:04:08.862555 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.862542    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr" event={"ID":"93072b33-47b5-4a7d-a31e-7b814588859b","Type":"ContainerDied","Data":"cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1"}
Jul 24 15:04:08.862639 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.862593    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr" event={"ID":"93072b33-47b5-4a7d-a31e-7b814588859b","Type":"ContainerDied","Data":"ce513f650b49d5ecb669f7c1cce5f932aea89019878c488918a67dba3fa7a219"}
Jul 24 15:04:08.870298 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.870142    2574 scope.go:117] "RemoveContainer" containerID="d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1"
Jul 24 15:04:08.870518 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:04:08.870494    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1\": container with ID starting with d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1 not found: ID does not exist" containerID="d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1"
Jul 24 15:04:08.870622 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.870529    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1"} err="failed to get container status \"d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1\": rpc error: code = NotFound desc = could not find container \"d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1\": container with ID starting with d8149cd63410b2704d6917b53162c0107eed7638a4269244ff76b74672c84eb1 not found: ID does not exist"
Jul 24 15:04:08.870622 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.870551    2574 scope.go:117] "RemoveContainer" containerID="cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1"
Jul 24 15:04:08.878953 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.878938    2574 scope.go:117] "RemoveContainer" containerID="cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1"
Jul 24 15:04:08.879233 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:04:08.879216    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1\": container with ID starting with cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1 not found: ID does not exist" containerID="cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1"
Jul 24 15:04:08.879301 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.879241    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1"} err="failed to get container status \"cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1\": rpc error: code = NotFound desc = could not find container \"cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1\": container with ID starting with cd2a03559ff1e22d979e26551d691beea0b7486b938242cfe1f7f0da328d3ca1 not found: ID does not exist"
Jul 24 15:04:08.887613 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.887592    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"]
Jul 24 15:04:08.893445 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.893424    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a1a404-5c99d6d8f-6hcvr"]
Jul 24 15:04:08.906102 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.906076    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"]
Jul 24 15:04:08.911517 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:08.911495    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a1a404-849c5678c6-tnsr2"]
Jul 24 15:04:10.018445 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:10.018410    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f8fb87-664a-46f8-b50b-b0e40b6ffa08" path="/var/lib/kubelet/pods/27f8fb87-664a-46f8-b50b-b0e40b6ffa08/volumes"
Jul 24 15:04:10.018824 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:10.018788    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93072b33-47b5-4a7d-a31e-7b814588859b" path="/var/lib/kubelet/pods/93072b33-47b5-4a7d-a31e-7b814588859b/volumes"
Jul 24 15:04:24.103615 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.103581    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"]
Jul 24 15:04:24.104081 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104065    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f8fb87-664a-46f8-b50b-b0e40b6ffa08" containerName="payload-processing"
Jul 24 15:04:24.104139 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104084    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f8fb87-664a-46f8-b50b-b0e40b6ffa08" containerName="payload-processing"
Jul 24 15:04:24.104139 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104110    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bbe3f19-5bf6-4899-9687-2cb3c65509be" containerName="payload-processing"
Jul 24 15:04:24.104139 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104119    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bbe3f19-5bf6-4899-9687-2cb3c65509be" containerName="payload-processing"
Jul 24 15:04:24.104139 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104131    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac02ecf-2743-4b85-b12f-a6e557735d53" containerName="maas-api"
Jul 24 15:04:24.104261 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104140    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac02ecf-2743-4b85-b12f-a6e557735d53" containerName="maas-api"
Jul 24 15:04:24.104261 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104158    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b479514e-0b14-4db7-b436-fd52ffd30afb" containerName="payload-pre-processing"
Jul 24 15:04:24.104261 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104167    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b479514e-0b14-4db7-b436-fd52ffd30afb" containerName="payload-pre-processing"
Jul 24 15:04:24.104261 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104180    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93072b33-47b5-4a7d-a31e-7b814588859b" containerName="maas-api"
Jul 24 15:04:24.104261 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104190    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93072b33-47b5-4a7d-a31e-7b814588859b" containerName="maas-api"
Jul 24 15:04:24.104414 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104268    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac02ecf-2743-4b85-b12f-a6e557735d53" containerName="maas-api"
Jul 24 15:04:24.104414 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104280    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="27f8fb87-664a-46f8-b50b-b0e40b6ffa08" containerName="payload-processing"
Jul 24 15:04:24.104414 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104290    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bbe3f19-5bf6-4899-9687-2cb3c65509be" containerName="payload-processing"
Jul 24 15:04:24.104414 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104299    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="93072b33-47b5-4a7d-a31e-7b814588859b" containerName="maas-api"
Jul 24 15:04:24.104414 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.104311    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b479514e-0b14-4db7-b436-fd52ffd30afb" containerName="payload-pre-processing"
Jul 24 15:04:24.107283 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.107257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.109658 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.109633    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-876f50-serving-cert\""
Jul 24 15:04:24.109797 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.109728    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-784dv\""
Jul 24 15:04:24.116934 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.116912    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"]
Jul 24 15:04:24.158440 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.158404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5gxl\" (UniqueName: \"kubernetes.io/projected/54916f99-5875-4bb0-a1f3-402dc103ee6a-kube-api-access-b5gxl\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.158440 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.158444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.158697 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.158561    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54916f99-5875-4bb0-a1f3-402dc103ee6a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.259452 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.259409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5gxl\" (UniqueName: \"kubernetes.io/projected/54916f99-5875-4bb0-a1f3-402dc103ee6a-kube-api-access-b5gxl\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.259452 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.259457    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.259664 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.259502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54916f99-5875-4bb0-a1f3-402dc103ee6a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.259664 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:04:24.259626    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-serving-cert: secret "maas-api-e2e-shared-a-876f50-serving-cert" not found
Jul 24 15:04:24.259732 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:04:24.259700    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls podName:54916f99-5875-4bb0-a1f3-402dc103ee6a nodeName:}" failed. No retries permitted until 2026-07-24 15:04:24.759682009 +0000 UTC m=+2531.201432507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls") pod "maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9" (UID: "54916f99-5875-4bb0-a1f3-402dc103ee6a") : secret "maas-api-e2e-shared-a-876f50-serving-cert" not found
Jul 24 15:04:24.260090 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.260074    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54916f99-5875-4bb0-a1f3-402dc103ee6a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.268851 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.268818    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5gxl\" (UniqueName: \"kubernetes.io/projected/54916f99-5875-4bb0-a1f3-402dc103ee6a-kube-api-access-b5gxl\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.764559 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.764527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.766898 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.766871    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls\") pod \"maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:24.827279 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.827243    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"]
Jul 24 15:04:24.831611 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.831589    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:24.833847 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.833828    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-876f50-dockercfg-ddrp4\""
Jul 24 15:04:24.833936 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.833870    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-876f50\""
Jul 24 15:04:24.838042 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.838007    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"]
Jul 24 15:04:24.863734 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.863700    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"]
Jul 24 15:04:24.867154 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.867128    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:24.876670 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.876641    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"]
Jul 24 15:04:24.966782 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.966744    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf\" (UID: \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:24.966782 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.966779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkdnk\" (UniqueName: \"kubernetes.io/projected/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-kube-api-access-hkdnk\") pod \"payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf\" (UID: \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:24.967002 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.966811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0818e5d9-7c45-479e-96aa-c5b63d940cff-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z\" (UID: \"0818e5d9-7c45-479e-96aa-c5b63d940cff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:24.967002 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:24.966900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xzj7\" (UniqueName: \"kubernetes.io/projected/0818e5d9-7c45-479e-96aa-c5b63d940cff-kube-api-access-6xzj7\") pod \"payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z\" (UID: \"0818e5d9-7c45-479e-96aa-c5b63d940cff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:25.019183 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.019083    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:25.068362 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.068325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0818e5d9-7c45-479e-96aa-c5b63d940cff-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z\" (UID: \"0818e5d9-7c45-479e-96aa-c5b63d940cff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:25.068539 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.068412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xzj7\" (UniqueName: \"kubernetes.io/projected/0818e5d9-7c45-479e-96aa-c5b63d940cff-kube-api-access-6xzj7\") pod \"payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z\" (UID: \"0818e5d9-7c45-479e-96aa-c5b63d940cff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:25.068539 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.068496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf\" (UID: \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:25.068539 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.068519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkdnk\" (UniqueName: \"kubernetes.io/projected/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-kube-api-access-hkdnk\") pod \"payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf\" (UID: \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:25.069435 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.069403    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0818e5d9-7c45-479e-96aa-c5b63d940cff-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z\" (UID: \"0818e5d9-7c45-479e-96aa-c5b63d940cff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:25.069600 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.069490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf\" (UID: \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:25.083906 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.083830    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkdnk\" (UniqueName: \"kubernetes.io/projected/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-kube-api-access-hkdnk\") pod \"payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf\" (UID: \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:25.093163 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.093127    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xzj7\" (UniqueName: \"kubernetes.io/projected/0818e5d9-7c45-479e-96aa-c5b63d940cff-kube-api-access-6xzj7\") pod \"payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z\" (UID: \"0818e5d9-7c45-479e-96aa-c5b63d940cff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:25.144424 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.144388    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:25.178443 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.178393    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:25.192970 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.192840    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"]
Jul 24 15:04:25.196215 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:04:25.196180    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54916f99_5875_4bb0_a1f3_402dc103ee6a.slice/crio-ef8f3d0d9b502ac1ae9a6fb4737667c9dec9495fff2ddfe218669b675021f367 WatchSource:0}: Error finding container ef8f3d0d9b502ac1ae9a6fb4737667c9dec9495fff2ddfe218669b675021f367: Status 404 returned error can't find the container with id ef8f3d0d9b502ac1ae9a6fb4737667c9dec9495fff2ddfe218669b675021f367
Jul 24 15:04:25.314241 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.314087    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"]
Jul 24 15:04:25.316673 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:04:25.316641    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b640eb8_8e04_4b69_a08c_5e1e9eae60fe.slice/crio-c3d2bf11fb487fc92cef4e74204f881c7dc803fa991aa4446e6d7fd50f9fda0e WatchSource:0}: Error finding container c3d2bf11fb487fc92cef4e74204f881c7dc803fa991aa4446e6d7fd50f9fda0e: Status 404 returned error can't find the container with id c3d2bf11fb487fc92cef4e74204f881c7dc803fa991aa4446e6d7fd50f9fda0e
Jul 24 15:04:25.341478 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.341435    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"]
Jul 24 15:04:25.342514 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:04:25.342477    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0818e5d9_7c45_479e_96aa_c5b63d940cff.slice/crio-fc02fa2f28c1e4275e3b62482e3ad745e3f342123ceb3f06b64cc9443dec4d01 WatchSource:0}: Error finding container fc02fa2f28c1e4275e3b62482e3ad745e3f342123ceb3f06b64cc9443dec4d01: Status 404 returned error can't find the container with id fc02fa2f28c1e4275e3b62482e3ad745e3f342123ceb3f06b64cc9443dec4d01
Jul 24 15:04:25.954501 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.954458    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf" event={"ID":"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe","Type":"ContainerStarted","Data":"8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86"}
Jul 24 15:04:25.954715 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.954523    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf" event={"ID":"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe","Type":"ContainerStarted","Data":"c3d2bf11fb487fc92cef4e74204f881c7dc803fa991aa4446e6d7fd50f9fda0e"}
Jul 24 15:04:25.954715 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.954655    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:25.956201 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.956174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9" event={"ID":"54916f99-5875-4bb0-a1f3-402dc103ee6a","Type":"ContainerStarted","Data":"fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5"}
Jul 24 15:04:25.956346 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.956226    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:25.956346 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.956251    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9" event={"ID":"54916f99-5875-4bb0-a1f3-402dc103ee6a","Type":"ContainerStarted","Data":"ef8f3d0d9b502ac1ae9a6fb4737667c9dec9495fff2ddfe218669b675021f367"}
Jul 24 15:04:25.957867 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.957831    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z" event={"ID":"0818e5d9-7c45-479e-96aa-c5b63d940cff","Type":"ContainerStarted","Data":"88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6"}
Jul 24 15:04:25.957987 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.957879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z" event={"ID":"0818e5d9-7c45-479e-96aa-c5b63d940cff","Type":"ContainerStarted","Data":"fc02fa2f28c1e4275e3b62482e3ad745e3f342123ceb3f06b64cc9443dec4d01"}
Jul 24 15:04:25.957987 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.957909    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:25.972373 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.972312    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf" podStartSLOduration=1.972294327 podStartE2EDuration="1.972294327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:25.971666394 +0000 UTC m=+2532.413416914" watchObservedRunningTime="2026-07-24 15:04:25.972294327 +0000 UTC m=+2532.414044845"
Jul 24 15:04:25.991137 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:25.991087    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z" podStartSLOduration=1.9910727179999999 podStartE2EDuration="1.991072718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:25.989175795 +0000 UTC m=+2532.430926333" watchObservedRunningTime="2026-07-24 15:04:25.991072718 +0000 UTC m=+2532.432823247"
Jul 24 15:04:26.007016 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:26.006961    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9" podStartSLOduration=1.550916661 podStartE2EDuration="2.006940089s" totalImagesPullingTime="456.023428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:26.006059568 +0000 UTC m=+2532.447810089" watchObservedRunningTime="2026-07-24 15:04:26.006940089 +0000 UTC m=+2532.448690607"
Jul 24 15:04:31.968939 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:31.968910    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:04:32.117551 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.117515    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"]
Jul 24 15:04:32.121518 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.121492    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.123936 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.123914    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-0d170b-serving-cert\""
Jul 24 15:04:32.133669 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.133592    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"]
Jul 24 15:04:32.238447 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.238366    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.238447 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.238413    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.238643 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.238482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5rjz\" (UniqueName: \"kubernetes.io/projected/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-kube-api-access-g5rjz\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.339831 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.339782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.340080 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.339846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.340080 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.339881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5rjz\" (UniqueName: \"kubernetes.io/projected/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-kube-api-access-g5rjz\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.340080 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:04:32.339945    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-serving-cert: secret "maas-api-e2e-shared-b-0d170b-serving-cert" not found
Jul 24 15:04:32.340080 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:04:32.340015    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls podName:a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9 nodeName:}" failed. No retries permitted until 2026-07-24 15:04:32.839998631 +0000 UTC m=+2539.281749131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls") pod "maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx" (UID: "a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9") : secret "maas-api-e2e-shared-b-0d170b-serving-cert" not found
Jul 24 15:04:32.340569 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.340546    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.349640 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.349615    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5rjz\" (UniqueName: \"kubernetes.io/projected/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-kube-api-access-g5rjz\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.816727 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.816696    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"]
Jul 24 15:04:32.820257 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.820241    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:32.822507 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.822484    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-0d170b\""
Jul 24 15:04:32.822603 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.822563    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-0d170b-dockercfg-bvktk\""
Jul 24 15:04:32.828603 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.828557    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"]
Jul 24 15:04:32.845386 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.845358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.847769 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.847743    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls\") pod \"maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:32.946297 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.946260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr\" (UID: \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:32.946297 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:32.946300    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx2kv\" (UniqueName: \"kubernetes.io/projected/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-kube-api-access-rx2kv\") pod \"payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr\" (UID: \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:33.034377 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:33.034335    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:33.047657 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:33.047627    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr\" (UID: \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:33.047806 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:33.047665    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx2kv\" (UniqueName: \"kubernetes.io/projected/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-kube-api-access-rx2kv\") pod \"payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr\" (UID: \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:33.048444 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:33.048420    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr\" (UID: \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:33.056721 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:33.056692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx2kv\" (UniqueName: \"kubernetes.io/projected/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-kube-api-access-rx2kv\") pod \"payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr\" (UID: \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:33.132461 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:33.132424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:33.170919 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:33.170892    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"]
Jul 24 15:04:33.172646 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:04:33.172620    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81f7a32_ae1d_4f78_bdfc_47025dd6d1a9.slice/crio-fecf0f0eec64c4063994a75177ea553253c3c33c2783033736538119b0ab91e1 WatchSource:0}: Error finding container fecf0f0eec64c4063994a75177ea553253c3c33c2783033736538119b0ab91e1: Status 404 returned error can't find the container with id fecf0f0eec64c4063994a75177ea553253c3c33c2783033736538119b0ab91e1
Jul 24 15:04:33.278122 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:33.278098    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"]
Jul 24 15:04:33.280191 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:04:33.280165    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc3d2c1_8c36_4eea_86d4_7b0848260a9e.slice/crio-ebe7574c779ec7b556ddbd511374c016c38ea7d67543195c18f1a94ed9b8e203 WatchSource:0}: Error finding container ebe7574c779ec7b556ddbd511374c016c38ea7d67543195c18f1a94ed9b8e203: Status 404 returned error can't find the container with id ebe7574c779ec7b556ddbd511374c016c38ea7d67543195c18f1a94ed9b8e203
Jul 24 15:04:34.001138 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:34.001043    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx" event={"ID":"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9","Type":"ContainerStarted","Data":"3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25"}
Jul 24 15:04:34.001138 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:34.001105    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx" event={"ID":"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9","Type":"ContainerStarted","Data":"fecf0f0eec64c4063994a75177ea553253c3c33c2783033736538119b0ab91e1"}
Jul 24 15:04:34.001355 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:34.001159    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:34.002515 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:34.002493    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr" event={"ID":"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e","Type":"ContainerStarted","Data":"4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82"}
Jul 24 15:04:34.002634 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:34.002529    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr" event={"ID":"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e","Type":"ContainerStarted","Data":"ebe7574c779ec7b556ddbd511374c016c38ea7d67543195c18f1a94ed9b8e203"}
Jul 24 15:04:34.002634 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:34.002587    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:04:34.026558 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:34.024889    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx" podStartSLOduration=1.5274022010000001 podStartE2EDuration="2.024867504s" totalImagesPullingTime="497.465303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:34.018899751 +0000 UTC m=+2540.460650272" watchObservedRunningTime="2026-07-24 15:04:34.024867504 +0000 UTC m=+2540.466618024"
Jul 24 15:04:34.049586 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:34.049535    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr" podStartSLOduration=2.049520967 podStartE2EDuration="2.049520967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:34.047854699 +0000 UTC m=+2540.489605223" watchObservedRunningTime="2026-07-24 15:04:34.049520967 +0000 UTC m=+2540.491271535"
Jul 24 15:04:36.964686 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:36.964654    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:04:36.965155 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:36.964893    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:04:40.012109 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:40.012079    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:04:45.009155 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:04:45.009125    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:08:05.263848 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.263809    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"]
Jul 24 15:08:05.267218 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.267200    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.271093 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.271072    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"default-dockercfg-rrzcq\""
Jul 24 15:08:05.271240 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.271113    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"openshift-service-ca.crt\""
Jul 24 15:08:05.271240 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.271118    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"sub-test-model-876f50-kserve-self-signed-certs\""
Jul 24 15:08:05.271240 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.271172    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"kube-root-ca.crt\""
Jul 24 15:08:05.280191 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.280162    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"]
Jul 24 15:08:05.334404 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.334368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0722d7-9149-4b0d-a002-3d73a4eec512-tls-certs\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.334578 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.334412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-tmp-dir\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.334578 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.334437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-dshm\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.334578 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.334496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-home\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.334578 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.334523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-model-cache\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.334578 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.334554    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkhk\" (UniqueName: \"kubernetes.io/projected/fe0722d7-9149-4b0d-a002-3d73a4eec512-kube-api-access-qzkhk\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435273 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0722d7-9149-4b0d-a002-3d73a4eec512-tls-certs\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435273 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-tmp-dir\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435546 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-dshm\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435546 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435419    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-home\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435546 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-model-cache\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435546 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkhk\" (UniqueName: \"kubernetes.io/projected/fe0722d7-9149-4b0d-a002-3d73a4eec512-kube-api-access-qzkhk\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435746 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435657    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-tmp-dir\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435805 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-home\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.435805 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.435777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-model-cache\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.437624 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.437601    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-dshm\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.437789 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.437772    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0722d7-9149-4b0d-a002-3d73a4eec512-tls-certs\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.448195 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.448167    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkhk\" (UniqueName: \"kubernetes.io/projected/fe0722d7-9149-4b0d-a002-3d73a4eec512-kube-api-access-qzkhk\") pod \"sub-test-model-876f50-kserve-54796f7d75-2vwml\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") " pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.576235 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.576136    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:05.720168 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:05.720142    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"]
Jul 24 15:08:05.721794 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:08:05.721766    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe0722d7_9149_4b0d_a002_3d73a4eec512.slice/crio-a7873e9e3470ee8d9f8a5700f7636470d4da2c5329559dbf6360520292d539fb WatchSource:0}: Error finding container a7873e9e3470ee8d9f8a5700f7636470d4da2c5329559dbf6360520292d539fb: Status 404 returned error can't find the container with id a7873e9e3470ee8d9f8a5700f7636470d4da2c5329559dbf6360520292d539fb
Jul 24 15:08:06.104206 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:06.104172    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml" event={"ID":"fe0722d7-9149-4b0d-a002-3d73a4eec512","Type":"ContainerStarted","Data":"7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e"}
Jul 24 15:08:06.104390 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:06.104214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml" event={"ID":"fe0722d7-9149-4b0d-a002-3d73a4eec512","Type":"ContainerStarted","Data":"a7873e9e3470ee8d9f8a5700f7636470d4da2c5329559dbf6360520292d539fb"}
Jul 24 15:08:06.122805 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:06.122752    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml" podStartSLOduration=1.122733698 podStartE2EDuration="1.122733698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:08:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:08:06.121731873 +0000 UTC m=+2752.563482393" watchObservedRunningTime="2026-07-24 15:08:06.122733698 +0000 UTC m=+2752.564484216"
Jul 24 15:08:15.576580 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:15.576525    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:15.576979 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:15.576590    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:15.589109 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:15.589083    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:08:16.168898 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:08:16.168868    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:09:19.247152 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:19.247120    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"]
Jul 24 15:09:34.265870 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.265804    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml" podUID="fe0722d7-9149-4b0d-a002-3d73a4eec512" containerName="main" containerID="cri-o://7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e" gracePeriod=45
Jul 24 15:09:34.519490 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.519422    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:09:34.562726 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.562697    2574 generic.go:356] "Generic (PLEG): container finished" podID="fe0722d7-9149-4b0d-a002-3d73a4eec512" containerID="7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e" exitCode=0
Jul 24 15:09:34.562915 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.562742    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"
Jul 24 15:09:34.562915 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.562755    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml" event={"ID":"fe0722d7-9149-4b0d-a002-3d73a4eec512","Type":"ContainerDied","Data":"7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e"}
Jul 24 15:09:34.562915 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.562786    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml" event={"ID":"fe0722d7-9149-4b0d-a002-3d73a4eec512","Type":"ContainerDied","Data":"a7873e9e3470ee8d9f8a5700f7636470d4da2c5329559dbf6360520292d539fb"}
Jul 24 15:09:34.562915 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.562803    2574 scope.go:117] "RemoveContainer" containerID="7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e"
Jul 24 15:09:34.572178 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.572160    2574 scope.go:117] "RemoveContainer" containerID="7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e"
Jul 24 15:09:34.572446 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:09:34.572427    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e\": container with ID starting with 7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e not found: ID does not exist" containerID="7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e"
Jul 24 15:09:34.572497 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.572458    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e"} err="failed to get container status \"7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e\": rpc error: code = NotFound desc = could not find container \"7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e\": container with ID starting with 7a2bdab052872748c58d75beb93a6ef73f96d6a37c11f9b1ba8078be2132fb0e not found: ID does not exist"
Jul 24 15:09:34.640300 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640267    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzkhk\" (UniqueName: \"kubernetes.io/projected/fe0722d7-9149-4b0d-a002-3d73a4eec512-kube-api-access-qzkhk\") pod \"fe0722d7-9149-4b0d-a002-3d73a4eec512\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") "
Jul 24 15:09:34.640300 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640305    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-tmp-dir\") pod \"fe0722d7-9149-4b0d-a002-3d73a4eec512\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") "
Jul 24 15:09:34.640553 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640324    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-home\") pod \"fe0722d7-9149-4b0d-a002-3d73a4eec512\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") "
Jul 24 15:09:34.640553 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640394    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-model-cache\") pod \"fe0722d7-9149-4b0d-a002-3d73a4eec512\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") "
Jul 24 15:09:34.640553 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640421    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-dshm\") pod \"fe0722d7-9149-4b0d-a002-3d73a4eec512\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") "
Jul 24 15:09:34.640553 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640460    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0722d7-9149-4b0d-a002-3d73a4eec512-tls-certs\") pod \"fe0722d7-9149-4b0d-a002-3d73a4eec512\" (UID: \"fe0722d7-9149-4b0d-a002-3d73a4eec512\") "
Jul 24 15:09:34.640750 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640589    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe0722d7-9149-4b0d-a002-3d73a4eec512" (UID: "fe0722d7-9149-4b0d-a002-3d73a4eec512"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:09:34.640750 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640624    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe0722d7-9149-4b0d-a002-3d73a4eec512" (UID: "fe0722d7-9149-4b0d-a002-3d73a4eec512"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:09:34.640750 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640643    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-home" (OuterVolumeSpecName: "home") pod "fe0722d7-9149-4b0d-a002-3d73a4eec512" (UID: "fe0722d7-9149-4b0d-a002-3d73a4eec512"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:09:34.640750 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640696    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-model-cache\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:09:34.640750 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.640709    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-tmp-dir\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:09:34.642608 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.642578    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-dshm" (OuterVolumeSpecName: "dshm") pod "fe0722d7-9149-4b0d-a002-3d73a4eec512" (UID: "fe0722d7-9149-4b0d-a002-3d73a4eec512"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:09:34.642706 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.642647    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0722d7-9149-4b0d-a002-3d73a4eec512-kube-api-access-qzkhk" (OuterVolumeSpecName: "kube-api-access-qzkhk") pod "fe0722d7-9149-4b0d-a002-3d73a4eec512" (UID: "fe0722d7-9149-4b0d-a002-3d73a4eec512"). InnerVolumeSpecName "kube-api-access-qzkhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:09:34.642706 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.642656    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe0722d7-9149-4b0d-a002-3d73a4eec512-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe0722d7-9149-4b0d-a002-3d73a4eec512" (UID: "fe0722d7-9149-4b0d-a002-3d73a4eec512"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:09:34.742129 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.742097    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0722d7-9149-4b0d-a002-3d73a4eec512-tls-certs\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:09:34.742129 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.742123    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzkhk\" (UniqueName: \"kubernetes.io/projected/fe0722d7-9149-4b0d-a002-3d73a4eec512-kube-api-access-qzkhk\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:09:34.742129 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.742133    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-home\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:09:34.742372 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.742142    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0722d7-9149-4b0d-a002-3d73a4eec512-dshm\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:09:34.887490 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.887450    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"]
Jul 24 15:09:34.893828 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:34.893796    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/sub-test-model-876f50-kserve-54796f7d75-2vwml"]
Jul 24 15:09:36.018856 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:09:36.018819    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe0722d7-9149-4b0d-a002-3d73a4eec512" path="/var/lib/kubelet/pods/fe0722d7-9149-4b0d-a002-3d73a4eec512/volumes"
Jul 24 15:10:55.407039 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.406988    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"]
Jul 24 15:10:55.407556 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.407380    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0722d7-9149-4b0d-a002-3d73a4eec512" containerName="main"
Jul 24 15:10:55.407556 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.407393    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0722d7-9149-4b0d-a002-3d73a4eec512" containerName="main"
Jul 24 15:10:55.407556 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.407466    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0722d7-9149-4b0d-a002-3d73a4eec512" containerName="main"
Jul 24 15:10:55.410705 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.410682    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:55.413403 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.413382    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-600d4a-serving-cert\""
Jul 24 15:10:55.421185 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.421159    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"]
Jul 24 15:10:55.569984 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.569936    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqckr\" (UniqueName: \"kubernetes.io/projected/944ad72f-8502-4f71-8eb6-956589d52b02-kube-api-access-qqckr\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:55.570193 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.570022    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:55.570193 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.570157    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944ad72f-8502-4f71-8eb6-956589d52b02-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:55.671519 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.671485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944ad72f-8502-4f71-8eb6-956589d52b02-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:55.671675 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.671530    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqckr\" (UniqueName: \"kubernetes.io/projected/944ad72f-8502-4f71-8eb6-956589d52b02-kube-api-access-qqckr\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:55.671675 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.671607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:55.671777 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:10:55.671758    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-serving-cert: secret "maas-api-e2e-ipp-a-600d4a-serving-cert" not found
Jul 24 15:10:55.671841 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:10:55.671830    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls podName:944ad72f-8502-4f71-8eb6-956589d52b02 nodeName:}" failed. No retries permitted until 2026-07-24 15:10:56.171809 +0000 UTC m=+2922.613559497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls") pod "maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm" (UID: "944ad72f-8502-4f71-8eb6-956589d52b02") : secret "maas-api-e2e-ipp-a-600d4a-serving-cert" not found
Jul 24 15:10:55.672297 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.672280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944ad72f-8502-4f71-8eb6-956589d52b02-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:55.682957 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:55.682930    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqckr\" (UniqueName: \"kubernetes.io/projected/944ad72f-8502-4f71-8eb6-956589d52b02-kube-api-access-qqckr\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:56.176739 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:56.176696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:56.179339 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:56.179307    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls\") pod \"maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:56.322198 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:56.322156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:56.459738 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:56.459711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"]
Jul 24 15:10:56.461475 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:10:56.461452    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944ad72f_8502_4f71_8eb6_956589d52b02.slice/crio-f5dff423e42c16b4f7755339ac7cbf77f71d3702f8de27de13810aefce6bb778 WatchSource:0}: Error finding container f5dff423e42c16b4f7755339ac7cbf77f71d3702f8de27de13810aefce6bb778: Status 404 returned error can't find the container with id f5dff423e42c16b4f7755339ac7cbf77f71d3702f8de27de13810aefce6bb778
Jul 24 15:10:56.462929 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:56.462910    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:10:56.993505 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:56.993473    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm" event={"ID":"944ad72f-8502-4f71-8eb6-956589d52b02","Type":"ContainerStarted","Data":"f5dff423e42c16b4f7755339ac7cbf77f71d3702f8de27de13810aefce6bb778"}
Jul 24 15:10:58.000576 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:58.000539    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm" event={"ID":"944ad72f-8502-4f71-8eb6-956589d52b02","Type":"ContainerStarted","Data":"8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0"}
Jul 24 15:10:58.001020 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:58.000656    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:10:58.025416 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:10:58.025344    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm" podStartSLOduration=2.5058170889999998 podStartE2EDuration="3.025322175s" totalImagesPullingTime="519.505086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:10:58.024772443 +0000 UTC m=+2924.466523006" watchObservedRunningTime="2026-07-24 15:10:58.025322175 +0000 UTC m=+2924.467072696"
Jul 24 15:11:04.012254 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:04.012217    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:11:14.315383 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.315347    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"]
Jul 24 15:11:14.319070 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.319052    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.321549 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.321525    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-5c17a6-serving-cert\""
Jul 24 15:11:14.330486 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.330462    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"]
Jul 24 15:11:14.339908 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.339873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.340110 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.340053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjlsx\" (UniqueName: \"kubernetes.io/projected/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-kube-api-access-kjlsx\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.340190 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.340127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.440952 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.440894    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjlsx\" (UniqueName: \"kubernetes.io/projected/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-kube-api-access-kjlsx\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.440952 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.440953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.441236 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.441057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.441236 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:11:14.441174    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-serving-cert: secret "maas-api-e2e-ipp-b-5c17a6-serving-cert" not found
Jul 24 15:11:14.441349 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:11:14.441252    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls podName:144b41ff-c3e3-4a4a-80f3-3aed9a20ca06 nodeName:}" failed. No retries permitted until 2026-07-24 15:11:14.941231271 +0000 UTC m=+2941.382981784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls") pod "maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7" (UID: "144b41ff-c3e3-4a4a-80f3-3aed9a20ca06") : secret "maas-api-e2e-ipp-b-5c17a6-serving-cert" not found
Jul 24 15:11:14.441580 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.441558    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.452039 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.451990    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjlsx\" (UniqueName: \"kubernetes.io/projected/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-kube-api-access-kjlsx\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.946495 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:14.946456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:14.946684 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:11:14.946609    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-serving-cert: secret "maas-api-e2e-ipp-b-5c17a6-serving-cert" not found
Jul 24 15:11:14.946684 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:11:14.946670    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls podName:144b41ff-c3e3-4a4a-80f3-3aed9a20ca06 nodeName:}" failed. No retries permitted until 2026-07-24 15:11:15.946655984 +0000 UTC m=+2942.388406483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls") pod "maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7" (UID: "144b41ff-c3e3-4a4a-80f3-3aed9a20ca06") : secret "maas-api-e2e-ipp-b-5c17a6-serving-cert" not found
Jul 24 15:11:15.956192 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:15.956155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:15.958747 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:15.958718    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls\") pod \"maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:16.130914 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:16.130882    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:16.268281 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:16.268251    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"]
Jul 24 15:11:16.269988 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:11:16.269956    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144b41ff_c3e3_4a4a_80f3_3aed9a20ca06.slice/crio-001176e5a165a83739c6458ab1903a6da0c3d1a81c270a93944c192457f8cd55 WatchSource:0}: Error finding container 001176e5a165a83739c6458ab1903a6da0c3d1a81c270a93944c192457f8cd55: Status 404 returned error can't find the container with id 001176e5a165a83739c6458ab1903a6da0c3d1a81c270a93944c192457f8cd55
Jul 24 15:11:17.099961 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:17.099868    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7" event={"ID":"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06","Type":"ContainerStarted","Data":"02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274"}
Jul 24 15:11:17.099961 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:17.099926    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7" event={"ID":"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06","Type":"ContainerStarted","Data":"001176e5a165a83739c6458ab1903a6da0c3d1a81c270a93944c192457f8cd55"}
Jul 24 15:11:17.100502 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:17.100049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:17.121808 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:17.121752    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7" podStartSLOduration=2.653448086 podStartE2EDuration="3.121736517s" totalImagesPullingTime="468.288431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:17.119004439 +0000 UTC m=+2943.560754957" watchObservedRunningTime="2026-07-24 15:11:17.121736517 +0000 UTC m=+2943.563487035"
Jul 24 15:11:23.111869 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:23.111840    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:11:36.670118 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:11:36.670047    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tpgv_c7d2d37a-9bb7-4c9e-987b-3291a3a49661/payload-processing/0.log"
Jul 24 15:12:15.936510 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:15.936476    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tpgv_c7d2d37a-9bb7-4c9e-987b-3291a3a49661/payload-processing/0.log"
Jul 24 15:12:20.069571 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.069535    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"]
Jul 24 15:12:20.073158 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.073137    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.076465 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.076442    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-891ff3-serving-cert\""
Jul 24 15:12:20.093532 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.093502    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"]
Jul 24 15:12:20.135794 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.135756    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06170eb-5e99-4b94-8148-6f38aaab5334-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.135985 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.135814    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m65d9\" (UniqueName: \"kubernetes.io/projected/d06170eb-5e99-4b94-8148-6f38aaab5334-kube-api-access-m65d9\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.135985 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.135879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.237267 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.237225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m65d9\" (UniqueName: \"kubernetes.io/projected/d06170eb-5e99-4b94-8148-6f38aaab5334-kube-api-access-m65d9\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.237474 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.237276    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.237474 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.237370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06170eb-5e99-4b94-8148-6f38aaab5334-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.237600 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:12:20.237469    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-serving-cert: secret "maas-api-e2e-ipp-cleanup-891ff3-serving-cert" not found
Jul 24 15:12:20.237600 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:12:20.237548    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls podName:d06170eb-5e99-4b94-8148-6f38aaab5334 nodeName:}" failed. No retries permitted until 2026-07-24 15:12:20.737526926 +0000 UTC m=+3007.179277427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2" (UID: "d06170eb-5e99-4b94-8148-6f38aaab5334") : secret "maas-api-e2e-ipp-cleanup-891ff3-serving-cert" not found
Jul 24 15:12:20.238094 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.238074    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06170eb-5e99-4b94-8148-6f38aaab5334-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.246474 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.246445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m65d9\" (UniqueName: \"kubernetes.io/projected/d06170eb-5e99-4b94-8148-6f38aaab5334-kube-api-access-m65d9\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.742523 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.742485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.744850 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.744826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:20.773808 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.773771    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"]
Jul 24 15:12:20.777465 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.777443    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:20.780011 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.779981    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-891ff3-dockercfg-nz4hg\""
Jul 24 15:12:20.780011 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.780000    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-891ff3\""
Jul 24 15:12:20.786567 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.786541    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"]
Jul 24 15:12:20.818727 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.818687    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"]
Jul 24 15:12:20.822074 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.822057    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:20.842562 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.842530    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"]
Jul 24 15:12:20.843642 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.843612    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzp9\" (UniqueName: \"kubernetes.io/projected/e06464b1-7559-4395-bfec-a3a6db9a5d55-kube-api-access-qpzp9\") pod \"payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4\" (UID: \"e06464b1-7559-4395-bfec-a3a6db9a5d55\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:20.843868 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.843850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06464b1-7559-4395-bfec-a3a6db9a5d55-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4\" (UID: \"e06464b1-7559-4395-bfec-a3a6db9a5d55\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:20.944733 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.944674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kptbz\" (UniqueName: \"kubernetes.io/projected/577991d5-e8d1-42ca-9022-bb215adfae62-kube-api-access-kptbz\") pod \"payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892\" (UID: \"577991d5-e8d1-42ca-9022-bb215adfae62\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:20.945072 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.944825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzp9\" (UniqueName: \"kubernetes.io/projected/e06464b1-7559-4395-bfec-a3a6db9a5d55-kube-api-access-qpzp9\") pod \"payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4\" (UID: \"e06464b1-7559-4395-bfec-a3a6db9a5d55\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:20.945072 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.944876    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/577991d5-e8d1-42ca-9022-bb215adfae62-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892\" (UID: \"577991d5-e8d1-42ca-9022-bb215adfae62\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:20.945072 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.944926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06464b1-7559-4395-bfec-a3a6db9a5d55-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4\" (UID: \"e06464b1-7559-4395-bfec-a3a6db9a5d55\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:20.945863 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.945839    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06464b1-7559-4395-bfec-a3a6db9a5d55-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4\" (UID: \"e06464b1-7559-4395-bfec-a3a6db9a5d55\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:20.955261 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.955232    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzp9\" (UniqueName: \"kubernetes.io/projected/e06464b1-7559-4395-bfec-a3a6db9a5d55-kube-api-access-qpzp9\") pod \"payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4\" (UID: \"e06464b1-7559-4395-bfec-a3a6db9a5d55\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:20.983204 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:20.983157    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:21.046760 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.046313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kptbz\" (UniqueName: \"kubernetes.io/projected/577991d5-e8d1-42ca-9022-bb215adfae62-kube-api-access-kptbz\") pod \"payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892\" (UID: \"577991d5-e8d1-42ca-9022-bb215adfae62\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:21.046760 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.046410    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/577991d5-e8d1-42ca-9022-bb215adfae62-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892\" (UID: \"577991d5-e8d1-42ca-9022-bb215adfae62\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:21.047557 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.047500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/577991d5-e8d1-42ca-9022-bb215adfae62-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892\" (UID: \"577991d5-e8d1-42ca-9022-bb215adfae62\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:21.057718 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.057650    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kptbz\" (UniqueName: \"kubernetes.io/projected/577991d5-e8d1-42ca-9022-bb215adfae62-kube-api-access-kptbz\") pod \"payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892\" (UID: \"577991d5-e8d1-42ca-9022-bb215adfae62\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:21.089572 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.089540    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:21.132218 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.132181    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:21.142392 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.142363    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"]
Jul 24 15:12:21.144080 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:12:21.144051    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06170eb_5e99_4b94_8148_6f38aaab5334.slice/crio-377893796e7625c9f6afb70d4cf99d6d61f5275b3e3cfdb890bae0012dcf4782 WatchSource:0}: Error finding container 377893796e7625c9f6afb70d4cf99d6d61f5275b3e3cfdb890bae0012dcf4782: Status 404 returned error can't find the container with id 377893796e7625c9f6afb70d4cf99d6d61f5275b3e3cfdb890bae0012dcf4782
Jul 24 15:12:21.247457 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.247051    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"]
Jul 24 15:12:21.249173 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:12:21.249126    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06464b1_7559_4395_bfec_a3a6db9a5d55.slice/crio-fbf3e68e838950c8cae83577e87d8e60534f4a28eb48cc5074cd98deefa498b7 WatchSource:0}: Error finding container fbf3e68e838950c8cae83577e87d8e60534f4a28eb48cc5074cd98deefa498b7: Status 404 returned error can't find the container with id fbf3e68e838950c8cae83577e87d8e60534f4a28eb48cc5074cd98deefa498b7
Jul 24 15:12:21.324125 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.324095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"]
Jul 24 15:12:21.324487 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:12:21.324460    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577991d5_e8d1_42ca_9022_bb215adfae62.slice/crio-35cdc0beea26b9324c6ecc3847da2faaa5045b747f72c8ffa30869bfd2d381ef WatchSource:0}: Error finding container 35cdc0beea26b9324c6ecc3847da2faaa5045b747f72c8ffa30869bfd2d381ef: Status 404 returned error can't find the container with id 35cdc0beea26b9324c6ecc3847da2faaa5045b747f72c8ffa30869bfd2d381ef
Jul 24 15:12:21.452959 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.452912    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892" event={"ID":"577991d5-e8d1-42ca-9022-bb215adfae62","Type":"ContainerStarted","Data":"726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b"}
Jul 24 15:12:21.453158 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.452999    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892" event={"ID":"577991d5-e8d1-42ca-9022-bb215adfae62","Type":"ContainerStarted","Data":"35cdc0beea26b9324c6ecc3847da2faaa5045b747f72c8ffa30869bfd2d381ef"}
Jul 24 15:12:21.453158 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.453077    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:21.454851 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.454823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4" event={"ID":"e06464b1-7559-4395-bfec-a3a6db9a5d55","Type":"ContainerStarted","Data":"76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1"}
Jul 24 15:12:21.455009 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.454892    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4" event={"ID":"e06464b1-7559-4395-bfec-a3a6db9a5d55","Type":"ContainerStarted","Data":"fbf3e68e838950c8cae83577e87d8e60534f4a28eb48cc5074cd98deefa498b7"}
Jul 24 15:12:21.455009 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.454936    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:21.456183 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.456158    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2" event={"ID":"d06170eb-5e99-4b94-8148-6f38aaab5334","Type":"ContainerStarted","Data":"377893796e7625c9f6afb70d4cf99d6d61f5275b3e3cfdb890bae0012dcf4782"}
Jul 24 15:12:21.470542 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.470488    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892" podStartSLOduration=1.470470055 podStartE2EDuration="1.470470055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:12:21.469597185 +0000 UTC m=+3007.911347704" watchObservedRunningTime="2026-07-24 15:12:21.470470055 +0000 UTC m=+3007.912220573"
Jul 24 15:12:21.488442 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:21.488391    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4" podStartSLOduration=1.488374525 podStartE2EDuration="1.488374525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:12:21.485606166 +0000 UTC m=+3007.927356711" watchObservedRunningTime="2026-07-24 15:12:21.488374525 +0000 UTC m=+3007.930125102"
Jul 24 15:12:22.464282 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:22.464245    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2" event={"ID":"d06170eb-5e99-4b94-8148-6f38aaab5334","Type":"ContainerStarted","Data":"4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645"}
Jul 24 15:12:22.485516 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:22.485456    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2" podStartSLOduration=2.103835577 podStartE2EDuration="2.485438549s" totalImagesPullingTime="381.602972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:12:22.483448016 +0000 UTC m=+3008.925198552" watchObservedRunningTime="2026-07-24 15:12:22.485438549 +0000 UTC m=+3008.927189101"
Jul 24 15:12:23.469522 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:23.469487    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:29.480474 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:29.480441    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:32.466908 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:32.466878    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:32.467406 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:32.466965    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:45.842241 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:45.842206    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"]
Jul 24 15:12:45.842630 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:45.842443    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2" podUID="d06170eb-5e99-4b94-8148-6f38aaab5334" containerName="maas-api" containerID="cri-o://4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645" gracePeriod=30
Jul 24 15:12:45.922848 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:45.922809    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"]
Jul 24 15:12:45.923131 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:45.923097    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4" podUID="e06464b1-7559-4395-bfec-a3a6db9a5d55" containerName="payload-processing" containerID="cri-o://76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1" gracePeriod=30
Jul 24 15:12:45.941198 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:45.941169    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"]
Jul 24 15:12:45.941442 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:45.941397    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892" podUID="577991d5-e8d1-42ca-9022-bb215adfae62" containerName="payload-pre-processing" containerID="cri-o://726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b" gracePeriod=30
Jul 24 15:12:46.199700 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.199661    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:46.239830 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.239790    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:46.252008 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.251979    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:46.384576 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.384482    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m65d9\" (UniqueName: \"kubernetes.io/projected/d06170eb-5e99-4b94-8148-6f38aaab5334-kube-api-access-m65d9\") pod \"d06170eb-5e99-4b94-8148-6f38aaab5334\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") "
Jul 24 15:12:46.384576 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.384522    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls\") pod \"d06170eb-5e99-4b94-8148-6f38aaab5334\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") "
Jul 24 15:12:46.384576 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.384540    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/577991d5-e8d1-42ca-9022-bb215adfae62-plugins-config-volume\") pod \"577991d5-e8d1-42ca-9022-bb215adfae62\" (UID: \"577991d5-e8d1-42ca-9022-bb215adfae62\") "
Jul 24 15:12:46.384576 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.384563    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06464b1-7559-4395-bfec-a3a6db9a5d55-plugins-config-volume\") pod \"e06464b1-7559-4395-bfec-a3a6db9a5d55\" (UID: \"e06464b1-7559-4395-bfec-a3a6db9a5d55\") "
Jul 24 15:12:46.384576 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.384579    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kptbz\" (UniqueName: \"kubernetes.io/projected/577991d5-e8d1-42ca-9022-bb215adfae62-kube-api-access-kptbz\") pod \"577991d5-e8d1-42ca-9022-bb215adfae62\" (UID: \"577991d5-e8d1-42ca-9022-bb215adfae62\") "
Jul 24 15:12:46.384972 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.384607    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06170eb-5e99-4b94-8148-6f38aaab5334-openshift-service-ca\") pod \"d06170eb-5e99-4b94-8148-6f38aaab5334\" (UID: \"d06170eb-5e99-4b94-8148-6f38aaab5334\") "
Jul 24 15:12:46.384972 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.384629    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpzp9\" (UniqueName: \"kubernetes.io/projected/e06464b1-7559-4395-bfec-a3a6db9a5d55-kube-api-access-qpzp9\") pod \"e06464b1-7559-4395-bfec-a3a6db9a5d55\" (UID: \"e06464b1-7559-4395-bfec-a3a6db9a5d55\") "
Jul 24 15:12:46.385126 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.385043    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/577991d5-e8d1-42ca-9022-bb215adfae62-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "577991d5-e8d1-42ca-9022-bb215adfae62" (UID: "577991d5-e8d1-42ca-9022-bb215adfae62"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:12:46.385126 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.385014    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06170eb-5e99-4b94-8148-6f38aaab5334-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d06170eb-5e99-4b94-8148-6f38aaab5334" (UID: "d06170eb-5e99-4b94-8148-6f38aaab5334"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:12:46.385240 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.385164    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06464b1-7559-4395-bfec-a3a6db9a5d55-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e06464b1-7559-4395-bfec-a3a6db9a5d55" (UID: "e06464b1-7559-4395-bfec-a3a6db9a5d55"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:12:46.386897 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.386871    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577991d5-e8d1-42ca-9022-bb215adfae62-kube-api-access-kptbz" (OuterVolumeSpecName: "kube-api-access-kptbz") pod "577991d5-e8d1-42ca-9022-bb215adfae62" (UID: "577991d5-e8d1-42ca-9022-bb215adfae62"). InnerVolumeSpecName "kube-api-access-kptbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:12:46.386897 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.386894    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06464b1-7559-4395-bfec-a3a6db9a5d55-kube-api-access-qpzp9" (OuterVolumeSpecName: "kube-api-access-qpzp9") pod "e06464b1-7559-4395-bfec-a3a6db9a5d55" (UID: "e06464b1-7559-4395-bfec-a3a6db9a5d55"). InnerVolumeSpecName "kube-api-access-qpzp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:12:46.387089 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.386901    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d06170eb-5e99-4b94-8148-6f38aaab5334" (UID: "d06170eb-5e99-4b94-8148-6f38aaab5334"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:12:46.387089 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.386920    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d06170eb-5e99-4b94-8148-6f38aaab5334-kube-api-access-m65d9" (OuterVolumeSpecName: "kube-api-access-m65d9") pod "d06170eb-5e99-4b94-8148-6f38aaab5334" (UID: "d06170eb-5e99-4b94-8148-6f38aaab5334"). InnerVolumeSpecName "kube-api-access-m65d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:12:46.485517 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.485483    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m65d9\" (UniqueName: \"kubernetes.io/projected/d06170eb-5e99-4b94-8148-6f38aaab5334-kube-api-access-m65d9\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:12:46.485517 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.485511    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06170eb-5e99-4b94-8148-6f38aaab5334-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:12:46.485517 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.485521    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/577991d5-e8d1-42ca-9022-bb215adfae62-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:12:46.485779 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.485541    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e06464b1-7559-4395-bfec-a3a6db9a5d55-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:12:46.485779 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.485555    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kptbz\" (UniqueName: \"kubernetes.io/projected/577991d5-e8d1-42ca-9022-bb215adfae62-kube-api-access-kptbz\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:12:46.485779 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.485569    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06170eb-5e99-4b94-8148-6f38aaab5334-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:12:46.485779 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.485581    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpzp9\" (UniqueName: \"kubernetes.io/projected/e06464b1-7559-4395-bfec-a3a6db9a5d55-kube-api-access-qpzp9\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:12:46.598113 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.598073    2574 generic.go:356] "Generic (PLEG): container finished" podID="d06170eb-5e99-4b94-8148-6f38aaab5334" containerID="4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645" exitCode=0
Jul 24 15:12:46.598266 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.598123    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"
Jul 24 15:12:46.598266 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.598162    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2" event={"ID":"d06170eb-5e99-4b94-8148-6f38aaab5334","Type":"ContainerDied","Data":"4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645"}
Jul 24 15:12:46.598266 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.598212    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2" event={"ID":"d06170eb-5e99-4b94-8148-6f38aaab5334","Type":"ContainerDied","Data":"377893796e7625c9f6afb70d4cf99d6d61f5275b3e3cfdb890bae0012dcf4782"}
Jul 24 15:12:46.598266 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.598234    2574 scope.go:117] "RemoveContainer" containerID="4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645"
Jul 24 15:12:46.599780 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.599755    2574 generic.go:356] "Generic (PLEG): container finished" podID="577991d5-e8d1-42ca-9022-bb215adfae62" containerID="726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b" exitCode=0
Jul 24 15:12:46.599885 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.599802    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"
Jul 24 15:12:46.599885 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.599852    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892" event={"ID":"577991d5-e8d1-42ca-9022-bb215adfae62","Type":"ContainerDied","Data":"726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b"}
Jul 24 15:12:46.600001 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.599905    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892" event={"ID":"577991d5-e8d1-42ca-9022-bb215adfae62","Type":"ContainerDied","Data":"35cdc0beea26b9324c6ecc3847da2faaa5045b747f72c8ffa30869bfd2d381ef"}
Jul 24 15:12:46.601524 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.601498    2574 generic.go:356] "Generic (PLEG): container finished" podID="e06464b1-7559-4395-bfec-a3a6db9a5d55" containerID="76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1" exitCode=0
Jul 24 15:12:46.601656 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.601548    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"
Jul 24 15:12:46.601656 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.601561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4" event={"ID":"e06464b1-7559-4395-bfec-a3a6db9a5d55","Type":"ContainerDied","Data":"76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1"}
Jul 24 15:12:46.601656 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.601603    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4" event={"ID":"e06464b1-7559-4395-bfec-a3a6db9a5d55","Type":"ContainerDied","Data":"fbf3e68e838950c8cae83577e87d8e60534f4a28eb48cc5074cd98deefa498b7"}
Jul 24 15:12:46.609938 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.609895    2574 scope.go:117] "RemoveContainer" containerID="4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645"
Jul 24 15:12:46.610296 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:12:46.610255    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645\": container with ID starting with 4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645 not found: ID does not exist" containerID="4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645"
Jul 24 15:12:46.610296 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.610281    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645"} err="failed to get container status \"4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645\": rpc error: code = NotFound desc = could not find container \"4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645\": container with ID starting with 4c2ad8fd8d4c85b92d4a831d26c6f7d7674bcc65e149db6f949d9211040d7645 not found: ID does not exist"
Jul 24 15:12:46.610429 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.610300    2574 scope.go:117] "RemoveContainer" containerID="726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b"
Jul 24 15:12:46.619653 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.619632    2574 scope.go:117] "RemoveContainer" containerID="726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b"
Jul 24 15:12:46.619985 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:12:46.619961    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b\": container with ID starting with 726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b not found: ID does not exist" containerID="726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b"
Jul 24 15:12:46.620122 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.619991    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b"} err="failed to get container status \"726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b\": rpc error: code = NotFound desc = could not find container \"726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b\": container with ID starting with 726123dec258f6dbe46680e70ab671a07b9fb530a04b758942fbb93ba2807a4b not found: ID does not exist"
Jul 24 15:12:46.620122 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.620015    2574 scope.go:117] "RemoveContainer" containerID="76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1"
Jul 24 15:12:46.626432 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.626399    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"]
Jul 24 15:12:46.629324 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.629306    2574 scope.go:117] "RemoveContainer" containerID="76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1"
Jul 24 15:12:46.629981 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:12:46.629950    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1\": container with ID starting with 76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1 not found: ID does not exist" containerID="76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1"
Jul 24 15:12:46.630127 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.629987    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1"} err="failed to get container status \"76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1\": rpc error: code = NotFound desc = could not find container \"76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1\": container with ID starting with 76905c40cf7da1e933a9281283a4d54119401b8011d93bd6dacd90379fe794f1 not found: ID does not exist"
Jul 24 15:12:46.633134 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.633112    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891ff3-77f7b5dd4b-cdzm2"]
Jul 24 15:12:46.644386 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.644307    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"]
Jul 24 15:12:46.648526 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.648501    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891ff3-9c995bbd4-55892"]
Jul 24 15:12:46.661271 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.661242    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"]
Jul 24 15:12:46.667561 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:46.667534    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-891ff3-7cb4f9bfc4-xxrx4"]
Jul 24 15:12:48.018936 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:48.018905    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="577991d5-e8d1-42ca-9022-bb215adfae62" path="/var/lib/kubelet/pods/577991d5-e8d1-42ca-9022-bb215adfae62/volumes"
Jul 24 15:12:48.019422 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:48.019309    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d06170eb-5e99-4b94-8148-6f38aaab5334" path="/var/lib/kubelet/pods/d06170eb-5e99-4b94-8148-6f38aaab5334/volumes"
Jul 24 15:12:48.019618 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:12:48.019604    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e06464b1-7559-4395-bfec-a3a6db9a5d55" path="/var/lib/kubelet/pods/e06464b1-7559-4395-bfec-a3a6db9a5d55/volumes"
Jul 24 15:13:18.761159 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:18.761079    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"]
Jul 24 15:13:18.761808 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:18.761395    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm" podUID="944ad72f-8502-4f71-8eb6-956589d52b02" containerName="maas-api" containerID="cri-o://8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0" gracePeriod=30
Jul 24 15:13:19.018113 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.018050    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:13:19.102984 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.102955    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944ad72f-8502-4f71-8eb6-956589d52b02-openshift-service-ca\") pod \"944ad72f-8502-4f71-8eb6-956589d52b02\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") "
Jul 24 15:13:19.103188 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.103000    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls\") pod \"944ad72f-8502-4f71-8eb6-956589d52b02\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") "
Jul 24 15:13:19.103188 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.103019    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqckr\" (UniqueName: \"kubernetes.io/projected/944ad72f-8502-4f71-8eb6-956589d52b02-kube-api-access-qqckr\") pod \"944ad72f-8502-4f71-8eb6-956589d52b02\" (UID: \"944ad72f-8502-4f71-8eb6-956589d52b02\") "
Jul 24 15:13:19.103432 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.103404    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/944ad72f-8502-4f71-8eb6-956589d52b02-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "944ad72f-8502-4f71-8eb6-956589d52b02" (UID: "944ad72f-8502-4f71-8eb6-956589d52b02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:13:19.105199 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.105172    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "944ad72f-8502-4f71-8eb6-956589d52b02" (UID: "944ad72f-8502-4f71-8eb6-956589d52b02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:13:19.105327 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.105226    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/944ad72f-8502-4f71-8eb6-956589d52b02-kube-api-access-qqckr" (OuterVolumeSpecName: "kube-api-access-qqckr") pod "944ad72f-8502-4f71-8eb6-956589d52b02" (UID: "944ad72f-8502-4f71-8eb6-956589d52b02"). InnerVolumeSpecName "kube-api-access-qqckr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:13:19.204053 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.203999    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944ad72f-8502-4f71-8eb6-956589d52b02-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:13:19.204053 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.204052    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944ad72f-8502-4f71-8eb6-956589d52b02-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:13:19.204250 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.204064    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqckr\" (UniqueName: \"kubernetes.io/projected/944ad72f-8502-4f71-8eb6-956589d52b02-kube-api-access-qqckr\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:13:19.781094 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.781063    2574 generic.go:356] "Generic (PLEG): container finished" podID="944ad72f-8502-4f71-8eb6-956589d52b02" containerID="8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0" exitCode=0
Jul 24 15:13:19.781516 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.781115    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"
Jul 24 15:13:19.781516 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.781160    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm" event={"ID":"944ad72f-8502-4f71-8eb6-956589d52b02","Type":"ContainerDied","Data":"8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0"}
Jul 24 15:13:19.781516 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.781218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm" event={"ID":"944ad72f-8502-4f71-8eb6-956589d52b02","Type":"ContainerDied","Data":"f5dff423e42c16b4f7755339ac7cbf77f71d3702f8de27de13810aefce6bb778"}
Jul 24 15:13:19.781516 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.781250    2574 scope.go:117] "RemoveContainer" containerID="8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0"
Jul 24 15:13:19.790321 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.790305    2574 scope.go:117] "RemoveContainer" containerID="8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0"
Jul 24 15:13:19.790577 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:13:19.790558    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0\": container with ID starting with 8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0 not found: ID does not exist" containerID="8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0"
Jul 24 15:13:19.790632 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.790586    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0"} err="failed to get container status \"8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0\": rpc error: code = NotFound desc = could not find container \"8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0\": container with ID starting with 8e230045f3bd0f4beef38d53a733a41386f5842b1fe7041ea2e4758c1de6aeb0 not found: ID does not exist"
Jul 24 15:13:19.804009 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.803979    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"]
Jul 24 15:13:19.809311 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:19.809281    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm"]
Jul 24 15:13:20.018946 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:20.018915    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="944ad72f-8502-4f71-8eb6-956589d52b02" path="/var/lib/kubelet/pods/944ad72f-8502-4f71-8eb6-956589d52b02/volumes"
Jul 24 15:13:22.007491 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:13:22.007438    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-600d4a-5b696f8669-j6plm" podUID="944ad72f-8502-4f71-8eb6-956589d52b02" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.75:8443/health\": context deadline exceeded"
Jul 24 15:14:24.537123 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.537084    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"]
Jul 24 15:14:24.537673 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.537327    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7" podUID="144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" containerName="maas-api" containerID="cri-o://02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274" gracePeriod=30
Jul 24 15:14:24.789869 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.789803    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:14:24.884276 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.884233    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls\") pod \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") "
Jul 24 15:14:24.884276 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.884274    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjlsx\" (UniqueName: \"kubernetes.io/projected/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-kube-api-access-kjlsx\") pod \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") "
Jul 24 15:14:24.884496 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.884329    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-openshift-service-ca\") pod \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\" (UID: \"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06\") "
Jul 24 15:14:24.884754 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.884727    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" (UID: "144b41ff-c3e3-4a4a-80f3-3aed9a20ca06"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:14:24.886405 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.886374    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" (UID: "144b41ff-c3e3-4a4a-80f3-3aed9a20ca06"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:14:24.886497 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.886426    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-kube-api-access-kjlsx" (OuterVolumeSpecName: "kube-api-access-kjlsx") pod "144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" (UID: "144b41ff-c3e3-4a4a-80f3-3aed9a20ca06"). InnerVolumeSpecName "kube-api-access-kjlsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:14:24.985807 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.985769    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:24.985807 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.985803    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjlsx\" (UniqueName: \"kubernetes.io/projected/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-kube-api-access-kjlsx\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:24.985807 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:24.985814    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:25.123141 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.123014    2574 generic.go:356] "Generic (PLEG): container finished" podID="144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" containerID="02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274" exitCode=0
Jul 24 15:14:25.123141 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.123071    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7" event={"ID":"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06","Type":"ContainerDied","Data":"02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274"}
Jul 24 15:14:25.123141 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.123096    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"
Jul 24 15:14:25.123141 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.123127    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7" event={"ID":"144b41ff-c3e3-4a4a-80f3-3aed9a20ca06","Type":"ContainerDied","Data":"001176e5a165a83739c6458ab1903a6da0c3d1a81c270a93944c192457f8cd55"}
Jul 24 15:14:25.123413 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.123152    2574 scope.go:117] "RemoveContainer" containerID="02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274"
Jul 24 15:14:25.132331 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.132314    2574 scope.go:117] "RemoveContainer" containerID="02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274"
Jul 24 15:14:25.132618 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:14:25.132599    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274\": container with ID starting with 02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274 not found: ID does not exist" containerID="02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274"
Jul 24 15:14:25.132664 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.132628    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274"} err="failed to get container status \"02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274\": rpc error: code = NotFound desc = could not find container \"02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274\": container with ID starting with 02e9e32fbcfe88ef52b8e0ccccf94ad2f5eb6759a89ae300103c43ad8eed7274 not found: ID does not exist"
Jul 24 15:14:25.147869 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.147831    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"]
Jul 24 15:14:25.152214 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:25.152188    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-5c17a6-6bcd78b468-6fdm7"]
Jul 24 15:14:26.019462 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:26.019424    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" path="/var/lib/kubelet/pods/144b41ff-c3e3-4a4a-80f3-3aed9a20ca06/volumes"
Jul 24 15:14:47.541205 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.541126    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"]
Jul 24 15:14:47.541732 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.541372    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9" podUID="54916f99-5875-4bb0-a1f3-402dc103ee6a" containerName="maas-api" containerID="cri-o://fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5" gracePeriod=30
Jul 24 15:14:47.624858 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.624823    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"]
Jul 24 15:14:47.625152 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.625093    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z" podUID="0818e5d9-7c45-479e-96aa-c5b63d940cff" containerName="payload-processing" containerID="cri-o://88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6" gracePeriod=30
Jul 24 15:14:47.628178 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.628152    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"]
Jul 24 15:14:47.628415 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.628376    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf" podUID="6b640eb8-8e04-4b69-a08c-5e1e9eae60fe" containerName="payload-pre-processing" containerID="cri-o://8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86" gracePeriod=30
Jul 24 15:14:47.911761 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.911738    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:14:47.916832 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.916801    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:14:47.933000 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.932975    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:14:47.993788 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.993753    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls\") pod \"54916f99-5875-4bb0-a1f3-402dc103ee6a\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") "
Jul 24 15:14:47.993952 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.993800    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-plugins-config-volume\") pod \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\" (UID: \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\") "
Jul 24 15:14:47.993952 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.993858    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5gxl\" (UniqueName: \"kubernetes.io/projected/54916f99-5875-4bb0-a1f3-402dc103ee6a-kube-api-access-b5gxl\") pod \"54916f99-5875-4bb0-a1f3-402dc103ee6a\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") "
Jul 24 15:14:47.993952 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.993925    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xzj7\" (UniqueName: \"kubernetes.io/projected/0818e5d9-7c45-479e-96aa-c5b63d940cff-kube-api-access-6xzj7\") pod \"0818e5d9-7c45-479e-96aa-c5b63d940cff\" (UID: \"0818e5d9-7c45-479e-96aa-c5b63d940cff\") "
Jul 24 15:14:47.994154 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.993964    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54916f99-5875-4bb0-a1f3-402dc103ee6a-openshift-service-ca\") pod \"54916f99-5875-4bb0-a1f3-402dc103ee6a\" (UID: \"54916f99-5875-4bb0-a1f3-402dc103ee6a\") "
Jul 24 15:14:47.994154 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.994010    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0818e5d9-7c45-479e-96aa-c5b63d940cff-plugins-config-volume\") pod \"0818e5d9-7c45-479e-96aa-c5b63d940cff\" (UID: \"0818e5d9-7c45-479e-96aa-c5b63d940cff\") "
Jul 24 15:14:47.994154 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.994073    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkdnk\" (UniqueName: \"kubernetes.io/projected/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-kube-api-access-hkdnk\") pod \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\" (UID: \"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe\") "
Jul 24 15:14:47.994299 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.994233    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b640eb8-8e04-4b69-a08c-5e1e9eae60fe" (UID: "6b640eb8-8e04-4b69-a08c-5e1e9eae60fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:14:47.994487 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.994362    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54916f99-5875-4bb0-a1f3-402dc103ee6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54916f99-5875-4bb0-a1f3-402dc103ee6a" (UID: "54916f99-5875-4bb0-a1f3-402dc103ee6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:14:47.994487 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.994371    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:47.994637 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.994590    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0818e5d9-7c45-479e-96aa-c5b63d940cff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0818e5d9-7c45-479e-96aa-c5b63d940cff" (UID: "0818e5d9-7c45-479e-96aa-c5b63d940cff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:14:47.996434 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.996399    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-kube-api-access-hkdnk" (OuterVolumeSpecName: "kube-api-access-hkdnk") pod "6b640eb8-8e04-4b69-a08c-5e1e9eae60fe" (UID: "6b640eb8-8e04-4b69-a08c-5e1e9eae60fe"). InnerVolumeSpecName "kube-api-access-hkdnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:14:47.996555 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.996437    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0818e5d9-7c45-479e-96aa-c5b63d940cff-kube-api-access-6xzj7" (OuterVolumeSpecName: "kube-api-access-6xzj7") pod "0818e5d9-7c45-479e-96aa-c5b63d940cff" (UID: "0818e5d9-7c45-479e-96aa-c5b63d940cff"). InnerVolumeSpecName "kube-api-access-6xzj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:14:47.996555 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.996458    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54916f99-5875-4bb0-a1f3-402dc103ee6a" (UID: "54916f99-5875-4bb0-a1f3-402dc103ee6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:14:47.996555 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:47.996480    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54916f99-5875-4bb0-a1f3-402dc103ee6a-kube-api-access-b5gxl" (OuterVolumeSpecName: "kube-api-access-b5gxl") pod "54916f99-5875-4bb0-a1f3-402dc103ee6a" (UID: "54916f99-5875-4bb0-a1f3-402dc103ee6a"). InnerVolumeSpecName "kube-api-access-b5gxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:14:48.095223 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.095127    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54916f99-5875-4bb0-a1f3-402dc103ee6a-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:48.095223 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.095157    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5gxl\" (UniqueName: \"kubernetes.io/projected/54916f99-5875-4bb0-a1f3-402dc103ee6a-kube-api-access-b5gxl\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:48.095223 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.095168    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xzj7\" (UniqueName: \"kubernetes.io/projected/0818e5d9-7c45-479e-96aa-c5b63d940cff-kube-api-access-6xzj7\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:48.095223 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.095179    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54916f99-5875-4bb0-a1f3-402dc103ee6a-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:48.095223 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.095188    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0818e5d9-7c45-479e-96aa-c5b63d940cff-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:48.095223 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.095197    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkdnk\" (UniqueName: \"kubernetes.io/projected/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe-kube-api-access-hkdnk\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:14:48.249091 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.249058    2574 generic.go:356] "Generic (PLEG): container finished" podID="6b640eb8-8e04-4b69-a08c-5e1e9eae60fe" containerID="8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86" exitCode=0
Jul 24 15:14:48.249291 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.249115    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"
Jul 24 15:14:48.249291 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.249130    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf" event={"ID":"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe","Type":"ContainerDied","Data":"8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86"}
Jul 24 15:14:48.249291 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.249210    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf" event={"ID":"6b640eb8-8e04-4b69-a08c-5e1e9eae60fe","Type":"ContainerDied","Data":"c3d2bf11fb487fc92cef4e74204f881c7dc803fa991aa4446e6d7fd50f9fda0e"}
Jul 24 15:14:48.249291 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.249242    2574 scope.go:117] "RemoveContainer" containerID="8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86"
Jul 24 15:14:48.250589 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.250564    2574 generic.go:356] "Generic (PLEG): container finished" podID="54916f99-5875-4bb0-a1f3-402dc103ee6a" containerID="fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5" exitCode=0
Jul 24 15:14:48.250690 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.250616    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"
Jul 24 15:14:48.250690 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.250648    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9" event={"ID":"54916f99-5875-4bb0-a1f3-402dc103ee6a","Type":"ContainerDied","Data":"fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5"}
Jul 24 15:14:48.250799 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.250699    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9" event={"ID":"54916f99-5875-4bb0-a1f3-402dc103ee6a","Type":"ContainerDied","Data":"ef8f3d0d9b502ac1ae9a6fb4737667c9dec9495fff2ddfe218669b675021f367"}
Jul 24 15:14:48.252117 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.252095    2574 generic.go:356] "Generic (PLEG): container finished" podID="0818e5d9-7c45-479e-96aa-c5b63d940cff" containerID="88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6" exitCode=0
Jul 24 15:14:48.252223 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.252147    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"
Jul 24 15:14:48.252272 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.252216    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z" event={"ID":"0818e5d9-7c45-479e-96aa-c5b63d940cff","Type":"ContainerDied","Data":"88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6"}
Jul 24 15:14:48.252272 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.252265    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z" event={"ID":"0818e5d9-7c45-479e-96aa-c5b63d940cff","Type":"ContainerDied","Data":"fc02fa2f28c1e4275e3b62482e3ad745e3f342123ceb3f06b64cc9443dec4d01"}
Jul 24 15:14:48.259439 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.259421    2574 scope.go:117] "RemoveContainer" containerID="8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86"
Jul 24 15:14:48.259711 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:14:48.259693    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86\": container with ID starting with 8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86 not found: ID does not exist" containerID="8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86"
Jul 24 15:14:48.259769 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.259724    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86"} err="failed to get container status \"8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86\": rpc error: code = NotFound desc = could not find container \"8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86\": container with ID starting with 8ea944462eb29f7f2bb74f3ca4efba588ff5c65a5587302a4a8eb2d8230b1f86 not found: ID does not exist"
Jul 24 15:14:48.259769 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.259740    2574 scope.go:117] "RemoveContainer" containerID="fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5"
Jul 24 15:14:48.267325 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.267310    2574 scope.go:117] "RemoveContainer" containerID="fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5"
Jul 24 15:14:48.267592 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:14:48.267556    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5\": container with ID starting with fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5 not found: ID does not exist" containerID="fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5"
Jul 24 15:14:48.267592 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.267583    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5"} err="failed to get container status \"fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5\": rpc error: code = NotFound desc = could not find container \"fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5\": container with ID starting with fe9fe30d62176d19922a08c3e7206e92b79f7c0df4023d9df05f636c9b3576a5 not found: ID does not exist"
Jul 24 15:14:48.267702 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.267597    2574 scope.go:117] "RemoveContainer" containerID="88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6"
Jul 24 15:14:48.275039 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.275008    2574 scope.go:117] "RemoveContainer" containerID="88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6"
Jul 24 15:14:48.275287 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:14:48.275269    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6\": container with ID starting with 88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6 not found: ID does not exist" containerID="88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6"
Jul 24 15:14:48.275339 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.275295    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6"} err="failed to get container status \"88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6\": rpc error: code = NotFound desc = could not find container \"88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6\": container with ID starting with 88bb51eccedfff1c2468bc263e38e1e6e87bb41ebcdedb9da7dee327322caae6 not found: ID does not exist"
Jul 24 15:14:48.278838 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.278816    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"]
Jul 24 15:14:48.283367 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.283348    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-876f50-6888d5c69b-rwtqf"]
Jul 24 15:14:48.296082 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.296060    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"]
Jul 24 15:14:48.301575 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.301548    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-876f50-57448bf646-6pv9z"]
Jul 24 15:14:48.315431 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.315391    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"]
Jul 24 15:14:48.320263 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:48.320235    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-876f50-7f489db7f8-cq5v9"]
Jul 24 15:14:50.018549 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:50.018518    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0818e5d9-7c45-479e-96aa-c5b63d940cff" path="/var/lib/kubelet/pods/0818e5d9-7c45-479e-96aa-c5b63d940cff/volumes"
Jul 24 15:14:50.018930 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:50.018898    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54916f99-5875-4bb0-a1f3-402dc103ee6a" path="/var/lib/kubelet/pods/54916f99-5875-4bb0-a1f3-402dc103ee6a/volumes"
Jul 24 15:14:50.019244 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:14:50.019230    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b640eb8-8e04-4b69-a08c-5e1e9eae60fe" path="/var/lib/kubelet/pods/6b640eb8-8e04-4b69-a08c-5e1e9eae60fe/volumes"
Jul 24 15:15:11.922704 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:11.922668    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"]
Jul 24 15:15:11.923184 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:11.922911    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx" podUID="a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" containerName="maas-api" containerID="cri-o://3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25" gracePeriod=30
Jul 24 15:15:12.035822 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.035788    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"]
Jul 24 15:15:12.036095 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.036067    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr" podUID="dfc3d2c1-8c36-4eea-86d4-7b0848260a9e" containerName="payload-processing" containerID="cri-o://4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82" gracePeriod=30
Jul 24 15:15:12.184279 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.184207    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:15:12.237865 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.237830    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-openshift-service-ca\") pod \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") "
Jul 24 15:15:12.238056 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.237916    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls\") pod \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") "
Jul 24 15:15:12.238056 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.238020    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5rjz\" (UniqueName: \"kubernetes.io/projected/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-kube-api-access-g5rjz\") pod \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\" (UID: \"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9\") "
Jul 24 15:15:12.238229 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.238203    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" (UID: "a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:15:12.238318 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.238299    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-openshift-service-ca\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:15:12.240235 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.240205    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-kube-api-access-g5rjz" (OuterVolumeSpecName: "kube-api-access-g5rjz") pod "a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" (UID: "a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9"). InnerVolumeSpecName "kube-api-access-g5rjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:15:12.240409 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.240252    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" (UID: "a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:15:12.286247 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.286219    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:15:12.338629 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.338597    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-plugins-config-volume\") pod \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\" (UID: \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\") "
Jul 24 15:15:12.338777 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.338662    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx2kv\" (UniqueName: \"kubernetes.io/projected/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-kube-api-access-rx2kv\") pod \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\" (UID: \"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e\") "
Jul 24 15:15:12.338947 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.338930    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-maas-api-tls\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:15:12.338987 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.338957    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5rjz\" (UniqueName: \"kubernetes.io/projected/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9-kube-api-access-g5rjz\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:15:12.338987 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.338956    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfc3d2c1-8c36-4eea-86d4-7b0848260a9e" (UID: "dfc3d2c1-8c36-4eea-86d4-7b0848260a9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:15:12.340708 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.340685    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-kube-api-access-rx2kv" (OuterVolumeSpecName: "kube-api-access-rx2kv") pod "dfc3d2c1-8c36-4eea-86d4-7b0848260a9e" (UID: "dfc3d2c1-8c36-4eea-86d4-7b0848260a9e"). InnerVolumeSpecName "kube-api-access-rx2kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:15:12.381254 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.381216    2574 generic.go:356] "Generic (PLEG): container finished" podID="a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" containerID="3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25" exitCode=0
Jul 24 15:15:12.381492 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.381268    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"
Jul 24 15:15:12.381492 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.381306    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx" event={"ID":"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9","Type":"ContainerDied","Data":"3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25"}
Jul 24 15:15:12.381492 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.381359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx" event={"ID":"a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9","Type":"ContainerDied","Data":"fecf0f0eec64c4063994a75177ea553253c3c33c2783033736538119b0ab91e1"}
Jul 24 15:15:12.381492 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.381386    2574 scope.go:117] "RemoveContainer" containerID="3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25"
Jul 24 15:15:12.382770 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.382741    2574 generic.go:356] "Generic (PLEG): container finished" podID="dfc3d2c1-8c36-4eea-86d4-7b0848260a9e" containerID="4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82" exitCode=0
Jul 24 15:15:12.382885 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.382780    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"
Jul 24 15:15:12.382885 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.382825    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr" event={"ID":"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e","Type":"ContainerDied","Data":"4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82"}
Jul 24 15:15:12.382885 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.382871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr" event={"ID":"dfc3d2c1-8c36-4eea-86d4-7b0848260a9e","Type":"ContainerDied","Data":"ebe7574c779ec7b556ddbd511374c016c38ea7d67543195c18f1a94ed9b8e203"}
Jul 24 15:15:12.390507 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.390437    2574 scope.go:117] "RemoveContainer" containerID="3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25"
Jul 24 15:15:12.390783 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:15:12.390764    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25\": container with ID starting with 3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25 not found: ID does not exist" containerID="3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25"
Jul 24 15:15:12.390860 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.390789    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25"} err="failed to get container status \"3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25\": rpc error: code = NotFound desc = could not find container \"3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25\": container with ID starting with 3ccd131389d263a6d2e9dfab91d768b2bc027242fbea2874dec63b64f3e2aa25 not found: ID does not exist"
Jul 24 15:15:12.390860 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.390806    2574 scope.go:117] "RemoveContainer" containerID="4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82"
Jul 24 15:15:12.399141 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.399121    2574 scope.go:117] "RemoveContainer" containerID="4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82"
Jul 24 15:15:12.399427 ip-10-0-134-104 kubenswrapper[2574]: E0724 15:15:12.399402    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82\": container with ID starting with 4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82 not found: ID does not exist" containerID="4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82"
Jul 24 15:15:12.399497 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.399440    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82"} err="failed to get container status \"4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82\": rpc error: code = NotFound desc = could not find container \"4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82\": container with ID starting with 4cc4247e32b7be530f9af22f176355a5339d221780d324efccc9fc58a5384a82 not found: ID does not exist"
Jul 24 15:15:12.435711 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.435626    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"]
Jul 24 15:15:12.440237 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.440217    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-plugins-config-volume\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:15:12.440324 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.440239    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx2kv\" (UniqueName: \"kubernetes.io/projected/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e-kube-api-access-rx2kv\") on node \"ip-10-0-134-104.ec2.internal\" DevicePath \"\""
Jul 24 15:15:12.447665 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.447636    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0d170b-68dccbbd4c-d27fx"]
Jul 24 15:15:12.468805 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.468764    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"]
Jul 24 15:15:12.479245 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:12.479219    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0d170b-fb648fd86-t8mhr"]
Jul 24 15:15:14.018017 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:14.017986    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" path="/var/lib/kubelet/pods/a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9/volumes"
Jul 24 15:15:14.018388 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:14.018367    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc3d2c1-8c36-4eea-86d4-7b0848260a9e" path="/var/lib/kubelet/pods/dfc3d2c1-8c36-4eea-86d4-7b0848260a9e/volumes"
Jul 24 15:15:30.775336 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:30.775306    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6946c9fc55-npzz2_ffc757c4-4d1e-4a76-a517-8d53652bde44/manager/0.log"
Jul 24 15:15:31.284507 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:31.284472    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bbcbb69d-jj8gv_42f78ced-aa2a-470e-b108-a30e2b2db03a/copy-manifests/0.log"
Jul 24 15:15:31.292686 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:31.292654    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bbcbb69d-jj8gv_42f78ced-aa2a-470e-b108-a30e2b2db03a/manager/0.log"
Jul 24 15:15:31.815660 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:31.815627    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-77cc5bc5d-8k4c7_b1c300f6-e1d9-4638-8de3-ec0442aff5eb/maas-api/0.log"
Jul 24 15:15:32.321146 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:32.321107    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-7m648_4c639305-4166-4fe5-ac9c-9dffc94cb5c9/postgres/0.log"
Jul 24 15:15:33.174836 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.174774    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2_3a9157b8-31d4-47b0-b6c9-31320933caa1/extract/0.log"
Jul 24 15:15:33.182784 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.182756    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2_3a9157b8-31d4-47b0-b6c9-31320933caa1/util/0.log"
Jul 24 15:15:33.190489 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.190468    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2_3a9157b8-31d4-47b0-b6c9-31320933caa1/pull/0.log"
Jul 24 15:15:33.311907 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.311878    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk_b9ddc5ea-ad95-4aae-9640-d3e36f479139/util/0.log"
Jul 24 15:15:33.319913 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.319893    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk_b9ddc5ea-ad95-4aae-9640-d3e36f479139/pull/0.log"
Jul 24 15:15:33.328018 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.327996    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk_b9ddc5ea-ad95-4aae-9640-d3e36f479139/extract/0.log"
Jul 24 15:15:33.446322 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.446246    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df_004ab5a7-9d75-4c01-b64a-a70e8b7182a9/pull/0.log"
Jul 24 15:15:33.455066 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.455021    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df_004ab5a7-9d75-4c01-b64a-a70e8b7182a9/extract/0.log"
Jul 24 15:15:33.463175 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.463156    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df_004ab5a7-9d75-4c01-b64a-a70e8b7182a9/util/0.log"
Jul 24 15:15:33.586590 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.586563    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8_015a5fbc-d63c-42cb-b73c-5870ed555d35/util/0.log"
Jul 24 15:15:33.595341 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.595322    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8_015a5fbc-d63c-42cb-b73c-5870ed555d35/pull/0.log"
Jul 24 15:15:33.605658 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:33.605637    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8_015a5fbc-d63c-42cb-b73c-5870ed555d35/extract/0.log"
Jul 24 15:15:35.160699 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:35.160668    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8gg9x_b30fc36e-262d-46dd-879e-a3bee4fa88e8/discovery/0.log"
Jul 24 15:15:35.799873 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:35.799842    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tpgv_c7d2d37a-9bb7-4c9e-987b-3291a3a49661/payload-processing/0.log"
Jul 24 15:15:36.317893 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:36.317846    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-fzgw9_8a720ab6-8fbc-4681-a401-6a1d315a498d/main/0.log"
Jul 24 15:15:36.694588 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:36.694559    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnz7m_bf5f6697-e3be-4468-b461-8e6de05a491b/main/0.log"
Jul 24 15:15:45.749343 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:45.749292    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zkd8c_e41c23ed-ecd6-48df-a1dd-04e32365c908/global-pull-secret-syncer/0.log"
Jul 24 15:15:45.908751 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:45.908722    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pwqxh_57f4836a-b235-4ff7-bbf7-03cd41122d70/konnectivity-agent/0.log"
Jul 24 15:15:45.961651 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:45.961620    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-104.ec2.internal_977e39685fd9fa3034b3c1273f0bec72/haproxy/0.log"
Jul 24 15:15:50.274004 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.273976    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2_3a9157b8-31d4-47b0-b6c9-31320933caa1/extract/0.log"
Jul 24 15:15:50.302474 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.302439    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2_3a9157b8-31d4-47b0-b6c9-31320933caa1/util/0.log"
Jul 24 15:15:50.327554 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.327526    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598mgp2_3a9157b8-31d4-47b0-b6c9-31320933caa1/pull/0.log"
Jul 24 15:15:50.358411 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.358383    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk_b9ddc5ea-ad95-4aae-9640-d3e36f479139/extract/0.log"
Jul 24 15:15:50.385875 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.385846    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk_b9ddc5ea-ad95-4aae-9640-d3e36f479139/util/0.log"
Jul 24 15:15:50.421468 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.421442    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gvcvk_b9ddc5ea-ad95-4aae-9640-d3e36f479139/pull/0.log"
Jul 24 15:15:50.450845 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.450797    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df_004ab5a7-9d75-4c01-b64a-a70e8b7182a9/extract/0.log"
Jul 24 15:15:50.474545 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.474515    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df_004ab5a7-9d75-4c01-b64a-a70e8b7182a9/util/0.log"
Jul 24 15:15:50.498781 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.498753    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z68df_004ab5a7-9d75-4c01-b64a-a70e8b7182a9/pull/0.log"
Jul 24 15:15:50.528218 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.528141    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8_015a5fbc-d63c-42cb-b73c-5870ed555d35/extract/0.log"
Jul 24 15:15:50.553359 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.553326    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8_015a5fbc-d63c-42cb-b73c-5870ed555d35/util/0.log"
Jul 24 15:15:50.580417 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:50.580389    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pv4z8_015a5fbc-d63c-42cb-b73c-5870ed555d35/pull/0.log"
Jul 24 15:15:53.541575 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:53.541545    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-tlgtz_989d1705-56a1-40bb-84ae-0cfae0fa853f/monitoring-plugin/0.log"
Jul 24 15:15:53.580438 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:53.580414    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6rfq_7a7cbe04-8968-4926-a484-265c2038c09f/node-exporter/0.log"
Jul 24 15:15:53.609713 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:53.609684    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6rfq_7a7cbe04-8968-4926-a484-265c2038c09f/kube-rbac-proxy/0.log"
Jul 24 15:15:53.639762 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:53.639734    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6rfq_7a7cbe04-8968-4926-a484-265c2038c09f/init-textfile/0.log"
Jul 24 15:15:54.188995 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:54.188967    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-jdlqj_5f6667b3-93ea-404f-8f20-dd46b097cd38/prometheus-operator/0.log"
Jul 24 15:15:54.212308 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:54.212271    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-jdlqj_5f6667b3-93ea-404f-8f20-dd46b097cd38/kube-rbac-proxy/0.log"
Jul 24 15:15:54.241282 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:54.241258    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-lstzv_d2779c5d-d8b5-4912-9f61-978fe4efd932/prometheus-operator-admission-webhook/0.log"
Jul 24 15:15:55.894275 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894240    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"]
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894568    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0818e5d9-7c45-479e-96aa-c5b63d940cff" containerName="payload-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894581    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0818e5d9-7c45-479e-96aa-c5b63d940cff" containerName="payload-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894592    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06464b1-7559-4395-bfec-a3a6db9a5d55" containerName="payload-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894598    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06464b1-7559-4395-bfec-a3a6db9a5d55" containerName="payload-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894606    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d06170eb-5e99-4b94-8148-6f38aaab5334" containerName="maas-api"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894613    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d06170eb-5e99-4b94-8148-6f38aaab5334" containerName="maas-api"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894620    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54916f99-5875-4bb0-a1f3-402dc103ee6a" containerName="maas-api"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894625    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="54916f99-5875-4bb0-a1f3-402dc103ee6a" containerName="maas-api"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894632    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc3d2c1-8c36-4eea-86d4-7b0848260a9e" containerName="payload-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894638    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc3d2c1-8c36-4eea-86d4-7b0848260a9e" containerName="payload-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894643    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577991d5-e8d1-42ca-9022-bb215adfae62" containerName="payload-pre-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894649    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="577991d5-e8d1-42ca-9022-bb215adfae62" containerName="payload-pre-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894655    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b640eb8-8e04-4b69-a08c-5e1e9eae60fe" containerName="payload-pre-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894660    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b640eb8-8e04-4b69-a08c-5e1e9eae60fe" containerName="payload-pre-processing"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894666    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" containerName="maas-api"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894671    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" containerName="maas-api"
Jul 24 15:15:55.894671 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894677    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894684    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894690    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944ad72f-8502-4f71-8eb6-956589d52b02" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894696    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="944ad72f-8502-4f71-8eb6-956589d52b02" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894744    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b640eb8-8e04-4b69-a08c-5e1e9eae60fe" containerName="payload-pre-processing"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894750    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a81f7a32-ae1d-4f78-bdfc-47025dd6d1a9" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894758    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="144b41ff-c3e3-4a4a-80f3-3aed9a20ca06" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894766    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d06170eb-5e99-4b94-8148-6f38aaab5334" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894771    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc3d2c1-8c36-4eea-86d4-7b0848260a9e" containerName="payload-processing"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894776    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0818e5d9-7c45-479e-96aa-c5b63d940cff" containerName="payload-processing"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894781    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="54916f99-5875-4bb0-a1f3-402dc103ee6a" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894787    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="944ad72f-8502-4f71-8eb6-956589d52b02" containerName="maas-api"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894792    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e06464b1-7559-4395-bfec-a3a6db9a5d55" containerName="payload-processing"
Jul 24 15:15:55.895224 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.894796    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="577991d5-e8d1-42ca-9022-bb215adfae62" containerName="payload-pre-processing"
Jul 24 15:15:55.897651 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.897633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:55.899927 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.899904    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44pkg\"/\"kube-root-ca.crt\""
Jul 24 15:15:55.900815 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.900794    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44pkg\"/\"default-dockercfg-6psc7\""
Jul 24 15:15:55.900953 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.900836    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44pkg\"/\"openshift-service-ca.crt\""
Jul 24 15:15:55.911034 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.911003    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"]
Jul 24 15:15:55.935451 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.935412    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7ts\" (UniqueName: \"kubernetes.io/projected/da61d621-a53f-4459-a1c5-c7c903bc4a38-kube-api-access-hl7ts\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:55.935652 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.935557    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-sys\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:55.935652 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.935590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-proc\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:55.935652 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.935616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-lib-modules\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:55.935785 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:55.935669    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-podres\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036088 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-lib-modules\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036288 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-podres\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036288 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7ts\" (UniqueName: \"kubernetes.io/projected/da61d621-a53f-4459-a1c5-c7c903bc4a38-kube-api-access-hl7ts\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036288 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036206    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-sys\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036288 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036205    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-lib-modules\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036288 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036223    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-proc\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036288 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-podres\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036520 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036295    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-sys\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.036520 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.036282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da61d621-a53f-4459-a1c5-c7c903bc4a38-proc\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.046355 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.046332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7ts\" (UniqueName: \"kubernetes.io/projected/da61d621-a53f-4459-a1c5-c7c903bc4a38-kube-api-access-hl7ts\") pod \"perf-node-gather-daemonset-67z8k\" (UID: \"da61d621-a53f-4459-a1c5-c7c903bc4a38\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.207795 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.207762    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.344285 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.344258    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"]
Jul 24 15:15:56.346898 ip-10-0-134-104 kubenswrapper[2574]: W0724 15:15:56.346872    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda61d621_a53f_4459_a1c5_c7c903bc4a38.slice/crio-242049742c3da135bba4d131293b8f24d96ff7fa7b79f9239a0df10f308ff35b WatchSource:0}: Error finding container 242049742c3da135bba4d131293b8f24d96ff7fa7b79f9239a0df10f308ff35b: Status 404 returned error can't find the container with id 242049742c3da135bba4d131293b8f24d96ff7fa7b79f9239a0df10f308ff35b
Jul 24 15:15:56.601687 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.601592    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k" event={"ID":"da61d621-a53f-4459-a1c5-c7c903bc4a38","Type":"ContainerStarted","Data":"6d7a2f61e9eb3785c5047c867d04d4fadc52001b4cf687aba4ddf910d3b6cf67"}
Jul 24 15:15:56.601687 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.601640    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k" event={"ID":"da61d621-a53f-4459-a1c5-c7c903bc4a38","Type":"ContainerStarted","Data":"242049742c3da135bba4d131293b8f24d96ff7fa7b79f9239a0df10f308ff35b"}
Jul 24 15:15:56.601889 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.601685    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:15:56.623156 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.623102    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k" podStartSLOduration=1.623085846 podStartE2EDuration="1.623085846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:15:56.621344764 +0000 UTC m=+3223.063095284" watchObservedRunningTime="2026-07-24 15:15:56.623085846 +0000 UTC m=+3223.064836417"
Jul 24 15:15:56.827365 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.827331    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-649c988d67-lvhd2_11eb3a8c-bcf1-4cea-858b-15374ba780ef/console/0.log"
Jul 24 15:15:56.867812 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:56.867725    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-622k9_12195fe5-614c-4140-b18a-10f0c231c632/download-server/0.log"
Jul 24 15:15:58.745650 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:58.745620    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7ptl_2ddd0013-4600-497f-ac52-502693253399/dns/0.log"
Jul 24 15:15:58.772528 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:58.772500    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7ptl_2ddd0013-4600-497f-ac52-502693253399/kube-rbac-proxy/0.log"
Jul 24 15:15:58.854586 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:58.854555    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vj9jm_2386794d-566b-4007-9d3d-d7123abd6cd8/dns-node-resolver/0.log"
Jul 24 15:15:59.445933 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:59.445896    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6957cd85fd-vhn4q_5152dfbb-3c29-4c07-99b5-b15bd11277b7/registry/0.log"
Jul 24 15:15:59.471375 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:15:59.471346    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-74lxm_7370b028-13f9-4584-bc28-3dc77abfa88e/node-ca/0.log"
Jul 24 15:16:00.728640 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:00.728609    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8gg9x_b30fc36e-262d-46dd-879e-a3bee4fa88e8/discovery/0.log"
Jul 24 15:16:00.948240 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:00.948202    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tpgv_c7d2d37a-9bb7-4c9e-987b-3291a3a49661/payload-processing/0.log"
Jul 24 15:16:01.866313 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:01.866285    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qdmgz_b5975eb8-ba5f-41fb-8300-262a3d048566/serve-healthcheck-canary/0.log"
Jul 24 15:16:02.436414 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:02.436379    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6drzf_268b9c0e-6fb8-445f-adbc-c05406142a25/kube-rbac-proxy/0.log"
Jul 24 15:16:02.462619 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:02.462594    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6drzf_268b9c0e-6fb8-445f-adbc-c05406142a25/exporter/0.log"
Jul 24 15:16:02.487759 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:02.487729    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6drzf_268b9c0e-6fb8-445f-adbc-c05406142a25/extractor/0.log"
Jul 24 15:16:02.616807 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:02.616780    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-67z8k"
Jul 24 15:16:05.589665 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:05.589582    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6946c9fc55-npzz2_ffc757c4-4d1e-4a76-a517-8d53652bde44/manager/0.log"
Jul 24 15:16:05.881348 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:05.881261    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bbcbb69d-jj8gv_42f78ced-aa2a-470e-b108-a30e2b2db03a/manager/0.log"
Jul 24 15:16:05.915098 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:05.915077    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bbcbb69d-jj8gv_42f78ced-aa2a-470e-b108-a30e2b2db03a/copy-manifests/0.log"
Jul 24 15:16:06.216413 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:06.216382    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8gg9x_b30fc36e-262d-46dd-879e-a3bee4fa88e8/discovery/0.log"
Jul 24 15:16:06.399073 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:06.399041    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tpgv_c7d2d37a-9bb7-4c9e-987b-3291a3a49661/payload-processing/0.log"
Jul 24 15:16:07.453798 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:07.453764    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76765b76bd-mzl77_9e7f858b-9df0-49fd-b4ab-5370128a40af/manager/0.log"
Jul 24 15:16:08.018867 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:08.018838    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8gg9x_b30fc36e-262d-46dd-879e-a3bee4fa88e8/discovery/0.log"
Jul 24 15:16:08.189860 ip-10-0-134-104 kubenswrapper[2574]: I0724 15:16:08.189831    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-5tpgv_c7d2d37a-9bb7-4c9e-987b-3291a3a49661/payload-processing/0.log"