Jul 22 04:22:40.300581 ip-10-0-131-26 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 04:22:40.301658 ip-10-0-131-26 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 04:22:40.301672 ip-10-0-131-26 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 04:22:40.302008 ip-10-0-131-26 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 04:22:50.549556 ip-10-0-131-26 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 04:22:50.549579 ip-10-0-131-26 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0ec4b000fd5f4b0ead943c76fd21938b --
Jul 22 04:24:42.741605 ip-10-0-131-26 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 04:24:43.053218 ip-10-0-131-26 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:24:43.053218 ip-10-0-131-26 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 04:24:43.053218 ip-10-0-131-26 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:24:43.053218 ip-10-0-131-26 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 04:24:43.053218 ip-10-0-131-26 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:24:43.053891 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.053815    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 04:24:43.058803 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058787    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:43.058803 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058803    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:43.058803 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058806    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058810    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058813    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058816    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058819    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058822    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058824    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058827    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058829    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058832    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058834    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058837    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058840    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058842    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058845    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058847    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058850    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058852    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058855    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058857    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:43.058896 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058861    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058865    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058867    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058870    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058873    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058875    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058878    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058880    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058883    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058885    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058888    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058891    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058893    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058896    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058900    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058903    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058906    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058909    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058911    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058914    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:43.059385 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058917    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058920    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058923    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058925    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058928    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058930    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058933    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058936    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058938    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058940    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058943    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058945    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058948    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058950    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058953    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058955    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058958    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058960    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058963    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:43.059867 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058966    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058968    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058971    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058973    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058976    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058979    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058984    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058989    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058992    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058994    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.058997    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059000    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059002    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059005    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059008    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059011    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059013    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059016    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059018    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:43.060352 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059021    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059023    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059028    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059032    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059035    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059038    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059041    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059044    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059046    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059050    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059054    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059057    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059059    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059062    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059064    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059067    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059069    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059072    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059074    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:43.060794 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059793    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059801    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059804    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059806    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059809    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059812    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059814    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059817    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059819    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059822    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059825    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059828    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059830    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059833    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059836    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059838    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059841    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059843    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059846    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059848    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:43.061285 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059851    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059853    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059856    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059859    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059862    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059864    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059867    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059870    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059873    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059875    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059878    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059880    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059884    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059886    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059889    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059892    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059894    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059898    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059902    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059905    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:43.061764 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059907    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059910    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059913    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059915    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059918    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059920    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059923    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059926    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059928    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059931    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059933    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059935    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059938    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059940    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059943    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059945    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059948    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059950    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059953    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059955    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:43.062294 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059977    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059981    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059985    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059988    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059996    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.059999    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060004    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060007    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060010    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060013    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060016    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060019    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060022    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060026    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060029    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060032    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060035    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060038    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060040    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:43.062757 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060043    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060046    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060048    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060050    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060053    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060055    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060058    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060060    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060063    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060067    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060069    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060072    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060074    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060077    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060079    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060082    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060085    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060089    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060092    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060094    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:43.063230 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060509    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060515    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060517    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060520    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060523    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060526    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060528    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060531    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060534    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060536    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060539    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060542    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060545    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060547    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060550    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060552    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060555    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060558    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060560    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060562    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:43.063710 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060565    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060568    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060570    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060572    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060575    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060578    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060580    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060583    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060585    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060591    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060593    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060596    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060599    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060601    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060604    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060606    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060609    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060611    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060616    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:43.064181 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060619    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060622    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060625    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060628    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060631    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060633    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060636    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060639    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060641    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060643    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060646    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060648    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060651    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060654    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060656    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060659    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060661    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060664    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060666    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060668    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:43.064643 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060671    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060674    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060677    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060680    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060683    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060686    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060688    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060690    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060693    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060697    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060700    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060703    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060705    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060708    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060710    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060713    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060716    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060718    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060722    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:43.065105 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060726    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060730    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060733    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060735    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060738    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060741    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060744    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060746    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060749    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060752    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060754    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060757    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060760    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060763    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060766    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060771    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060773    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060776    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060778    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060781    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.060783    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:43.065580 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060854    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060862    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060869    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060873    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060878    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060881    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060885    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060889    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060893    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060896    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060899    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060902    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060905    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060908    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060911    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060914    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060917    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060920    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060923    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060926    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060929    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060932    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060935    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060939    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 04:24:43.066097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060942    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060945    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060949    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060953    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060955    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060958    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060961    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060964    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060968    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060971    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060973    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060976    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060979    2564 flags.go:64] FLAG: --enable-server="true"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060982    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060986    2564 flags.go:64] FLAG: --event-burst="100"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060989    2564 flags.go:64] FLAG: --event-qps="50"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060992    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060996    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.060999    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061003    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061005    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061008    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061011    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061014    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061017    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 04:24:43.066657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061019    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061022    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061025    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061028    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061030    2564 flags.go:64] FLAG: --feature-gates=""
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061034    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061037    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061040    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061042    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061046    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061050    2564 flags.go:64] FLAG: --help="false"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061053    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061056    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061059    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061062    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061066    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061069    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061072    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061074    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061077    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061080    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061083    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061085    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061088    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 22 04:24:43.067322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061091    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061095    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061098    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061101    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061104    2564 flags.go:64] FLAG: --lock-file=""
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061107    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061110    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061113    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061118    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061121    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061124    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061126    2564 flags.go:64] FLAG: --logging-format="text"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061129    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061133    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061135    2564 flags.go:64] FLAG: --manifest-url=""
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061138    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061142    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061146    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061150    2564 flags.go:64] FLAG: --max-pods="110"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061153    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061155    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061158    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061161    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061164    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061167    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 04:24:43.067905 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061170    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061177    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061179    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061183    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061186    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061188    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061194    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061197    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061216    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061222    2564 flags.go:64] FLAG: --port="10250"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061225    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061228    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0972800e2b0a9011f"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061231    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061235    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061237    2564 flags.go:64] FLAG: --register-node="true"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061240    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061244    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061247    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061250    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061253    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061261    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061264    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061267    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061270    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061273    2564 flags.go:64] FLAG: --runonce="false"
Jul 22 04:24:43.068523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061275    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061279    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061282    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061285    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061287    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061290    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061293    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061297    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061300    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061302    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061305    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061308    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061311    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061314    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061317    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061322    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061325    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061328    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061357    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061361    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061364    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061367    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061369    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061372    2564 flags.go:64] FLAG: --v="2"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061377    2564 flags.go:64] FLAG: --version="false"
Jul 22 04:24:43.069107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061381    2564 flags.go:64] FLAG: --vmodule=""
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061384    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061388    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061513    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061517    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061520    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061528    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061532    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061535    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061539    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061541    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061544    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061547    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061549    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061552    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061554    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061557    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061560    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061562    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061565    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:43.069750 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061568    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061570    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061573    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061575    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061578    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061582    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061584    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061587    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061589    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061592    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061594    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061598    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061601    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061604    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061606    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061609    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061612    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061615    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061620    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:43.070254 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061623    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061626    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061629    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061632    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061635    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061638    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061640    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061643    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061645    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061647    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061650    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061652    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061655    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061657    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061660    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061663    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061665    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061668    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061670    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061673    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:43.070735 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061676    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061678    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061681    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061683    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061685    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061688    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061691    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061693    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061696    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061698    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061701    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061706    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061709    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061712    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061714    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061717    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061720    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061722    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061725    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061727    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:43.071197 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061730    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061732    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061736    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061738    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061741    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061743    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061745    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061750    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061753    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061756    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061759    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061762    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061765    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061768    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061771    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061774    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061777    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061779    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061782    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061785    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:43.071699 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061787    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061790    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.061792    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.061802    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.068352    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.068369    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.068939    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.068947    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069004    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069009    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069014    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069017    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069020    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069022    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:43.072169 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069025    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069028    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069030    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069033    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069036    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069038    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069041    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069044    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069047    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069050    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069053    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069056    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069058    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069061    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069064    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069066    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069070    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069074    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069077    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:43.072549 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069081    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069084    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069087    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069090    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069094    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069097    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069100    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069103    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069106    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069108    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069111    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069114    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069117    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069120    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069123    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069125    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069128    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069130    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069133    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:43.072996 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069136    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069138    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069141    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069144    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069147    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069150    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069152    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069155    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069159    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069163    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069166    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069169    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069172    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069174    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069177    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069180    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069182    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069186    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069189    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069191    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:43.073538 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069194    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069196    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069214    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069218    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069221    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069223    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069226    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069228    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069231    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069233    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069236    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069241    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069243    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069246    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069248    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069251    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069254    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069256    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069259    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069262    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:43.074029 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069265    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069267    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069270    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069272    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069275    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069277    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069280    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069282    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069285    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069288    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069291    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069294    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069296    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069299    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069301    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:43.074555 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.069307    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069419    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069424    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069427    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069430    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069433    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069435    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069438    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069441    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069445    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069448    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069451    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069454    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069457    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069460    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069463    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069466    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069468    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069471    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:24:43.074939 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069474    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069476    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069479    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069481    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069483    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069486    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069488    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069491    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069494    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069497    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069499    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069502    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069504    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069508    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069511    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069514    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069517    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069520    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069523    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069525    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:24:43.075406 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069529    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069533    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069536    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069538    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069541    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069543    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069546    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069548    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069551    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069553    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069559    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069562    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069564    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069567    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069569    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069572    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069574    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069577    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069579    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069582    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:24:43.075872 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069584    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069603    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069606    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069609    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069612    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069615    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069617    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069620    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069623    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069626    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069628    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069631    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069633    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069636    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069638    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069640    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069643    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069645    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069648    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069650    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:24:43.076369 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069653    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069655    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069657    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069660    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069663    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069666    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069668    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069670    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069673    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069675    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069678    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069680    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069683    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069686    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069688    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069691    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069693    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069696    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069698    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069701    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:24:43.076840 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:43.069703    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:24:43.077345 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.069708    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:24:43.077345 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.069813    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 04:24:43.077345 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.071759    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 04:24:43.077345 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.072800    2564 server.go:1019] "Starting client certificate rotation"
Jul 22 04:24:43.077345 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.072903    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 04:24:43.077345 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.072941    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 04:24:43.077345 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.074876    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 04:24:43.079716 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.079692    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 04:24:43.087755 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.087737    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 22 04:24:43.089717 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.089703    2564 log.go:25] "Validated CRI v1 image API"
Jul 22 04:24:43.093829 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.093812    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 04:24:43.095828 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.095803    2564 fs.go:135] Filesystem UUIDs: map[3ba5d2ec-ac5c-47d8-9975-366c60833ec9:/dev/nvme0n1p4 741eb3b9-f9af-41ad-9948-31c5fc6c0b39:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 22 04:24:43.095916 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.095827    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 04:24:43.100818 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.100697    2564 manager.go:216] Machine: {Timestamp:2026-07-22 04:24:43.099597869 +0000 UTC m=+0.258995498 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3080584 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28be8c9a24dce1f8ec5de75314ca40 SystemUUID:ec28be8c-9a24-dce1-f8ec-5de75314ca40 BootID:0ec4b000-fd5f-4b0e-ad94-3c76fd21938b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e5:fd:a5:32:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e5:fd:a5:32:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:6a:06:09:fe:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 04:24:43.100818 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.100802    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 04:24:43.100944 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.100884    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 04:24:43.103248 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.103217    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 04:24:43.103385 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.103249    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 04:24:43.103879 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.103867    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 04:24:43.103879 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.103880    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 04:24:43.103950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.103888    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 04:24:43.103950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.103903    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 04:24:43.105100 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.105086    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 04:24:43.106606 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.106592    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 04:24:43.108689 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.108677    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 04:24:43.108808 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.108798    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 04:24:43.108848 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.108833    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 04:24:43.108848 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.108844    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 04:24:43.108906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.108854    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 04:24:43.108906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.108862    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 22 04:24:43.108906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.108878    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 04:24:43.109348 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.109334    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 04:24:43.109391 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.109358    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 04:24:43.111133 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.111109    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 04:24:43.112766 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.112754    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 04:24:43.112826 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.112784    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 04:24:43.113753 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113740    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 04:24:43.113794 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113764    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 04:24:43.113794 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113776    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 04:24:43.113794 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113783    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 04:24:43.113868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113803    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 04:24:43.113868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113820    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 04:24:43.113868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113832    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 04:24:43.113868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113837    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 04:24:43.113868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113845    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 04:24:43.113868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113851    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 04:24:43.113868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113865    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 04:24:43.113868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.113870    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 04:24:43.114465 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.114455    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 04:24:43.114501 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.114465    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 04:24:43.117685 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.117671    2564 server.go:1268] "Started kubelet"
Jul 22 04:24:43.120902 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.120637    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 04:24:43.121469 ip-10-0-131-26 systemd[1]: Started Kubernetes Kubelet.
Jul 22 04:24:43.122181 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.120642    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 04:24:43.122326 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.122281    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 04:24:43.122823 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.122775    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 04:24:43.122895 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.122827    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 04:24:43.122895 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.122842    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 04:24:43.124174 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.124151    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbjjp"
Jul 22 04:24:43.125165 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.125147    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 04:24:43.125392 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.125376    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 04:24:43.126756 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.126045    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-26.ec2.internal.18c481fea9e58b93  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-26.ec2.internal,UID:ip-10-0-131-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-26.ec2.internal,},FirstTimestamp:2026-07-22 04:24:43.117628307 +0000 UTC m=+0.277025988,LastTimestamp:2026-07-22 04:24:43.117628307 +0000 UTC m=+0.277025988,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-26.ec2.internal,}"
Jul 22 04:24:43.127770 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.127751    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 04:24:43.131698 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.131681    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 04:24:43.131775 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.131696    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 04:24:43.131822 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.131774    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbjjp"
Jul 22 04:24:43.131867 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.131856    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:43.132447 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.132231    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 04:24:43.132447 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.132254    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 04:24:43.132447 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.132234    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 04:24:43.132447 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.132351    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 04:24:43.132447 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.132361    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 04:24:43.132701 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.132692    2564 factory.go:55] Registering systemd factory
Jul 22 04:24:43.132745 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.132707    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 22 04:24:43.132995 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.132973    2564 factory.go:153] Registering CRI-O factory
Jul 22 04:24:43.133060 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.133000    2564 factory.go:223] Registration of the crio container factory successfully
Jul 22 04:24:43.133060 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.133051    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 04:24:43.133134 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.133076    2564 factory.go:103] Registering Raw factory
Jul 22 04:24:43.133134 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.133093    2564 manager.go:1196] Started watching for new ooms in manager
Jul 22 04:24:43.133590 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.133578    2564 manager.go:349] Starting recovery of all containers
Jul 22 04:24:43.133726 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.133705    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 04:24:43.133878 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.133854    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 04:24:43.144655 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.144639    2564 manager.go:354] Recovery completed
Jul 22 04:24:43.148751 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.148739    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:43.150533 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.150514    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:43.150611 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.150545    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:43.150611 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.150556    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:43.151152 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.151139    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 04:24:43.151152 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.151150    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 04:24:43.151252 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.151155    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:43.151252 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.151164    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 04:24:43.152871 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.152850    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:43.152979 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.152969    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:43.153050 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.153043    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:43.153865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.153822    2564 policy_none.go:49] "None policy: Start"
Jul 22 04:24:43.154102 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.154091    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 04:24:43.154159 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.154108    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 04:24:43.156197 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.156183    2564 policy_none.go:47] "Start"
Jul 22 04:24:43.188481 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.188333    2564 manager.go:337] "Starting Device Plugin manager"
Jul 22 04:24:43.188569 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.188500    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 04:24:43.188569 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.188513    2564 server.go:87] "Starting device plugin registration server"
Jul 22 04:24:43.188826 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.188814    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 04:24:43.188856 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.188828    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 04:24:43.188939 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.188920    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 04:24:43.189014 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.189002    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 04:24:43.189064 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.189017    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 04:24:43.189541 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.189518    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 04:24:43.189614 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.189574    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:43.288080 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.288021    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.289243    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.289272    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.289322    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.289348    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.289390    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.290142    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.290180    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.290197    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:43.290334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.290248    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.291698 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.291680    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:43.295819 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.295804    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.295895 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.295824    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-26.ec2.internal\": node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:43.305610 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.305556    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:43.390495 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.390440    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"]
Jul 22 04:24:43.390668 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.390530    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:43.392039 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.392024    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:43.392111 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.392057    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:43.392111 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.392067    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:43.394453 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.394440    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:43.394572 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.394555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.394611 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.394588    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:43.395197 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.395179    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:43.395287 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.395229    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:43.395287 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.395245    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:43.395287 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.395250    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:43.395287 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.395268    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:43.395287 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.395278    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:43.397474 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.397456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.397565 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.397482    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:24:43.398166 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.398143    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:24:43.398166 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.398169    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:24:43.398327 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.398183    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:24:43.406483 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.406468    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:43.419024 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.419001    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-26.ec2.internal\" not found" node="ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.423613 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.423597    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-26.ec2.internal\" not found" node="ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.506631 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.506608    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:43.533962 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.533937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8278c981d94520c88dce0403440d011e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"8278c981d94520c88dce0403440d011e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.534032 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.533969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d79e369aa2d59c651a8ba89c9fc225a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"d79e369aa2d59c651a8ba89c9fc225a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.534032 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:43.533989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79e369aa2d59c651a8ba89c9fc225a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"d79e369aa2d59c651a8ba89c9fc225a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:43.607261 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:43.607159    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:45.510187 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.510159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8278c981d94520c88dce0403440d011e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"8278c981d94520c88dce0403440d011e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:45.510269 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.510189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d79e369aa2d59c651a8ba89c9fc225a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"d79e369aa2d59c651a8ba89c9fc225a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:45.510269 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.510209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79e369aa2d59c651a8ba89c9fc225a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"d79e369aa2d59c651a8ba89c9fc225a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:45.510269 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.510258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d79e369aa2d59c651a8ba89c9fc225a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"d79e369aa2d59c651a8ba89c9fc225a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:45.510362 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.510265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8278c981d94520c88dce0403440d011e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-26.ec2.internal\" (UID: \"8278c981d94520c88dce0403440d011e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:45.510362 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.510308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79e369aa2d59c651a8ba89c9fc225a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal\" (UID: \"d79e369aa2d59c651a8ba89c9fc225a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:45.583349 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:45.583309    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:45.597517 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.597493    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:45.602581 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.602391    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:45.683457 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:45.683411    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:45.784058 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:45.783985    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:45.884497 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:45.884467    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:45.930108 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.930073    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:45.947625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.947600    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 04:24:45.947799 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.947749    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 04:24:45.947799 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:45.947782    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 04:24:45.984998 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:45.984960    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:46.013079 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.013031    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 04:19:44 +0000 UTC" deadline="2028-03-28 16:28:11.37911618 +0000 UTC"
Jul 22 04:24:46.013079 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.013066    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14772h3m25.366057432s"
Jul 22 04:24:46.085882 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:46.085808    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:46.117015 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:46.116981    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8278c981d94520c88dce0403440d011e.slice/crio-aeb45d7e7399311073fdbfa4638aff4135732f58de8a91a9ec12bcfc7d3f47c1 WatchSource:0}: Error finding container aeb45d7e7399311073fdbfa4638aff4135732f58de8a91a9ec12bcfc7d3f47c1: Status 404 returned error can't find the container with id aeb45d7e7399311073fdbfa4638aff4135732f58de8a91a9ec12bcfc7d3f47c1
Jul 22 04:24:46.117215 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:46.117194    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79e369aa2d59c651a8ba89c9fc225a5.slice/crio-bd2196abe95939d5cd435530ed84c71a57fef51e3de0cfa1c26251d8aa561f1c WatchSource:0}: Error finding container bd2196abe95939d5cd435530ed84c71a57fef51e3de0cfa1c26251d8aa561f1c: Status 404 returned error can't find the container with id bd2196abe95939d5cd435530ed84c71a57fef51e3de0cfa1c26251d8aa561f1c
Jul 22 04:24:46.120206 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.120189    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:46.123342 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.123326    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:24:46.168703 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.168648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"d79e369aa2d59c651a8ba89c9fc225a5","Type":"ContainerStarted","Data":"bd2196abe95939d5cd435530ed84c71a57fef51e3de0cfa1c26251d8aa561f1c"}
Jul 22 04:24:46.169638 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.169614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" event={"ID":"8278c981d94520c88dce0403440d011e","Type":"ContainerStarted","Data":"aeb45d7e7399311073fdbfa4638aff4135732f58de8a91a9ec12bcfc7d3f47c1"}
Jul 22 04:24:46.186801 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:46.186772    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-26.ec2.internal\" not found"
Jul 22 04:24:46.219291 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.219268    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:46.308372 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.308333    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:46.316220 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.316201    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 04:24:46.316955 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.316942    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal"
Jul 22 04:24:46.325864 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.325845    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 04:24:46.985085 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.985048    2564 apiserver.go:52] "Watching apiserver"
Jul 22 04:24:46.992408 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.992381    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 04:24:46.994827 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.994789    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-rv2fl","openshift-multus/network-metrics-daemon-xms64","openshift-ovn-kubernetes/ovnkube-node-2b5f4","kube-system/global-pull-secret-syncer-8g68t","kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal","openshift-dns/node-resolver-cm2hm","openshift-image-registry/node-ca-fwqq6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal","openshift-multus/multus-rr745","openshift-network-diagnostics/network-check-target-hpkdj","openshift-network-operator/iptables-alerter-km54w","kube-system/konnectivity-agent-kwph5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz","openshift-cluster-node-tuning-operator/tuned-n8q69"]
Jul 22 04:24:46.997550 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.997526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:46.999841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:46.999817    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 04:24:47.000311 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.000121    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-659m8\""
Jul 22 04:24:47.000311 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.000139    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 04:24:47.000470 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.000343    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 04:24:47.000470 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.000372    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.003131 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.002610    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l4qb5\""
Jul 22 04:24:47.003131 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.002649    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 04:24:47.003131 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.002804    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:24:47.003131 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.003022    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.003552 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.003532    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 04:24:47.004988 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.004971    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.005087 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.005038    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:24:47.005366 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.005344    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 04:24:47.005638 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.005619    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 04:24:47.005806 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.005676    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 04:24:47.006908 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.006886    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2cdrx\""
Jul 22 04:24:47.007002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.006949    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 04:24:47.007002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.006967    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 04:24:47.007199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.007183    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 04:24:47.007405 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.007386    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.007720 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.007696    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 04:24:47.009614 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.009556    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gfz2j\""
Jul 22 04:24:47.009988 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.009967    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:24:47.010189 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.010172    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.011399 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.011381    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 04:24:47.012410 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.012388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ds8pj\""
Jul 22 04:24:47.012600 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.012583    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 04:24:47.012656 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.012645    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 04:24:47.013872 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.013728    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.016375 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.016355    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z8td5\""
Jul 22 04:24:47.016670 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.016652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.017671 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.017527    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 04:24:47.017784 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.017768    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 04:24:47.017882 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.017860    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 04:24:47.018040 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018024    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 04:24:47.018389 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-lib-modules\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.018451 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-var-lib-kubelet\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.018451 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqzb7\" (UniqueName: \"kubernetes.io/projected/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-kube-api-access-nqzb7\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.018552 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-host\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.018552 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-var-lib-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.018552 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018499    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysconfig\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.018552 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-host\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovn-node-metrics-cert\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-kubernetes\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4185d097-31d6-43fe-82af-7b35bebe846b-etc-tuned\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-ovn\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-cni-netd\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovnkube-config\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysctl-conf\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.018757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f7eb396e-4ec8-4282-84a9-33e21152443e-iptables-alerter-script\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5zcf\" (UniqueName: \"kubernetes.io/projected/9a446c1d-dbbf-43c3-8878-140d992fa52c-kube-api-access-t5zcf\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysctl-d\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018845    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-run\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jfkp\" (UniqueName: \"kubernetes.io/projected/4185d097-31d6-43fe-82af-7b35bebe846b-kube-api-access-9jfkp\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-serviceca\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-kubelet\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.018993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-dbus\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-systemd-units\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019082    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jjx4g\""
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:47.019172 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.019163    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-run-netns\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-etc-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-node-log\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-cni-bin\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019285    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-kubelet-config\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4185d097-31d6-43fe-82af-7b35bebe846b-tmp\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-hosts-file\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019401    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cjrl\" (UniqueName: \"kubernetes.io/projected/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-kube-api-access-7cjrl\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7eb396e-4ec8-4282-84a9-33e21152443e-host-slash\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p945g\" (UniqueName: \"kubernetes.io/projected/f7eb396e-4ec8-4282-84a9-33e21152443e-kube-api-access-p945g\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-slash\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-log-socket\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-modprobe-d\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-sys\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-tmp-dir\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.019861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-systemd\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.020693 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.020693 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-env-overrides\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.020693 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovnkube-script-lib\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.020693 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.019761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-systemd\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.020693 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.020071    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 04:24:47.021381 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.021317    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:47.021576 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.021548    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:24:47.023930 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.023893    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.026830 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.026173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:24:47.026830 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.026329    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 04:24:47.026830 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.026539    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 04:24:47.026830 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.026623    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4xh8h\""
Jul 22 04:24:47.029056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.029004    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 04:24:47.029056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.029046    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 04:24:47.029332 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.029306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9l5d2\""
Jul 22 04:24:47.040819 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.040793    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzltd"
Jul 22 04:24:47.049479 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.049451    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzltd"
Jul 22 04:24:47.109159 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.109126    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 04:24:47.120208 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120166    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5zcf\" (UniqueName: \"kubernetes.io/projected/9a446c1d-dbbf-43c3-8878-140d992fa52c-kube-api-access-t5zcf\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.120383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.120383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysctl-d\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.120383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-run\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.120383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-kubelet\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.120383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-kubelet\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.120383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-socket-dir-parent\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120423    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-socket-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-run\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysctl-d\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-system-cni-dir\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cnibin\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-run-netns\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.120637    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-etc-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.120686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-system-cni-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-etc-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120655    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-run-netns\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.120719    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret podName:7db9fc18-6ab0-4f65-8622-6e9f0c3c36de nodeName:}" failed. No retries permitted until 2026-07-22 04:24:47.620695794 +0000 UTC m=+2.904561186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret") pod "global-pull-secret-syncer-8g68t" (UID: "7db9fc18-6ab0-4f65-8622-6e9f0c3c36de") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-cnibin\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-kubelet-config\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4185d097-31d6-43fe-82af-7b35bebe846b-tmp\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-hosts-file\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-hosts-file\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-kubelet-config\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.120994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjrl\" (UniqueName: \"kubernetes.io/projected/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-kube-api-access-7cjrl\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7eb396e-4ec8-4282-84a9-33e21152443e-host-slash\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p945g\" (UniqueName: \"kubernetes.io/projected/f7eb396e-4ec8-4282-84a9-33e21152443e-kube-api-access-p945g\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-log-socket\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7eb396e-4ec8-4282-84a9-33e21152443e-host-slash\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-netns\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-systemd\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.121236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-log-socket\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121208    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-systemd\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-env-overrides\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-os-release\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-hostroot\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-sys-fs\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-systemd\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-lib-modules\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-var-lib-kubelet\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-systemd\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121535    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqzb7\" (UniqueName: \"kubernetes.io/projected/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-kube-api-access-nqzb7\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-host\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-var-lib-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-var-lib-kubelet\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-host\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-etc-kubernetes\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.122129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysconfig\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-lib-modules\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ccf3d05-fde7-4768-9984-dfd91465e72e-agent-certs\") pod \"konnectivity-agent-kwph5\" (UID: \"1ccf3d05-fde7-4768-9984-dfd91465e72e\") " pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-var-lib-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-cni-bin\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-env-overrides\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysconfig\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-kubernetes\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4185d097-31d6-43fe-82af-7b35bebe846b-etc-tuned\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovnkube-config\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-kubernetes\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-k8s-cni-cncf-io\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-cni-multus\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysctl-conf\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.121976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f7eb396e-4ec8-4282-84a9-33e21152443e-iptables-alerter-script\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-registration-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.123059 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jfkp\" (UniqueName: \"kubernetes.io/projected/4185d097-31d6-43fe-82af-7b35bebe846b-kube-api-access-9jfkp\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-serviceca\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-cni-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3882e8b-fa29-4881-815c-a21b8c61fbf2-cni-binary-copy\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-conf-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-multus-certs\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-dbus\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-systemd-units\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-node-log\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-sysctl-conf\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-cni-bin\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovnkube-config\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6p7q\" (UniqueName: \"kubernetes.io/projected/dad8fcac-e29e-4878-a3d9-9f787bf3551e-kube-api-access-q6p7q\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-device-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.124002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8glg\" (UniqueName: \"kubernetes.io/projected/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-kube-api-access-p8glg\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-slash\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-dbus\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxjg7\" (UniqueName: \"kubernetes.io/projected/206eec8a-5ac8-477f-9797-cec90e3236da-kube-api-access-qxjg7\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-cni-bin\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-modprobe-d\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-sys\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-tmp-dir\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122590    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-slash\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122555    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-sys\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122587    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-systemd-units\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-node-log\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovnkube-script-lib\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122708    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-serviceca\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.124865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-etc-modprobe-d\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122772    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f7eb396e-4ec8-4282-84a9-33e21152443e-iptables-alerter-script\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-host\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-tmp-dir\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4185d097-31d6-43fe-82af-7b35bebe846b-host\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovn-node-metrics-cert\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-openvswitch\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.122988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-kubelet\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-daemon-config\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g2km\" (UniqueName: \"kubernetes.io/projected/e3882e8b-fa29-4881-815c-a21b8c61fbf2-kube-api-access-4g2km\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123145    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovnkube-script-lib\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-ovn\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-cni-netd\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ccf3d05-fde7-4768-9984-dfd91465e72e-konnectivity-ca\") pod \"konnectivity-agent-kwph5\" (UID: \"1ccf3d05-fde7-4768-9984-dfd91465e72e\") " pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:24:47.125696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123274    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-run-ovn\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.126523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-os-release\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.126523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.123314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a446c1d-dbbf-43c3-8878-140d992fa52c-host-cni-netd\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.126523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.124862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4185d097-31d6-43fe-82af-7b35bebe846b-etc-tuned\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.126523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.124930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4185d097-31d6-43fe-82af-7b35bebe846b-tmp\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.128009 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.127268    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a446c1d-dbbf-43c3-8878-140d992fa52c-ovn-node-metrics-cert\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.130824 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.130679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5zcf\" (UniqueName: \"kubernetes.io/projected/9a446c1d-dbbf-43c3-8878-140d992fa52c-kube-api-access-t5zcf\") pod \"ovnkube-node-2b5f4\" (UID: \"9a446c1d-dbbf-43c3-8878-140d992fa52c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.131010 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.130985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqzb7\" (UniqueName: \"kubernetes.io/projected/ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6-kube-api-access-nqzb7\") pod \"node-resolver-cm2hm\" (UID: \"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6\") " pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.131117 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.131023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cjrl\" (UniqueName: \"kubernetes.io/projected/0d672265-00a0-46f3-a9a7-a5c0882ccc5c-kube-api-access-7cjrl\") pod \"node-ca-fwqq6\" (UID: \"0d672265-00a0-46f3-a9a7-a5c0882ccc5c\") " pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.131443 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.131422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p945g\" (UniqueName: \"kubernetes.io/projected/f7eb396e-4ec8-4282-84a9-33e21152443e-kube-api-access-p945g\") pod \"iptables-alerter-km54w\" (UID: \"f7eb396e-4ec8-4282-84a9-33e21152443e\") " pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.132099 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.132077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jfkp\" (UniqueName: \"kubernetes.io/projected/4185d097-31d6-43fe-82af-7b35bebe846b-kube-api-access-9jfkp\") pod \"tuned-n8q69\" (UID: \"4185d097-31d6-43fe-82af-7b35bebe846b\") " pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.224012 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.223978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224012 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-socket-dir-parent\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-socket-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.224255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-system-cni-dir\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cnibin\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-socket-dir-parent\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-system-cni-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-cnibin\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-netns\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-os-release\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224286    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-socket-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-hostroot\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224326    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-sys-fs\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-hostroot\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-cnibin\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224379    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-system-cni-dir\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cnibin\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-etc-kubernetes\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ccf3d05-fde7-4768-9984-dfd91465e72e-agent-certs\") pod \"konnectivity-agent-kwph5\" (UID: \"1ccf3d05-fde7-4768-9984-dfd91465e72e\") " pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-etc-kubernetes\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-system-cni-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-os-release\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224484    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-sys-fs\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-cni-bin\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:47.224675 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dad8fcac-e29e-4878-a3d9-9f787bf3551e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-cni-bin\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-netns\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-k8s-cni-cncf-io\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.224626    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-cni-multus\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-registration-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.224688    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:24:47.724670585 +0000 UTC m=+3.008535983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-k8s-cni-cncf-io\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-registration-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-cni-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-cni-multus\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3882e8b-fa29-4881-815c-a21b8c61fbf2-cni-binary-copy\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-conf-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-cni-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-multus-certs\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.225506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224798    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-conf-dir\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224843    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-run-multus-certs\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6p7q\" (UniqueName: \"kubernetes.io/projected/dad8fcac-e29e-4878-a3d9-9f787bf3551e-kube-api-access-q6p7q\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-device-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8glg\" (UniqueName: \"kubernetes.io/projected/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-kube-api-access-p8glg\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.224993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-device-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxjg7\" (UniqueName: \"kubernetes.io/projected/206eec8a-5ac8-477f-9797-cec90e3236da-kube-api-access-qxjg7\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-kubelet\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-daemon-config\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g2km\" (UniqueName: \"kubernetes.io/projected/e3882e8b-fa29-4881-815c-a21b8c61fbf2-kube-api-access-4g2km\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ccf3d05-fde7-4768-9984-dfd91465e72e-konnectivity-ca\") pod \"konnectivity-agent-kwph5\" (UID: \"1ccf3d05-fde7-4768-9984-dfd91465e72e\") " pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:24:47.226199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-os-release\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226856 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3882e8b-fa29-4881-815c-a21b8c61fbf2-cni-binary-copy\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226856 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.226856 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-os-release\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226856 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3882e8b-fa29-4881-815c-a21b8c61fbf2-host-var-lib-kubelet\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226856 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225815    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3882e8b-fa29-4881-815c-a21b8c61fbf2-multus-daemon-config\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.226856 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.225835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dad8fcac-e29e-4878-a3d9-9f787bf3551e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.226856 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.226337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ccf3d05-fde7-4768-9984-dfd91465e72e-konnectivity-ca\") pod \"konnectivity-agent-kwph5\" (UID: \"1ccf3d05-fde7-4768-9984-dfd91465e72e\") " pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:24:47.230043 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.227603    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ccf3d05-fde7-4768-9984-dfd91465e72e-agent-certs\") pod \"konnectivity-agent-kwph5\" (UID: \"1ccf3d05-fde7-4768-9984-dfd91465e72e\") " pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:24:47.233568 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.233541    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:47.233568 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.233564    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:47.233724 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.233576    2564 projected.go:196] Error preparing data for projected volume kube-api-access-r9qqj for pod openshift-network-diagnostics/network-check-target-hpkdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:47.233724 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.233634    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj podName:97109624-40a0-4b8f-9a1a-1a3b00e5c0d2 nodeName:}" failed. No retries permitted until 2026-07-22 04:24:47.733620429 +0000 UTC m=+3.017485822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r9qqj" (UniqueName: "kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj") pod "network-check-target-hpkdj" (UID: "97109624-40a0-4b8f-9a1a-1a3b00e5c0d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:47.240346 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.240279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g2km\" (UniqueName: \"kubernetes.io/projected/e3882e8b-fa29-4881-815c-a21b8c61fbf2-kube-api-access-4g2km\") pod \"multus-rr745\" (UID: \"e3882e8b-fa29-4881-815c-a21b8c61fbf2\") " pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.240746 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.240704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6p7q\" (UniqueName: \"kubernetes.io/projected/dad8fcac-e29e-4878-a3d9-9f787bf3551e-kube-api-access-q6p7q\") pod \"multus-additional-cni-plugins-rv2fl\" (UID: \"dad8fcac-e29e-4878-a3d9-9f787bf3551e\") " pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.240850 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.240770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxjg7\" (UniqueName: \"kubernetes.io/projected/206eec8a-5ac8-477f-9797-cec90e3236da-kube-api-access-qxjg7\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:47.240898 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.240849    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8glg\" (UniqueName: \"kubernetes.io/projected/5a31b5a5-1813-4852-ae41-3dcb3dc954c0-kube-api-access-p8glg\") pod \"aws-ebs-csi-driver-node-6qdvz\" (UID: \"5a31b5a5-1813-4852-ae41-3dcb3dc954c0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.246948 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.246927    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:47.312143 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.312117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fwqq6"
Jul 22 04:24:47.322107 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.322077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-km54w"
Jul 22 04:24:47.331898 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.331879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:24:47.337532 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.337512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n8q69"
Jul 22 04:24:47.345171 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.345153    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cm2hm"
Jul 22 04:24:47.351753 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.351724    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rr745"
Jul 22 04:24:47.357382 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.357363    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz"
Jul 22 04:24:47.363995 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.363967    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rv2fl"
Jul 22 04:24:47.369539 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.369514    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:24:47.628459 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.628366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:47.628637 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.628480    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:47.628637 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.628532    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret podName:7db9fc18-6ab0-4f65-8622-6e9f0c3c36de nodeName:}" failed. No retries permitted until 2026-07-22 04:24:48.628519137 +0000 UTC m=+3.912384510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret") pod "global-pull-secret-syncer-8g68t" (UID: "7db9fc18-6ab0-4f65-8622-6e9f0c3c36de") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:47.729378 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.729345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:47.729570 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.729517    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:47.729632 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.729592    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:24:48.729570808 +0000 UTC m=+4.013436185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:47.830074 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:47.830035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:47.830269 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.830176    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:47.830269 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.830197    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:47.830269 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.830210    2564 projected.go:196] Error preparing data for projected volume kube-api-access-r9qqj for pod openshift-network-diagnostics/network-check-target-hpkdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:47.830269 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:47.830271    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj podName:97109624-40a0-4b8f-9a1a-1a3b00e5c0d2 nodeName:}" failed. No retries permitted until 2026-07-22 04:24:48.830254419 +0000 UTC m=+4.114119811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9qqj" (UniqueName: "kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj") pod "network-check-target-hpkdj" (UID: "97109624-40a0-4b8f-9a1a-1a3b00e5c0d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:47.951233 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.951135    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7eb396e_4ec8_4282_84a9_33e21152443e.slice/crio-184c73f9ba436901d627e21d70d7113bcb0b611cbc96cf1a9478829200eb1f8e WatchSource:0}: Error finding container 184c73f9ba436901d627e21d70d7113bcb0b611cbc96cf1a9478829200eb1f8e: Status 404 returned error can't find the container with id 184c73f9ba436901d627e21d70d7113bcb0b611cbc96cf1a9478829200eb1f8e
Jul 22 04:24:47.953017 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.952995    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d672265_00a0_46f3_a9a7_a5c0882ccc5c.slice/crio-acafefc9fd58d7a988d9e1bcdb2259cb12a945d8924c17740d14a6667f61be95 WatchSource:0}: Error finding container acafefc9fd58d7a988d9e1bcdb2259cb12a945d8924c17740d14a6667f61be95: Status 404 returned error can't find the container with id acafefc9fd58d7a988d9e1bcdb2259cb12a945d8924c17740d14a6667f61be95
Jul 22 04:24:47.974457 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.974428    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ccf3d05_fde7_4768_9984_dfd91465e72e.slice/crio-9cd651328b50a6b08ac348d607d122e335b32724ad17f5f69272af0f2488c0c1 WatchSource:0}: Error finding container 9cd651328b50a6b08ac348d607d122e335b32724ad17f5f69272af0f2488c0c1: Status 404 returned error can't find the container with id 9cd651328b50a6b08ac348d607d122e335b32724ad17f5f69272af0f2488c0c1
Jul 22 04:24:47.975092 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.975071    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a31b5a5_1813_4852_ae41_3dcb3dc954c0.slice/crio-b012b2297fd54ea54024790beb20a3ca62e71439032da3c8423099da99287714 WatchSource:0}: Error finding container b012b2297fd54ea54024790beb20a3ca62e71439032da3c8423099da99287714: Status 404 returned error can't find the container with id b012b2297fd54ea54024790beb20a3ca62e71439032da3c8423099da99287714
Jul 22 04:24:47.975946 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.975922    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad8fcac_e29e_4878_a3d9_9f787bf3551e.slice/crio-5594e05c0da09a2a67035c630aaf5510c6c40ab0fa00b626f5972218c1597e75 WatchSource:0}: Error finding container 5594e05c0da09a2a67035c630aaf5510c6c40ab0fa00b626f5972218c1597e75: Status 404 returned error can't find the container with id 5594e05c0da09a2a67035c630aaf5510c6c40ab0fa00b626f5972218c1597e75
Jul 22 04:24:47.976890 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.976835    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4185d097_31d6_43fe_82af_7b35bebe846b.slice/crio-fa8f4a941aeda09399f7fb5d7f53649e4ae04e6cfe3d17ff5299e7672f8a14fe WatchSource:0}: Error finding container fa8f4a941aeda09399f7fb5d7f53649e4ae04e6cfe3d17ff5299e7672f8a14fe: Status 404 returned error can't find the container with id fa8f4a941aeda09399f7fb5d7f53649e4ae04e6cfe3d17ff5299e7672f8a14fe
Jul 22 04:24:47.983577 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.983528    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc87cf6_25fd_4215_8bcb_98a5a3e9abc6.slice/crio-2a6d10515228af6908f264b5033601be781fbee2eb30fc3b5967ab6300772ae7 WatchSource:0}: Error finding container 2a6d10515228af6908f264b5033601be781fbee2eb30fc3b5967ab6300772ae7: Status 404 returned error can't find the container with id 2a6d10515228af6908f264b5033601be781fbee2eb30fc3b5967ab6300772ae7
Jul 22 04:24:47.984191 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.983918    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3882e8b_fa29_4881_815c_a21b8c61fbf2.slice/crio-d56ae6a4d5885ae6691fadee219d0dfb4f58ed9dbb1e0829a7559e51c3695c9e WatchSource:0}: Error finding container d56ae6a4d5885ae6691fadee219d0dfb4f58ed9dbb1e0829a7559e51c3695c9e: Status 404 returned error can't find the container with id d56ae6a4d5885ae6691fadee219d0dfb4f58ed9dbb1e0829a7559e51c3695c9e
Jul 22 04:24:47.986070 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:24:47.985703    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a446c1d_dbbf_43c3_8878_140d992fa52c.slice/crio-50c8a08e86783eabb99e567ab2126c64e0abfb0e4f3b29a56e87582190131e9e WatchSource:0}: Error finding container 50c8a08e86783eabb99e567ab2126c64e0abfb0e4f3b29a56e87582190131e9e: Status 404 returned error can't find the container with id 50c8a08e86783eabb99e567ab2126c64e0abfb0e4f3b29a56e87582190131e9e
Jul 22 04:24:48.052410 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.052327    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 04:19:47 +0000 UTC" deadline="2028-01-11 05:18:51.024259529 +0000 UTC"
Jul 22 04:24:48.052536 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.052415    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12912h54m2.971854977s"
Jul 22 04:24:48.164511 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.164490    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:24:48.165707 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.165688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:48.165781 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.165691    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:48.165839 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.165821    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:24:48.165950 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.165932    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:24:48.173823 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.173796    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fwqq6" event={"ID":"0d672265-00a0-46f3-a9a7-a5c0882ccc5c","Type":"ContainerStarted","Data":"acafefc9fd58d7a988d9e1bcdb2259cb12a945d8924c17740d14a6667f61be95"}
Jul 22 04:24:48.174828 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.174801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-km54w" event={"ID":"f7eb396e-4ec8-4282-84a9-33e21152443e","Type":"ContainerStarted","Data":"184c73f9ba436901d627e21d70d7113bcb0b611cbc96cf1a9478829200eb1f8e"}
Jul 22 04:24:48.175893 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.175872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"50c8a08e86783eabb99e567ab2126c64e0abfb0e4f3b29a56e87582190131e9e"}
Jul 22 04:24:48.176817 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.176798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rr745" event={"ID":"e3882e8b-fa29-4881-815c-a21b8c61fbf2","Type":"ContainerStarted","Data":"d56ae6a4d5885ae6691fadee219d0dfb4f58ed9dbb1e0829a7559e51c3695c9e"}
Jul 22 04:24:48.177782 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.177755    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n8q69" event={"ID":"4185d097-31d6-43fe-82af-7b35bebe846b","Type":"ContainerStarted","Data":"fa8f4a941aeda09399f7fb5d7f53649e4ae04e6cfe3d17ff5299e7672f8a14fe"}
Jul 22 04:24:48.178778 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.178755    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz" event={"ID":"5a31b5a5-1813-4852-ae41-3dcb3dc954c0","Type":"ContainerStarted","Data":"b012b2297fd54ea54024790beb20a3ca62e71439032da3c8423099da99287714"}
Jul 22 04:24:48.181784 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.181759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" event={"ID":"8278c981d94520c88dce0403440d011e","Type":"ContainerStarted","Data":"afba110fd5b1d2bf793bd515b16fb4bfe5a6a8df976aeacf50c2d06b1f437419"}
Jul 22 04:24:48.182864 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.182846    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cm2hm" event={"ID":"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6","Type":"ContainerStarted","Data":"2a6d10515228af6908f264b5033601be781fbee2eb30fc3b5967ab6300772ae7"}
Jul 22 04:24:48.183840 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.183819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kwph5" event={"ID":"1ccf3d05-fde7-4768-9984-dfd91465e72e","Type":"ContainerStarted","Data":"9cd651328b50a6b08ac348d607d122e335b32724ad17f5f69272af0f2488c0c1"}
Jul 22 04:24:48.184729 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.184709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" event={"ID":"dad8fcac-e29e-4878-a3d9-9f787bf3551e","Type":"ContainerStarted","Data":"5594e05c0da09a2a67035c630aaf5510c6c40ab0fa00b626f5972218c1597e75"}
Jul 22 04:24:48.636914 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.636830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:48.637069 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.637013    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:48.637125 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.637072    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret podName:7db9fc18-6ab0-4f65-8622-6e9f0c3c36de nodeName:}" failed. No retries permitted until 2026-07-22 04:24:50.637052538 +0000 UTC m=+5.920917939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret") pod "global-pull-secret-syncer-8g68t" (UID: "7db9fc18-6ab0-4f65-8622-6e9f0c3c36de") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:48.737967 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.737883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:48.738146 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.738100    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:48.738206 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.738166    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:24:50.738147179 +0000 UTC m=+6.022012607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:48.838634 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:48.838601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:48.838814 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.838805    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:48.838890 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.838837    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:48.838890 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.838850    2564 projected.go:196] Error preparing data for projected volume kube-api-access-r9qqj for pod openshift-network-diagnostics/network-check-target-hpkdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:48.838982 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:48.838908    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj podName:97109624-40a0-4b8f-9a1a-1a3b00e5c0d2 nodeName:}" failed. No retries permitted until 2026-07-22 04:24:50.838887876 +0000 UTC m=+6.122753262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9qqj" (UniqueName: "kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj") pod "network-check-target-hpkdj" (UID: "97109624-40a0-4b8f-9a1a-1a3b00e5c0d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:49.052914 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:49.052806    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 04:19:47 +0000 UTC" deadline="2028-05-04 17:12:00.798214498 +0000 UTC"
Jul 22 04:24:49.052914 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:49.052862    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15660h47m11.745356975s"
Jul 22 04:24:49.166908 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:49.166870    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:49.167084 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:49.166991    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:24:49.200861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:49.200657    2564 generic.go:356] "Generic (PLEG): container finished" podID="d79e369aa2d59c651a8ba89c9fc225a5" containerID="7b7f72b767d83e1c0db772c228e2a23ccf480e0238e03baed800c62c1522a780" exitCode=0
Jul 22 04:24:49.200861 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:49.200727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"d79e369aa2d59c651a8ba89c9fc225a5","Type":"ContainerDied","Data":"7b7f72b767d83e1c0db772c228e2a23ccf480e0238e03baed800c62c1522a780"}
Jul 22 04:24:49.217144 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:49.216692    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-26.ec2.internal" podStartSLOduration=3.216671575 podStartE2EDuration="3.216671575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:24:48.207088607 +0000 UTC m=+3.490954004" watchObservedRunningTime="2026-07-22 04:24:49.216671575 +0000 UTC m=+4.500536973"
Jul 22 04:24:50.165364 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:50.165330    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:50.165885 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.165483    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:24:50.165955 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:50.165882    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:50.166020 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.165981    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:24:50.221615 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:50.221576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" event={"ID":"d79e369aa2d59c651a8ba89c9fc225a5","Type":"ContainerStarted","Data":"932ebe1354f484099f82317b5d5e941ad1bf33687ec65ffce1330e9c4147fc2e"}
Jul 22 04:24:50.236673 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:50.236615    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-26.ec2.internal" podStartSLOduration=4.236593192 podStartE2EDuration="4.236593192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:24:50.236053392 +0000 UTC m=+5.519918788" watchObservedRunningTime="2026-07-22 04:24:50.236593192 +0000 UTC m=+5.520458591"
Jul 22 04:24:50.656828 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:50.656724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:50.657001 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.656893    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:50.657001 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.656955    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret podName:7db9fc18-6ab0-4f65-8622-6e9f0c3c36de nodeName:}" failed. No retries permitted until 2026-07-22 04:24:54.656937304 +0000 UTC m=+9.940802692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret") pod "global-pull-secret-syncer-8g68t" (UID: "7db9fc18-6ab0-4f65-8622-6e9f0c3c36de") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:50.757158 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:50.757119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:50.757348 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.757300    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:50.757415 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.757368    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:24:54.757347087 +0000 UTC m=+10.041212482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:50.859823 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:50.859786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:50.860040 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.859960    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:50.860040 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.859977    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:50.860040 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.859990    2564 projected.go:196] Error preparing data for projected volume kube-api-access-r9qqj for pod openshift-network-diagnostics/network-check-target-hpkdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:50.860199 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:50.860047    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj podName:97109624-40a0-4b8f-9a1a-1a3b00e5c0d2 nodeName:}" failed. No retries permitted until 2026-07-22 04:24:54.860028043 +0000 UTC m=+10.143893420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9qqj" (UniqueName: "kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj") pod "network-check-target-hpkdj" (UID: "97109624-40a0-4b8f-9a1a-1a3b00e5c0d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:51.166110 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:51.166063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:51.166585 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:51.166223    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:24:52.165364 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:52.165332    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:52.165545 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:52.165369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:52.165605 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:52.165566    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:24:52.165673 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:52.165620    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:24:53.165922 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:53.165829    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:53.166392 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:53.165969    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:24:54.165158 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:54.165117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:54.165323 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.165264    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:24:54.165685 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:54.165667    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:54.165816 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.165795    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:24:54.693607 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:54.693552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:54.694109 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.693748    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:54.694109 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.693833    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret podName:7db9fc18-6ab0-4f65-8622-6e9f0c3c36de nodeName:}" failed. No retries permitted until 2026-07-22 04:25:02.693811072 +0000 UTC m=+17.977676460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret") pod "global-pull-secret-syncer-8g68t" (UID: "7db9fc18-6ab0-4f65-8622-6e9f0c3c36de") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:24:54.794570 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:54.794532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:54.794780 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.794711    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:54.794839 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.794806    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:25:02.794789064 +0000 UTC m=+18.078654441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:24:54.895797 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:54.895679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:54.895983 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.895904    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:24:54.895983 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.895931    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:24:54.895983 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.895944    2564 projected.go:196] Error preparing data for projected volume kube-api-access-r9qqj for pod openshift-network-diagnostics/network-check-target-hpkdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:54.896138 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:54.896003    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj podName:97109624-40a0-4b8f-9a1a-1a3b00e5c0d2 nodeName:}" failed. No retries permitted until 2026-07-22 04:25:02.895985211 +0000 UTC m=+18.179850588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9qqj" (UniqueName: "kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj") pod "network-check-target-hpkdj" (UID: "97109624-40a0-4b8f-9a1a-1a3b00e5c0d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:24:55.167280 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:55.166782    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:55.167280 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:55.166891    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:24:56.166018 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:56.165474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:56.166018 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:56.165610    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:24:56.166018 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:56.165932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:56.166623 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:56.166042    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:24:57.165706 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:57.165664    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:57.165907 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:57.165822    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:24:58.166070 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:58.166024    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:24:58.166070 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:58.166061    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:24:58.166547 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:58.166184    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:24:58.166547 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:58.166318    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:24:59.166148 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:24:59.166113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:24:59.166615 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:24:59.166240    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:00.165666 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:00.165628    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:00.165863 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:00.165629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:00.165863 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:00.165767    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:00.165963 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:00.165859    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:01.166081 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:01.166043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:01.166562 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:01.166180    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:02.165425 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:02.165393    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:02.165425 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:02.165420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:02.165722 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.165521    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:02.165722 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.165643    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:02.757531 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:02.757499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:02.758011 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.757633    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:25:02.758011 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.757708    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret podName:7db9fc18-6ab0-4f65-8622-6e9f0c3c36de nodeName:}" failed. No retries permitted until 2026-07-22 04:25:18.757688685 +0000 UTC m=+34.041554062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret") pod "global-pull-secret-syncer-8g68t" (UID: "7db9fc18-6ab0-4f65-8622-6e9f0c3c36de") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:25:02.858202 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:02.858157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:02.858355 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.858301    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:25:02.858403 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.858364    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:25:18.858350465 +0000 UTC m=+34.142215841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:25:02.958548 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:02.958510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:02.958758 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.958656    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:25:02.958758 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.958677    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:25:02.958758 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.958689    2564 projected.go:196] Error preparing data for projected volume kube-api-access-r9qqj for pod openshift-network-diagnostics/network-check-target-hpkdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:25:02.958914 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:02.958769    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj podName:97109624-40a0-4b8f-9a1a-1a3b00e5c0d2 nodeName:}" failed. No retries permitted until 2026-07-22 04:25:18.958750195 +0000 UTC m=+34.242615588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9qqj" (UniqueName: "kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj") pod "network-check-target-hpkdj" (UID: "97109624-40a0-4b8f-9a1a-1a3b00e5c0d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:25:03.169205 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:03.169129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:03.169369 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:03.169242    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:04.165976 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:04.165936    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:04.166448 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:04.165936    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:04.166448 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:04.166091    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:04.166448 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:04.166192    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:05.168847 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:05.168813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:05.169244 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:05.168935    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:06.165864 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:06.165827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:06.166030 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:06.165827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:06.166030 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:06.165964    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:06.166030 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:06.165995    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:07.166011 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.165817    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:07.166428 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:07.166153    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:07.253624 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.253532    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n8q69" event={"ID":"4185d097-31d6-43fe-82af-7b35bebe846b","Type":"ContainerStarted","Data":"632bcc2541db1cf847a804177728a3629c6aa6715ddd5c2976355cf94429ac71"}
Jul 22 04:25:07.254923 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.254902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz" event={"ID":"5a31b5a5-1813-4852-ae41-3dcb3dc954c0","Type":"ContainerStarted","Data":"e726f63327046f36459f44c6c02f1bca11f43d58bc206fb182751b7facb62982"}
Jul 22 04:25:07.256178 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.256156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cm2hm" event={"ID":"ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6","Type":"ContainerStarted","Data":"f74ed589fca7808da4dadbc212b4177676a3424874312d8e4a13bf3cea13e57d"}
Jul 22 04:25:07.257376 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.257356    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kwph5" event={"ID":"1ccf3d05-fde7-4768-9984-dfd91465e72e","Type":"ContainerStarted","Data":"ec6a0fa0becc9034f8819d2b38ba8ae8fbcef4adef8bdc365095ab0b94f32bfd"}
Jul 22 04:25:07.258746 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.258711    2564 generic.go:356] "Generic (PLEG): container finished" podID="dad8fcac-e29e-4878-a3d9-9f787bf3551e" containerID="a4a7f271f756ef8c81f89bd7ecb41844a94a0fbb0bac744cf02e4bafd31dcdb5" exitCode=0
Jul 22 04:25:07.258841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.258766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" event={"ID":"dad8fcac-e29e-4878-a3d9-9f787bf3551e","Type":"ContainerDied","Data":"a4a7f271f756ef8c81f89bd7ecb41844a94a0fbb0bac744cf02e4bafd31dcdb5"}
Jul 22 04:25:07.260339 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.260321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fwqq6" event={"ID":"0d672265-00a0-46f3-a9a7-a5c0882ccc5c","Type":"ContainerStarted","Data":"20913bfc9d3e19a18fef857fa7cc8d477232efeeb2d41f3cb63dfe8906fe6faf"}
Jul 22 04:25:07.261697 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.261677    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rr745" event={"ID":"e3882e8b-fa29-4881-815c-a21b8c61fbf2","Type":"ContainerStarted","Data":"2ad57846bb1227ab4ea14cb047e37273f3de681ed6ba953f54db12051e1326ce"}
Jul 22 04:25:07.271013 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.270976    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n8q69" podStartSLOduration=3.588136161 podStartE2EDuration="22.270963516s" totalImagesPullingTime="18.682827355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.270455734 +0000 UTC m=+22.554321129" watchObservedRunningTime="2026-07-22 04:25:07.270963516 +0000 UTC m=+22.554828911"
Jul 22 04:25:07.308752 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.308690    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kwph5" podStartSLOduration=12.01427715 podStartE2EDuration="22.308673758s" totalImagesPullingTime="10.294396608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.308399026 +0000 UTC m=+22.592264422" watchObservedRunningTime="2026-07-22 04:25:07.308673758 +0000 UTC m=+22.592539153"
Jul 22 04:25:07.325565 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.325516    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cm2hm" podStartSLOduration=3.647969953 podStartE2EDuration="22.325493009s" totalImagesPullingTime="18.677523056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.324666995 +0000 UTC m=+22.608532391" watchObservedRunningTime="2026-07-22 04:25:07.325493009 +0000 UTC m=+22.609358406"
Jul 22 04:25:07.346106 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.346055    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rr745" podStartSLOduration=3.656734646 podStartE2EDuration="22.346040146s" totalImagesPullingTime="18.6893055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.345176975 +0000 UTC m=+22.629042382" watchObservedRunningTime="2026-07-22 04:25:07.346040146 +0000 UTC m=+22.629905549"
Jul 22 04:25:07.380189 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.380133    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fwqq6" podStartSLOduration=3.689892847 podStartE2EDuration="22.380112543s" totalImagesPullingTime="18.690219696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:07.380097266 +0000 UTC m=+22.663962663" watchObservedRunningTime="2026-07-22 04:25:07.380112543 +0000 UTC m=+22.663977939"
Jul 22 04:25:07.848567 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.848383    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:25:07.849085 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:07.849068    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:25:08.165110 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.165081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:08.165110 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.165106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:08.165268 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:08.165226    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:08.165357 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:08.165319    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:08.179092 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.179069    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 04:25:08.266591 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.266559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz" event={"ID":"5a31b5a5-1813-4852-ae41-3dcb3dc954c0","Type":"ContainerStarted","Data":"6a14b5f667df1a3af0f23261c79de02b6dc81553b5a500c628e0e4ff8ab8d6eb"}
Jul 22 04:25:08.268246 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.268213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-km54w" event={"ID":"f7eb396e-4ec8-4282-84a9-33e21152443e","Type":"ContainerStarted","Data":"a6bc5fd00d4615bc2bb3bbf02c034fb1535db35fbaabed445b488d3ff7adde01"}
Jul 22 04:25:08.271350 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.271330    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:25:08.271721 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.271693    2564 generic.go:356] "Generic (PLEG): container finished" podID="9a446c1d-dbbf-43c3-8878-140d992fa52c" containerID="25d20ee1f323941ad815ad408c6ccf6349599c00f40e245791134a43aefad78d" exitCode=1
Jul 22 04:25:08.271837 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.271780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"951c1ea82aff8e339fa4bc8a1842bbc31a9f40756bca10ff41cbd3909bad6173"}
Jul 22 04:25:08.271900 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.271857    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"49d908880946bd22575edf05ca82829e399fb7b5aba372c0e218ee1e817ab07f"}
Jul 22 04:25:08.271956 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.271906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"b7ef8fd2c58ada5255d4bfdd79cf3fe5d7ed7b4e065388e6b95207e82455972c"}
Jul 22 04:25:08.271956 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.271952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"1eab806c431a454768f48502656188d7f4b9b20450d608da72a19b5f3f8c218b"}
Jul 22 04:25:08.272046 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.271999    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerDied","Data":"25d20ee1f323941ad815ad408c6ccf6349599c00f40e245791134a43aefad78d"}
Jul 22 04:25:08.272046 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.272040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"21b5dc47bd079b7772367a7e521a450ba211b42d606192d0c2afa9780d704bc7"}
Jul 22 04:25:08.272390 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.272372    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:25:08.272835 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.272811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kwph5"
Jul 22 04:25:08.297556 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:08.297465    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-km54w" podStartSLOduration=4.629258047 podStartE2EDuration="23.297442603s" totalImagesPullingTime="18.668184556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:08.282587092 +0000 UTC m=+23.566452492" watchObservedRunningTime="2026-07-22 04:25:08.297442603 +0000 UTC m=+23.581307999"
Jul 22 04:25:09.080378 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:09.080265    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T04:25:08.179085675Z","UUID":"ea3ff5a5-85c3-4466-b5c2-f0ae0672d958","Handler":null,"Name":"","Endpoint":""}
Jul 22 04:25:09.083836 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:09.083791    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 04:25:09.083836 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:09.083840    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 04:25:09.166106 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:09.166075    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:09.166292 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:09.166205    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:10.165643 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:10.165608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:10.165643 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:10.165645    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:10.166171 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:10.165785    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:10.166171 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:10.165904    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:10.278578 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:10.278534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz" event={"ID":"5a31b5a5-1813-4852-ae41-3dcb3dc954c0","Type":"ContainerStarted","Data":"b22af24e15d9025cf66226a80b785296ba59e6a6a347a7fdb19c6b4009fa8224"}
Jul 22 04:25:10.296728 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:10.296674    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qdvz" podStartSLOduration=4.38099622 podStartE2EDuration="25.296653664s" totalImagesPullingTime="20.915657444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:10.296236896 +0000 UTC m=+25.580102292" watchObservedRunningTime="2026-07-22 04:25:10.296653664 +0000 UTC m=+25.580519060"
Jul 22 04:25:11.165977 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:11.165752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:11.166428 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:11.166085    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:12.166074 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:12.166036    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:12.166687 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:12.166039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:12.166687 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:12.166151    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:12.166687 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:12.166240    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:12.284573 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:12.284483    2564 generic.go:356] "Generic (PLEG): container finished" podID="dad8fcac-e29e-4878-a3d9-9f787bf3551e" containerID="55a6863381d9feb02da6df8a55bcd7f35c155dcfd4ba3034652982d0ac899ca8" exitCode=0
Jul 22 04:25:12.284573 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:12.284564    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" event={"ID":"dad8fcac-e29e-4878-a3d9-9f787bf3551e","Type":"ContainerDied","Data":"55a6863381d9feb02da6df8a55bcd7f35c155dcfd4ba3034652982d0ac899ca8"}
Jul 22 04:25:12.287865 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:12.287566    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:25:12.287992 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:12.287968    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"114737d2345ff7f29e51705f179fbe28a86c5fede756e460936f5babda021397"}
Jul 22 04:25:13.165848 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:13.165815    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:13.166006 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:13.165918    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:14.166103 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.165997    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:14.166689 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:14.166102    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:14.166689 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.166155    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:14.166689 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:14.166245    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:14.294266 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.294230    2564 generic.go:356] "Generic (PLEG): container finished" podID="dad8fcac-e29e-4878-a3d9-9f787bf3551e" containerID="9f5f1b805e62a14f922d0a9a496cbc3f9cf227df5dd02f6f304911fa63c9d6d9" exitCode=0
Jul 22 04:25:14.294410 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.294320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" event={"ID":"dad8fcac-e29e-4878-a3d9-9f787bf3551e","Type":"ContainerDied","Data":"9f5f1b805e62a14f922d0a9a496cbc3f9cf227df5dd02f6f304911fa63c9d6d9"}
Jul 22 04:25:14.297836 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.297808    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:25:14.298135 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.298115    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"b10d0d7a33ae69f303e19fc43b7f4b2fe38645c868a3757a5375b43c622081dd"}
Jul 22 04:25:14.298442 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.298421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:25:14.298576 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.298562    2564 scope.go:117] "RemoveContainer" containerID="25d20ee1f323941ad815ad408c6ccf6349599c00f40e245791134a43aefad78d"
Jul 22 04:25:14.314958 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:14.314934    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:25:15.167794 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:15.167762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:15.169209 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:15.169171    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:15.304361 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:15.304337    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:25:15.304779 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:15.304705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" event={"ID":"9a446c1d-dbbf-43c3-8878-140d992fa52c","Type":"ContainerStarted","Data":"e8c5434a678fa1d709ebd790f5e5de1e78288516ad65a8826084839be2172f67"}
Jul 22 04:25:15.305100 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:15.305076    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:25:15.305223 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:15.305155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:25:15.320143 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:15.320122    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:25:15.331869 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:15.331816    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4" podStartSLOduration=10.993358753999999 podStartE2EDuration="30.331802085s" totalImagesPullingTime="19.338443331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:15.331776886 +0000 UTC m=+30.615642281" watchObservedRunningTime="2026-07-22 04:25:15.331802085 +0000 UTC m=+30.615667474"
Jul 22 04:25:16.101882 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:16.101623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8g68t"]
Jul 22 04:25:16.102051 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:16.102035    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:16.102157 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:16.102137    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:16.104636 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:16.104597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hpkdj"]
Jul 22 04:25:16.104801 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:16.104710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:16.104865 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:16.104822    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:16.105263 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:16.105238    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xms64"]
Jul 22 04:25:16.105365 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:16.105347    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:16.105473 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:16.105436    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:16.309088 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:16.309007    2564 generic.go:356] "Generic (PLEG): container finished" podID="dad8fcac-e29e-4878-a3d9-9f787bf3551e" containerID="7206a742787a901ded6b2a5bbe441602c98167b88ce0ddc279c44ef524c6a413" exitCode=0
Jul 22 04:25:16.309500 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:16.309080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" event={"ID":"dad8fcac-e29e-4878-a3d9-9f787bf3551e","Type":"ContainerDied","Data":"7206a742787a901ded6b2a5bbe441602c98167b88ce0ddc279c44ef524c6a413"}
Jul 22 04:25:18.165847 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:18.165814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:18.166487 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.165985    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:18.166487 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:18.166418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:18.166598 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.166542    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:18.170221 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:18.170190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:18.170831 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.170789    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:18.779723 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:18.779685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:18.779925 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.779843    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:25:18.779925 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.779923    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret podName:7db9fc18-6ab0-4f65-8622-6e9f0c3c36de nodeName:}" failed. No retries permitted until 2026-07-22 04:25:50.779906834 +0000 UTC m=+66.063772207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret") pod "global-pull-secret-syncer-8g68t" (UID: "7db9fc18-6ab0-4f65-8622-6e9f0c3c36de") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:25:18.880234 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:18.880198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:18.880416 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.880382    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:25:18.880481 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.880469    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:25:50.880446726 +0000 UTC m=+66.164312121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:25:18.981568 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:18.981528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:18.981761 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.981707    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:25:18.981761 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.981750    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:25:18.981761 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.981764    2564 projected.go:196] Error preparing data for projected volume kube-api-access-r9qqj for pod openshift-network-diagnostics/network-check-target-hpkdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:25:18.981930 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:18.981827    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj podName:97109624-40a0-4b8f-9a1a-1a3b00e5c0d2 nodeName:}" failed. No retries permitted until 2026-07-22 04:25:50.981808988 +0000 UTC m=+66.265674380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9qqj" (UniqueName: "kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj") pod "network-check-target-hpkdj" (UID: "97109624-40a0-4b8f-9a1a-1a3b00e5c0d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:25:20.165773 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.165719    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:20.165773 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.165772    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:20.166405 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:20.165876    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpkdj" podUID="97109624-40a0-4b8f-9a1a-1a3b00e5c0d2"
Jul 22 04:25:20.166405 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.165947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:20.166405 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:20.166052    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:25:20.166405 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:20.166150    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g68t" podUID="7db9fc18-6ab0-4f65-8622-6e9f0c3c36de"
Jul 22 04:25:20.543175 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.543149    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-26.ec2.internal" event="NodeReady"
Jul 22 04:25:20.543333 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.543275    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 04:25:20.599326 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.599297    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xsd82"]
Jul 22 04:25:20.622365 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.622334    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mxv98"]
Jul 22 04:25:20.622502 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.622480    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.625566 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.625544    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjpdb\""
Jul 22 04:25:20.625700 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.625674    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 04:25:20.625783 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.625700    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 04:25:20.646337 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.646309    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mxv98"]
Jul 22 04:25:20.646337 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.646339    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xsd82"]
Jul 22 04:25:20.646497 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.646427    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mxv98"
Jul 22 04:25:20.648599 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.648579    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 04:25:20.648686 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.648670    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rp4tt\""
Jul 22 04:25:20.648760 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.648691    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 04:25:20.648965 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.648950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 04:25:20.795687 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.795653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3612a551-96e1-4faa-9366-5de9ab0f948b-config-volume\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.795888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.795714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c70a1040-b1ff-41cd-a105-ae23df85535a-cert\") pod \"ingress-canary-mxv98\" (UID: \"c70a1040-b1ff-41cd-a105-ae23df85535a\") " pod="openshift-ingress-canary/ingress-canary-mxv98"
Jul 22 04:25:20.795888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.795776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhg8t\" (UniqueName: \"kubernetes.io/projected/c70a1040-b1ff-41cd-a105-ae23df85535a-kube-api-access-lhg8t\") pod \"ingress-canary-mxv98\" (UID: \"c70a1040-b1ff-41cd-a105-ae23df85535a\") " pod="openshift-ingress-canary/ingress-canary-mxv98"
Jul 22 04:25:20.795888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.795839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nck6b\" (UniqueName: \"kubernetes.io/projected/3612a551-96e1-4faa-9366-5de9ab0f948b-kube-api-access-nck6b\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.795888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.795879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.796024 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.795898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3612a551-96e1-4faa-9366-5de9ab0f948b-tmp-dir\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.896962 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.896930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c70a1040-b1ff-41cd-a105-ae23df85535a-cert\") pod \"ingress-canary-mxv98\" (UID: \"c70a1040-b1ff-41cd-a105-ae23df85535a\") " pod="openshift-ingress-canary/ingress-canary-mxv98"
Jul 22 04:25:20.896962 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.896963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhg8t\" (UniqueName: \"kubernetes.io/projected/c70a1040-b1ff-41cd-a105-ae23df85535a-kube-api-access-lhg8t\") pod \"ingress-canary-mxv98\" (UID: \"c70a1040-b1ff-41cd-a105-ae23df85535a\") " pod="openshift-ingress-canary/ingress-canary-mxv98"
Jul 22 04:25:20.897171 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.896998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nck6b\" (UniqueName: \"kubernetes.io/projected/3612a551-96e1-4faa-9366-5de9ab0f948b-kube-api-access-nck6b\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.897171 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.897034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.897171 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:20.897116    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:20.897171 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:20.897172    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:25:21.397154011 +0000 UTC m=+36.681019383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:20.897355 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.897204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3612a551-96e1-4faa-9366-5de9ab0f948b-tmp-dir\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.897355 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.897254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3612a551-96e1-4faa-9366-5de9ab0f948b-config-volume\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.897553 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.897535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3612a551-96e1-4faa-9366-5de9ab0f948b-tmp-dir\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.897834 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.897815    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3612a551-96e1-4faa-9366-5de9ab0f948b-config-volume\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.901100 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.901082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c70a1040-b1ff-41cd-a105-ae23df85535a-cert\") pod \"ingress-canary-mxv98\" (UID: \"c70a1040-b1ff-41cd-a105-ae23df85535a\") " pod="openshift-ingress-canary/ingress-canary-mxv98"
Jul 22 04:25:20.906079 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.906060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhg8t\" (UniqueName: \"kubernetes.io/projected/c70a1040-b1ff-41cd-a105-ae23df85535a-kube-api-access-lhg8t\") pod \"ingress-canary-mxv98\" (UID: \"c70a1040-b1ff-41cd-a105-ae23df85535a\") " pod="openshift-ingress-canary/ingress-canary-mxv98"
Jul 22 04:25:20.909272 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.906837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nck6b\" (UniqueName: \"kubernetes.io/projected/3612a551-96e1-4faa-9366-5de9ab0f948b-kube-api-access-nck6b\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:20.954704 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:20.954669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mxv98"
Jul 22 04:25:21.158036 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:21.158009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mxv98"]
Jul 22 04:25:21.161487 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:25:21.161461    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70a1040_b1ff_41cd_a105_ae23df85535a.slice/crio-10a174755b82a71ac35f4612837a83cfbdc02d890e815bcc40abc22acd5574a3 WatchSource:0}: Error finding container 10a174755b82a71ac35f4612837a83cfbdc02d890e815bcc40abc22acd5574a3: Status 404 returned error can't find the container with id 10a174755b82a71ac35f4612837a83cfbdc02d890e815bcc40abc22acd5574a3
Jul 22 04:25:21.322774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:21.322671    2564 generic.go:356] "Generic (PLEG): container finished" podID="dad8fcac-e29e-4878-a3d9-9f787bf3551e" containerID="f2c17c3ecef7520a8fad96c80def976b1457dd56fcd95a84a0a1d21a1d82da7b" exitCode=0
Jul 22 04:25:21.323401 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:21.322766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" event={"ID":"dad8fcac-e29e-4878-a3d9-9f787bf3551e","Type":"ContainerDied","Data":"f2c17c3ecef7520a8fad96c80def976b1457dd56fcd95a84a0a1d21a1d82da7b"}
Jul 22 04:25:21.323950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:21.323931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mxv98" event={"ID":"c70a1040-b1ff-41cd-a105-ae23df85535a","Type":"ContainerStarted","Data":"10a174755b82a71ac35f4612837a83cfbdc02d890e815bcc40abc22acd5574a3"}
Jul 22 04:25:21.401118 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:21.401095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:21.401222 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:21.401210    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:21.401277 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:21.401267    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:25:22.401253254 +0000 UTC m=+37.685118644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:22.165589 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.165556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:22.165804 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.165672    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:22.165804 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.165760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:22.168317 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.168292    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 04:25:22.168453 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.168292    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 04:25:22.168453 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.168334    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 04:25:22.169286 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.169232    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h8l96\""
Jul 22 04:25:22.169286 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.169279    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s9hfn\""
Jul 22 04:25:22.169519 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.169322    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 04:25:22.330195 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.330159    2564 generic.go:356] "Generic (PLEG): container finished" podID="dad8fcac-e29e-4878-a3d9-9f787bf3551e" containerID="72be7fbeb4f979309fb711f6f6c88ea30e547a7a442f74f6f54b5b3c5cad9a42" exitCode=0
Jul 22 04:25:22.330626 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.330207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" event={"ID":"dad8fcac-e29e-4878-a3d9-9f787bf3551e","Type":"ContainerDied","Data":"72be7fbeb4f979309fb711f6f6c88ea30e547a7a442f74f6f54b5b3c5cad9a42"}
Jul 22 04:25:22.410860 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:22.410827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:22.411013 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:22.410982    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:22.411094 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:22.411053    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:25:24.411034028 +0000 UTC m=+39.694899407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:23.338568 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:23.338384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" event={"ID":"dad8fcac-e29e-4878-a3d9-9f787bf3551e","Type":"ContainerStarted","Data":"2a370263f5023df39ee865b0cfeee6f859cd54e76008efc662f8449c14fe4fad"}
Jul 22 04:25:23.363405 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:23.363359    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rv2fl" podStartSLOduration=9.093701125 podStartE2EDuration="38.363345956s" totalImagesPullingTime="29.269644831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:23.362470726 +0000 UTC m=+38.646336121" watchObservedRunningTime="2026-07-22 04:25:23.363345956 +0000 UTC m=+38.647211351"
Jul 22 04:25:24.341936 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:24.341884    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mxv98" event={"ID":"c70a1040-b1ff-41cd-a105-ae23df85535a","Type":"ContainerStarted","Data":"5f8fae12e2988034b11803db3ad3c1f606f4902d045de918d3ff28c5f3ff9143"}
Jul 22 04:25:24.359940 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:24.359891    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mxv98" podStartSLOduration=2.123322244 podStartE2EDuration="4.359876164s" totalImagesPullingTime="2.23655392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:24.358430117 +0000 UTC m=+39.642295512" watchObservedRunningTime="2026-07-22 04:25:24.359876164 +0000 UTC m=+39.643741559"
Jul 22 04:25:24.427690 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:24.427651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:24.427893 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:24.427838    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:24.427965 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:24.427918    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:25:28.427899017 +0000 UTC m=+43.711764407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:28.455300 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:28.455256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:28.455790 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:28.455376    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:28.455790 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:28.455428    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:25:36.455415412 +0000 UTC m=+51.739280785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:36.513560 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:36.513517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:36.514144 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:36.513647    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:36.514144 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:36.513721    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:25:52.513700144 +0000 UTC m=+67.797565532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:47.321609 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:47.321581    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2b5f4"
Jul 22 04:25:50.817366 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:50.817325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:50.820188 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:50.820169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 04:25:50.831716 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:50.831694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7db9fc18-6ab0-4f65-8622-6e9f0c3c36de-original-pull-secret\") pod \"global-pull-secret-syncer-8g68t\" (UID: \"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de\") " pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:50.917947 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:50.917910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:25:50.920350 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:50.920333    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 04:25:50.928245 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:50.928227    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 04:25:50.928310 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:50.928301    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:26:54.928283429 +0000 UTC m=+130.212148802 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : secret "metrics-daemon-secret" not found
Jul 22 04:25:50.985138 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:50.985111    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g68t"
Jul 22 04:25:51.018815 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.018790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:51.021773 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.021750    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 04:25:51.031659 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.031638    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 04:25:51.041942 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.041919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9qqj\" (UniqueName: \"kubernetes.io/projected/97109624-40a0-4b8f-9a1a-1a3b00e5c0d2-kube-api-access-r9qqj\") pod \"network-check-target-hpkdj\" (UID: \"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2\") " pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:51.126826 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.126796    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8g68t"]
Jul 22 04:25:51.130021 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:25:51.129995    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db9fc18_6ab0_4f65_8622_6e9f0c3c36de.slice/crio-aace80f6100a9e44cfb8890e6be0dac3d59d7c74e1881cb844ac242c9c716267 WatchSource:0}: Error finding container aace80f6100a9e44cfb8890e6be0dac3d59d7c74e1881cb844ac242c9c716267: Status 404 returned error can't find the container with id aace80f6100a9e44cfb8890e6be0dac3d59d7c74e1881cb844ac242c9c716267
Jul 22 04:25:51.280247 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.280217    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h8l96\""
Jul 22 04:25:51.288368 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.288345    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:51.402039 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.402008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8g68t" event={"ID":"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de","Type":"ContainerStarted","Data":"aace80f6100a9e44cfb8890e6be0dac3d59d7c74e1881cb844ac242c9c716267"}
Jul 22 04:25:51.426079 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:51.426047    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hpkdj"]
Jul 22 04:25:52.406766 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:52.406699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hpkdj" event={"ID":"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2","Type":"ContainerStarted","Data":"df24b076dab463db92da19637a3fec3e954505229371a610250319fdf6945b97"}
Jul 22 04:25:52.532184 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:52.532141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:25:52.532369 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:52.532339    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:25:52.532442 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:25:52.532428    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:26:24.53240489 +0000 UTC m=+99.816270287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:25:56.417188 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:56.417147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8g68t" event={"ID":"7db9fc18-6ab0-4f65-8622-6e9f0c3c36de","Type":"ContainerStarted","Data":"4b2bbbc1cffe2d582cdf3b12091af5641c7bed68d35300d20f52b246d652dcaa"}
Jul 22 04:25:56.418507 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:56.418481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hpkdj" event={"ID":"97109624-40a0-4b8f-9a1a-1a3b00e5c0d2","Type":"ContainerStarted","Data":"73191a1d4908fcbef980cb46c0cdea2988c100409276ae0ad7d3dced85d8c9d1"}
Jul 22 04:25:56.418630 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:56.418614    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:25:56.447265 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:56.447215    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hpkdj" podStartSLOduration=67.07141143 podStartE2EDuration="1m11.447200934s" totalImagesPullingTime="4.375789504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:56.447099618 +0000 UTC m=+71.730965016" watchObservedRunningTime="2026-07-22 04:25:56.447200934 +0000 UTC m=+71.731066329"
Jul 22 04:25:56.447600 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:25:56.447575    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8g68t" podStartSLOduration=66.765744286 podStartE2EDuration="1m11.447567053s" totalImagesPullingTime="4.681822767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:25:56.432240329 +0000 UTC m=+71.716105725" watchObservedRunningTime="2026-07-22 04:25:56.447567053 +0000 UTC m=+71.731432447"
Jul 22 04:26:18.432537 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.432338    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"]
Jul 22 04:26:18.436498 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.436479    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.439847 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.439820    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 04:26:18.440746 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.440714    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 04:26:18.441085 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.441070    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 04:26:18.441273 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.441258    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 04:26:18.454354 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.454308    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"]
Jul 22 04:26:18.457169 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.457149    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"]
Jul 22 04:26:18.457278 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.457263    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.460415 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.460387    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 04:26:18.460516 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.460446    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 04:26:18.460516 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.460473    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 04:26:18.460605 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.460529    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 04:26:18.474661 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.474629    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"]
Jul 22 04:26:18.516269 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c055133-591b-4102-b7ae-f1c982c3bb3f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.516269 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkqts\" (UniqueName: \"kubernetes.io/projected/c659d77a-3b3b-47ec-8af6-1e169e243c17-kube-api-access-nkqts\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.516473 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-hub\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.516473 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frl8n\" (UniqueName: \"kubernetes.io/projected/6c055133-591b-4102-b7ae-f1c982c3bb3f-kube-api-access-frl8n\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.516473 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.516473 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-ca\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.516473 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c659d77a-3b3b-47ec-8af6-1e169e243c17-additional-service-ca\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.516631 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c055133-591b-4102-b7ae-f1c982c3bb3f-tmp\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.516631 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.516509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.617265 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c055133-591b-4102-b7ae-f1c982c3bb3f-tmp\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.617265 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.617443 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c055133-591b-4102-b7ae-f1c982c3bb3f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.617443 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkqts\" (UniqueName: \"kubernetes.io/projected/c659d77a-3b3b-47ec-8af6-1e169e243c17-kube-api-access-nkqts\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.617555 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-hub\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.617555 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frl8n\" (UniqueName: \"kubernetes.io/projected/6c055133-591b-4102-b7ae-f1c982c3bb3f-kube-api-access-frl8n\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.617660 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.617660 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c055133-591b-4102-b7ae-f1c982c3bb3f-tmp\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.617660 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-ca\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.617848 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.617696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c659d77a-3b3b-47ec-8af6-1e169e243c17-additional-service-ca\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.618383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.618359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c659d77a-3b3b-47ec-8af6-1e169e243c17-additional-service-ca\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.620087 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.620062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.620383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.620365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-hub\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.620479 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.620461    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c055133-591b-4102-b7ae-f1c982c3bb3f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.620531 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.620483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-ca\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.620531 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.620518    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c659d77a-3b3b-47ec-8af6-1e169e243c17-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.625176 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.625153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkqts\" (UniqueName: \"kubernetes.io/projected/c659d77a-3b3b-47ec-8af6-1e169e243c17-kube-api-access-nkqts\") pod \"cluster-proxy-proxy-agent-997df7866-xggxx\" (UID: \"c659d77a-3b3b-47ec-8af6-1e169e243c17\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.625431 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.625410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frl8n\" (UniqueName: \"kubernetes.io/projected/6c055133-591b-4102-b7ae-f1c982c3bb3f-kube-api-access-frl8n\") pod \"klusterlet-addon-workmgr-6995f8c84-znbcr\" (UID: \"6c055133-591b-4102-b7ae-f1c982c3bb3f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.744921 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.744893    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:18.773034 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.772999    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:26:18.873221 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.873188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"]
Jul 22 04:26:18.877158 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:26:18.877128    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c055133_591b_4102_b7ae_f1c982c3bb3f.slice/crio-3e242c95305df778641958b0860cfdf80f351dc07825bbaf8eea97c375a166c2 WatchSource:0}: Error finding container 3e242c95305df778641958b0860cfdf80f351dc07825bbaf8eea97c375a166c2: Status 404 returned error can't find the container with id 3e242c95305df778641958b0860cfdf80f351dc07825bbaf8eea97c375a166c2
Jul 22 04:26:18.901347 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:18.901316    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"]
Jul 22 04:26:18.904187 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:26:18.904160    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc659d77a_3b3b_47ec_8af6_1e169e243c17.slice/crio-a13a94585f7166062759bf21c875461d3e64843db78ca153aff652020857da4e WatchSource:0}: Error finding container a13a94585f7166062759bf21c875461d3e64843db78ca153aff652020857da4e: Status 404 returned error can't find the container with id a13a94585f7166062759bf21c875461d3e64843db78ca153aff652020857da4e
Jul 22 04:26:19.472895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:19.472850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" event={"ID":"c659d77a-3b3b-47ec-8af6-1e169e243c17","Type":"ContainerStarted","Data":"a13a94585f7166062759bf21c875461d3e64843db78ca153aff652020857da4e"}
Jul 22 04:26:19.474308 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:19.474252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr" event={"ID":"6c055133-591b-4102-b7ae-f1c982c3bb3f","Type":"ContainerStarted","Data":"3e242c95305df778641958b0860cfdf80f351dc07825bbaf8eea97c375a166c2"}
Jul 22 04:26:24.497503 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.497464    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" event={"ID":"c659d77a-3b3b-47ec-8af6-1e169e243c17","Type":"ContainerStarted","Data":"20495be85fc8ebddc8e9d08c740b9dad47a6069d1b8d3ebee0559ebdd79bcf96"}
Jul 22 04:26:24.497987 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.497520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" event={"ID":"c659d77a-3b3b-47ec-8af6-1e169e243c17","Type":"ContainerStarted","Data":"9f08b3098852cad40cb392c1200e10c5fa98fe9a691ab6cf9de4be3cfe2e29f0"}
Jul 22 04:26:24.497987 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.497547    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" event={"ID":"c659d77a-3b3b-47ec-8af6-1e169e243c17","Type":"ContainerStarted","Data":"8d6f4c1497fefd0a5ece5c2ba0690f56ba3ab2e88ee9702b66bc37b7effd8d83"}
Jul 22 04:26:24.499046 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.499020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr" event={"ID":"6c055133-591b-4102-b7ae-f1c982c3bb3f","Type":"ContainerStarted","Data":"84c80c0c54edcf2c4617a09d4a6d0b0c8c1df426803912d459d917d9f9ec86c5"}
Jul 22 04:26:24.499180 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.499140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:24.500598 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.500581    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:26:24.516284 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.516244    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" podStartSLOduration=1.5987914669999999 podStartE2EDuration="6.516212977s" totalImagesPullingTime="4.91742151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:26:24.515614026 +0000 UTC m=+99.799479420" watchObservedRunningTime="2026-07-22 04:26:24.516212977 +0000 UTC m=+99.800078350"
Jul 22 04:26:24.530827 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.530778    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr" podStartSLOduration=1.58338369 podStartE2EDuration="6.530764911s" totalImagesPullingTime="4.947381221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:26:24.530264098 +0000 UTC m=+99.814129494" watchObservedRunningTime="2026-07-22 04:26:24.530764911 +0000 UTC m=+99.814630340"
Jul 22 04:26:24.562682 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:24.562648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:26:24.562856 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:26:24.562833    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:26:24.562921 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:26:24.562914    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:27:28.562897081 +0000 UTC m=+163.846762469 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:26:27.423370 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:27.423334    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hpkdj"
Jul 22 04:26:54.977343 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:26:54.977298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:26:54.977824 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:26:54.977426    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 04:26:54.977824 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:26:54.977499    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:28:56.977485574 +0000 UTC m=+252.261350947 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : secret "metrics-daemon-secret" not found
Jul 22 04:27:23.631982 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:27:23.631920    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xsd82" podUID="3612a551-96e1-4faa-9366-5de9ab0f948b"
Jul 22 04:27:23.672336 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:27:23.672310    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsd82"
Jul 22 04:27:25.190980 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:27:25.190927    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:27:28.603849 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:27:28.603805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:27:28.604323 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:27:28.603955    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:27:28.604323 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:27:28.604031    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls podName:3612a551-96e1-4faa-9366-5de9ab0f948b nodeName:}" failed. No retries permitted until 2026-07-22 04:29:30.604009555 +0000 UTC m=+285.887874947 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls") pod "dns-default-xsd82" (UID: "3612a551-96e1-4faa-9366-5de9ab0f948b") : secret "dns-default-metrics-tls" not found
Jul 22 04:27:39.166420 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:27:39.166338    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:28:24.500051 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:24.499993    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr" podUID="6c055133-591b-4102-b7ae-f1c982c3bb3f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jul 22 04:28:24.843322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:24.843237    2564 generic.go:356] "Generic (PLEG): container finished" podID="6c055133-591b-4102-b7ae-f1c982c3bb3f" containerID="84c80c0c54edcf2c4617a09d4a6d0b0c8c1df426803912d459d917d9f9ec86c5" exitCode=1
Jul 22 04:28:24.843322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:24.843280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr" event={"ID":"6c055133-591b-4102-b7ae-f1c982c3bb3f","Type":"ContainerDied","Data":"84c80c0c54edcf2c4617a09d4a6d0b0c8c1df426803912d459d917d9f9ec86c5"}
Jul 22 04:28:24.843617 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:24.843602    2564 scope.go:117] "RemoveContainer" containerID="84c80c0c54edcf2c4617a09d4a6d0b0c8c1df426803912d459d917d9f9ec86c5"
Jul 22 04:28:25.847654 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:25.847610    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr" event={"ID":"6c055133-591b-4102-b7ae-f1c982c3bb3f","Type":"ContainerStarted","Data":"0b9adcb063f2b3e2e7edf85c8b028f03c2d93783c79c6b7d195abb3d23add59e"}
Jul 22 04:28:25.848153 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:25.847943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:28:25.848565 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:25.848547    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6995f8c84-znbcr"
Jul 22 04:28:49.524990 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.524954    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jjxcv"]
Jul 22 04:28:49.527950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.527929    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.530374 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.530355    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 04:28:49.530476 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.530356    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 04:28:49.531201 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.531184    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 04:28:49.531201 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.531196    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qzd8f\""
Jul 22 04:28:49.531371 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.531188    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 04:28:49.541212 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.541188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jjxcv"]
Jul 22 04:28:49.660065 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.660023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.660065 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.660069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-data-volume\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.660347 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.660087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.660347 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.660103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4dvt\" (UniqueName: \"kubernetes.io/projected/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-api-access-g4dvt\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.660347 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.660146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-crio-socket\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.761478 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.761441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.761478 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.761483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-data-volume\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.761697 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.761504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.761697 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.761524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4dvt\" (UniqueName: \"kubernetes.io/projected/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-api-access-g4dvt\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.761697 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.761562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-crio-socket\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.761697 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:49.761609    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:49.761697 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:49.761619    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:49.761697 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.761671    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-crio-socket\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.761697 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:49.761692    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:50.26167094 +0000 UTC m=+245.545536316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:49.761976 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:49.761713    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:50.261703593 +0000 UTC m=+245.545568966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:49.761976 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.761815    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-data-volume\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:49.773918 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:49.773888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4dvt\" (UniqueName: \"kubernetes.io/projected/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-api-access-g4dvt\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:50.265464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:50.265421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:50.265464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:50.265468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:50.265685 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:50.265592    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:50.265685 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:50.265634    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:50.265685 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:50.265668    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:51.265652797 +0000 UTC m=+246.549518171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:50.265685 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:50.265684    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:51.26567385 +0000 UTC m=+246.549539223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:51.272287 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:51.272237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:51.272773 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:51.272309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:51.272773 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:51.272340    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:51.272773 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:51.272413    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:53.272395389 +0000 UTC m=+248.556260766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:51.272773 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:51.272506    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:51.272773 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:51.272558    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:53.272542521 +0000 UTC m=+248.556407896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:51.717485 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:51.717413    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cm2hm_ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6/dns-node-resolver/0.log"
Jul 22 04:28:52.521321 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:52.521293    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fwqq6_0d672265-00a0-46f3-a9a7-a5c0882ccc5c/node-ca/0.log"
Jul 22 04:28:53.286815 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:53.286756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:53.286815 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:53.286820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:53.287087 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:53.286838    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:53.287087 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:53.286900    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:53.287087 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:53.286926    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:57.28690581 +0000 UTC m=+252.570771182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:53.287087 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:53.286952    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:28:57.286940936 +0000 UTC m=+252.570806309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:53.319757 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:53.319712    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mxv98_c70a1040-b1ff-41cd-a105-ae23df85535a/serve-healthcheck-canary/0.log"
Jul 22 04:28:57.013979 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:57.013945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:28:57.014446 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:57.014096    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 04:28:57.014446 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:57.014172    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs podName:206eec8a-5ac8-477f-9797-cec90e3236da nodeName:}" failed. No retries permitted until 2026-07-22 04:30:59.014155232 +0000 UTC m=+374.298020606 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs") pod "network-metrics-daemon-xms64" (UID: "206eec8a-5ac8-477f-9797-cec90e3236da") : secret "metrics-daemon-secret" not found
Jul 22 04:28:57.317012 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:57.316914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:57.317012 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:28:57.316959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:28:57.317244 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:57.317022    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:28:57.317244 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:57.317047    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:28:57.317244 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:57.317071    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:29:05.317058752 +0000 UTC m=+260.600924125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : configmap "kube-rbac-proxy" not found
Jul 22 04:28:57.317244 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:28:57.317100    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls podName:8a0f3caf-5cc3-4b70-9530-5804c069fbc5 nodeName:}" failed. No retries permitted until 2026-07-22 04:29:05.317087611 +0000 UTC m=+260.600952983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjxcv" (UID: "8a0f3caf-5cc3-4b70-9530-5804c069fbc5") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:29:05.378858 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:05.378802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:29:05.378858 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:05.378870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:29:05.379367 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:05.379345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:29:05.381140 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:05.381118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a0f3caf-5cc3-4b70-9530-5804c069fbc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjxcv\" (UID: \"8a0f3caf-5cc3-4b70-9530-5804c069fbc5\") " pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:29:05.436213 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:05.436181    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jjxcv"
Jul 22 04:29:05.556837 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:05.556806    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jjxcv"]
Jul 22 04:29:05.560034 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:29:05.560006    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0f3caf_5cc3_4b70_9530_5804c069fbc5.slice/crio-8295afc44b863dd2f6f22856d950d1901795c969594935772c4aeae3cb4ee2f4 WatchSource:0}: Error finding container 8295afc44b863dd2f6f22856d950d1901795c969594935772c4aeae3cb4ee2f4: Status 404 returned error can't find the container with id 8295afc44b863dd2f6f22856d950d1901795c969594935772c4aeae3cb4ee2f4
Jul 22 04:29:05.966342 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:05.966302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjxcv" event={"ID":"8a0f3caf-5cc3-4b70-9530-5804c069fbc5","Type":"ContainerStarted","Data":"8295afc44b863dd2f6f22856d950d1901795c969594935772c4aeae3cb4ee2f4"}
Jul 22 04:29:10.989448 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:10.989402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjxcv" event={"ID":"8a0f3caf-5cc3-4b70-9530-5804c069fbc5","Type":"ContainerStarted","Data":"bfbd3f079842ef68909a3cde46c8b834eaf5c5f183c256152ab15a41b1070d3d"}
Jul 22 04:29:14.000823 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.000787    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjxcv" event={"ID":"8a0f3caf-5cc3-4b70-9530-5804c069fbc5","Type":"ContainerStarted","Data":"cb496c3ff7e75d01292c13ff888fc60849c6e367a01771161cd2ab9ef69ec5c2"}
Jul 22 04:29:14.661771 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.661717    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"]
Jul 22 04:29:14.664743 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.664699    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.667010 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.666983    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 04:29:14.667238 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.667222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 04:29:14.667526 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.667504    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xk8gb\""
Jul 22 04:29:14.668293 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.668273    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 04:29:14.673720 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.673699    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 04:29:14.676790 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.676767    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"]
Jul 22 04:29:14.745098 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.745063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63724cac-1e11-4194-845e-e1e0a3ef462d-image-registry-private-configuration\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.745098 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.745111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-bound-sa-token\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.745350 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.745139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvx8s\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-kube-api-access-nvx8s\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.745350 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.745202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63724cac-1e11-4194-845e-e1e0a3ef462d-installation-pull-secrets\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.745350 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.745228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63724cac-1e11-4194-845e-e1e0a3ef462d-ca-trust-extracted\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.745350 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.745280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-registry-tls\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.745350 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.745314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63724cac-1e11-4194-845e-e1e0a3ef462d-trusted-ca\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.745562 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.745376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63724cac-1e11-4194-845e-e1e0a3ef462d-registry-certificates\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.845980 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.845939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63724cac-1e11-4194-845e-e1e0a3ef462d-trusted-ca\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.846163 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.846046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63724cac-1e11-4194-845e-e1e0a3ef462d-registry-certificates\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.846163 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.846144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63724cac-1e11-4194-845e-e1e0a3ef462d-image-registry-private-configuration\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.846271 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.846180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-bound-sa-token\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.846271 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.846251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvx8s\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-kube-api-access-nvx8s\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.846379 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.846288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63724cac-1e11-4194-845e-e1e0a3ef462d-installation-pull-secrets\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.846379 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.846316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63724cac-1e11-4194-845e-e1e0a3ef462d-ca-trust-extracted\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.846468 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.846407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-registry-tls\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.846841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.846799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63724cac-1e11-4194-845e-e1e0a3ef462d-ca-trust-extracted\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.847035 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.847000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63724cac-1e11-4194-845e-e1e0a3ef462d-registry-certificates\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.847142 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.847005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63724cac-1e11-4194-845e-e1e0a3ef462d-trusted-ca\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.849424 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.849394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63724cac-1e11-4194-845e-e1e0a3ef462d-installation-pull-secrets\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.849424 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.849399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63724cac-1e11-4194-845e-e1e0a3ef462d-image-registry-private-configuration\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.849898 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.849875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-registry-tls\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.857597 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.857575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-bound-sa-token\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.857965 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.857941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvx8s\" (UniqueName: \"kubernetes.io/projected/63724cac-1e11-4194-845e-e1e0a3ef462d-kube-api-access-nvx8s\") pod \"image-registry-5f8b4c7d56-mjbkm\" (UID: \"63724cac-1e11-4194-845e-e1e0a3ef462d\") " pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:14.976598 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:14.976482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:15.126209 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:15.126176    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"]
Jul 22 04:29:15.129166 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:29:15.129137    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63724cac_1e11_4194_845e_e1e0a3ef462d.slice/crio-c1b7b54ad15ebf75f1846d08d715c22df44ec930d64ce9a5c5fb6145a743d0a1 WatchSource:0}: Error finding container c1b7b54ad15ebf75f1846d08d715c22df44ec930d64ce9a5c5fb6145a743d0a1: Status 404 returned error can't find the container with id c1b7b54ad15ebf75f1846d08d715c22df44ec930d64ce9a5c5fb6145a743d0a1
Jul 22 04:29:16.009947 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:16.009909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm" event={"ID":"63724cac-1e11-4194-845e-e1e0a3ef462d","Type":"ContainerStarted","Data":"6bd083bc080bfab7b0f95d2388f73bda70443347da10d562be7cb338e8828e35"}
Jul 22 04:29:16.010185 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:16.009967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm" event={"ID":"63724cac-1e11-4194-845e-e1e0a3ef462d","Type":"ContainerStarted","Data":"c1b7b54ad15ebf75f1846d08d715c22df44ec930d64ce9a5c5fb6145a743d0a1"}
Jul 22 04:29:16.010185 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:16.010036    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:18.018191 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:18.018155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjxcv" event={"ID":"8a0f3caf-5cc3-4b70-9530-5804c069fbc5","Type":"ContainerStarted","Data":"a2ff8a972553cf70ed3408ba3d5705b346cb704216e00ff2a25f02162d30249f"}
Jul 22 04:29:18.035470 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:18.035423    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jjxcv" podStartSLOduration=17.355253669 podStartE2EDuration="29.035408278s" totalImagesPullingTime="11.680154609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:28:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:18.034163874 +0000 UTC m=+273.318029282" watchObservedRunningTime="2026-07-22 04:29:18.035408278 +0000 UTC m=+273.319273673"
Jul 22 04:29:18.035636 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:18.035514    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm" podStartSLOduration=4.035507659 podStartE2EDuration="4.035507659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:16.029308331 +0000 UTC m=+271.313173727" watchObservedRunningTime="2026-07-22 04:29:18.035507659 +0000 UTC m=+273.319373053"
Jul 22 04:29:23.319519 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.319486    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sxhpj"]
Jul 22 04:29:23.324186 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.324164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.326481 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.326449    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 04:29:23.326592 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.326540    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-svvf9\""
Jul 22 04:29:23.326674 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.326643    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 04:29:23.327426 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.327406    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 04:29:23.327481 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.327404    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 04:29:23.327481 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.327447    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 04:29:23.327481 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.327475    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 04:29:23.401545 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-root\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.401545 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-sys\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.401771 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-textfile\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.401771 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.401771 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.401771 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401720    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-wtmp\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.401903 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c924fbb-5448-49f9-88f6-9a78279379a9-metrics-client-ca\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.401903 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.401903 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.401817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkxgh\" (UniqueName: \"kubernetes.io/projected/1c924fbb-5448-49f9-88f6-9a78279379a9-kube-api-access-dkxgh\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502713 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-wtmp\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c924fbb-5448-49f9-88f6-9a78279379a9-metrics-client-ca\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxgh\" (UniqueName: \"kubernetes.io/projected/1c924fbb-5448-49f9-88f6-9a78279379a9-kube-api-access-dkxgh\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-root\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-sys\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-textfile\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502849    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-wtmp\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502859    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.502895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.503339 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-root\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.503339 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.502979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c924fbb-5448-49f9-88f6-9a78279379a9-sys\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.503339 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:29:23.502986    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 04:29:23.503339 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:29:23.503060    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls podName:1c924fbb-5448-49f9-88f6-9a78279379a9 nodeName:}" failed. No retries permitted until 2026-07-22 04:29:24.003040415 +0000 UTC m=+279.286905793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls") pod "node-exporter-sxhpj" (UID: "1c924fbb-5448-49f9-88f6-9a78279379a9") : secret "node-exporter-tls" not found
Jul 22 04:29:23.503339 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.503224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-textfile\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.503545 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.503417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c924fbb-5448-49f9-88f6-9a78279379a9-metrics-client-ca\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.503545 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.503470    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.505024 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.505007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:23.512954 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:23.512935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkxgh\" (UniqueName: \"kubernetes.io/projected/1c924fbb-5448-49f9-88f6-9a78279379a9-kube-api-access-dkxgh\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:24.006164 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:24.006132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:24.006337 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:29:24.006249    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 04:29:24.006337 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:29:24.006299    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls podName:1c924fbb-5448-49f9-88f6-9a78279379a9 nodeName:}" failed. No retries permitted until 2026-07-22 04:29:25.006286945 +0000 UTC m=+280.290152318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls") pod "node-exporter-sxhpj" (UID: "1c924fbb-5448-49f9-88f6-9a78279379a9") : secret "node-exporter-tls" not found
Jul 22 04:29:25.012337 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:25.012281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:25.014449 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:25.014430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c924fbb-5448-49f9-88f6-9a78279379a9-node-exporter-tls\") pod \"node-exporter-sxhpj\" (UID: \"1c924fbb-5448-49f9-88f6-9a78279379a9\") " pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:25.132502 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:25.132472    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sxhpj"
Jul 22 04:29:25.143852 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:29:25.143825    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c924fbb_5448_49f9_88f6_9a78279379a9.slice/crio-baae04c849a87b89c09e87eb1585eb3a473c672f47d7392c022e40f09a070eb7 WatchSource:0}: Error finding container baae04c849a87b89c09e87eb1585eb3a473c672f47d7392c022e40f09a070eb7: Status 404 returned error can't find the container with id baae04c849a87b89c09e87eb1585eb3a473c672f47d7392c022e40f09a070eb7
Jul 22 04:29:26.047331 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:26.047289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxhpj" event={"ID":"1c924fbb-5448-49f9-88f6-9a78279379a9","Type":"ContainerStarted","Data":"baae04c849a87b89c09e87eb1585eb3a473c672f47d7392c022e40f09a070eb7"}
Jul 22 04:29:26.673786 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:29:26.673666    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xsd82" podUID="3612a551-96e1-4faa-9366-5de9ab0f948b"
Jul 22 04:29:27.051790 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:27.051757    2564 generic.go:356] "Generic (PLEG): container finished" podID="1c924fbb-5448-49f9-88f6-9a78279379a9" containerID="bb07b058d7b60108545e13c5983bb33c34c4b8a9b5b06444658183ba39897ec9" exitCode=0
Jul 22 04:29:27.052273 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:27.051840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsd82"
Jul 22 04:29:27.052273 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:27.051838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxhpj" event={"ID":"1c924fbb-5448-49f9-88f6-9a78279379a9","Type":"ContainerDied","Data":"bb07b058d7b60108545e13c5983bb33c34c4b8a9b5b06444658183ba39897ec9"}
Jul 22 04:29:28.057998 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:28.057961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxhpj" event={"ID":"1c924fbb-5448-49f9-88f6-9a78279379a9","Type":"ContainerStarted","Data":"ac29721fe993dcecfa54e91531341c4b2e975fa75d3c52d9a0293d5eab14b8e4"}
Jul 22 04:29:28.058446 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:28.058028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxhpj" event={"ID":"1c924fbb-5448-49f9-88f6-9a78279379a9","Type":"ContainerStarted","Data":"2a77343066312b459b35a2112ba6de9a57e2d3a6227ba3d81d1598c5304b9e7d"}
Jul 22 04:29:28.080297 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:28.080251    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sxhpj" podStartSLOduration=3.995104446 podStartE2EDuration="5.080234292s" totalImagesPullingTime="1.022714487s" totalInitContainerRuntime="62.415359ms" isStatefulPod=true podCreationTimestamp="2026-07-22 04:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:28.079809292 +0000 UTC m=+283.363674688" watchObservedRunningTime="2026-07-22 04:29:28.080234292 +0000 UTC m=+283.364099687"
Jul 22 04:29:29.449742 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.449698    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:29:29.453183 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.453166    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.455824 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.455802    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 04:29:29.455824 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.455803    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 04:29:29.455996 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.455926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 04:29:29.456293 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8z25j\""
Jul 22 04:29:29.456340 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456327    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 04:29:29.456415 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456399    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 04:29:29.456480 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456418    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 04:29:29.456602 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456586    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 04:29:29.456669 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456608    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 04:29:29.456722 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456707    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-205m6cb7gm958\""
Jul 22 04:29:29.456903 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 04:29:29.456965 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.456950    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 04:29:29.457181 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.457167    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 04:29:29.458337 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.458315    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 04:29:29.458441 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.458420    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 04:29:29.458497 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.458436    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 04:29:29.459767 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.459747    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 04:29:29.470136 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.470115    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:29:29.545860 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.545828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.545860 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.545863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.545881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.545897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.545944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m827\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-kube-api-access-7m827\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546218 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546218 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546218 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546218 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546218 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546218 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546218 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546433 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546433 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546433 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546433 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546433 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.546433 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.546347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.646846 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.646813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.646846 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.646850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647049 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.646877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647049 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.646954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647049 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.646994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647049 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647195 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647195 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647195 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647195 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647195 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647896 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m827\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-kube-api-access-7m827\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647896 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647520    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.647896 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.647751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.648709 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.648540    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.649290 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.649226    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.649414 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.649312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.650394 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.650371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.650919 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.650868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.651468 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.651240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.651468 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.651326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.652204 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.652178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.652443 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.652420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.654144 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.654117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.656197 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.656171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.656479 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.656451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.656956 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.656897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m827\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-kube-api-access-7m827\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.657516 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.657475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.658100 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.658075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.658223 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.658203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.658280 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.658241    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.659479 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.659459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.762740 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.762710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:29.898974 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:29.898941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:29:29.903873 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:29:29.903850    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff41d82f_ee09_407a_b6b4_b7deca4db9b5.slice/crio-85265fbdf59362d240b9a93d445a155a13a15c28d60f5baedabe50b1a664f3fe WatchSource:0}: Error finding container 85265fbdf59362d240b9a93d445a155a13a15c28d60f5baedabe50b1a664f3fe: Status 404 returned error can't find the container with id 85265fbdf59362d240b9a93d445a155a13a15c28d60f5baedabe50b1a664f3fe
Jul 22 04:29:30.065914 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:30.065821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerStarted","Data":"85265fbdf59362d240b9a93d445a155a13a15c28d60f5baedabe50b1a664f3fe"}
Jul 22 04:29:30.657577 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:30.657534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:29:30.660135 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:30.660105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3612a551-96e1-4faa-9366-5de9ab0f948b-metrics-tls\") pod \"dns-default-xsd82\" (UID: \"3612a551-96e1-4faa-9366-5de9ab0f948b\") " pod="openshift-dns/dns-default-xsd82"
Jul 22 04:29:30.955456 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:30.955428    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjpdb\""
Jul 22 04:29:30.963269 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:30.963249    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xsd82"
Jul 22 04:29:31.071263 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:31.071233    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerID="913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9" exitCode=0
Jul 22 04:29:31.071417 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:31.071312    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerDied","Data":"913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9"}
Jul 22 04:29:31.086606 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:31.086579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xsd82"]
Jul 22 04:29:31.089261 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:29:31.089239    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3612a551_96e1_4faa_9366_5de9ab0f948b.slice/crio-4dc43bc7ec79aa984657768add53cbf6f1ed931cec82dacf1fe915ce29ea4d3b WatchSource:0}: Error finding container 4dc43bc7ec79aa984657768add53cbf6f1ed931cec82dacf1fe915ce29ea4d3b: Status 404 returned error can't find the container with id 4dc43bc7ec79aa984657768add53cbf6f1ed931cec82dacf1fe915ce29ea4d3b
Jul 22 04:29:32.076248 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:32.076207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsd82" event={"ID":"3612a551-96e1-4faa-9366-5de9ab0f948b","Type":"ContainerStarted","Data":"4dc43bc7ec79aa984657768add53cbf6f1ed931cec82dacf1fe915ce29ea4d3b"}
Jul 22 04:29:33.081684 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:33.081646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsd82" event={"ID":"3612a551-96e1-4faa-9366-5de9ab0f948b","Type":"ContainerStarted","Data":"89513d55dfad3de352645ff9303d734505a5f3e6b55e4e1fec6ab7bd4601d722"}
Jul 22 04:29:33.082133 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:33.081717    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xsd82" event={"ID":"3612a551-96e1-4faa-9366-5de9ab0f948b","Type":"ContainerStarted","Data":"15d78fc22734fa99b2e01fe5388a812eb1b4ba1c67b142f316860b6058e6c787"}
Jul 22 04:29:33.082133 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:33.081772    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xsd82"
Jul 22 04:29:33.098177 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:33.098114    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xsd82" podStartSLOduration=251.48880684 podStartE2EDuration="4m13.098096791s" totalImagesPullingTime="1.609289951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:33.096674983 +0000 UTC m=+288.380540401" watchObservedRunningTime="2026-07-22 04:29:33.098096791 +0000 UTC m=+288.381962188"
Jul 22 04:29:34.981923 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:34.981699    2564 patch_prober.go:28] interesting pod/image-registry-5f8b4c7d56-mjbkm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 04:29:34.981923 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:34.981798    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm" podUID="63724cac-1e11-4194-845e-e1e0a3ef462d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 04:29:35.090925 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:35.090888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerStarted","Data":"cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055"}
Jul 22 04:29:35.091072 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:35.091010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerStarted","Data":"18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e"}
Jul 22 04:29:36.097713 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:36.097676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerStarted","Data":"836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b"}
Jul 22 04:29:36.098105 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:36.097768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerStarted","Data":"4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54"}
Jul 22 04:29:36.098105 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:36.097794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerStarted","Data":"baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52"}
Jul 22 04:29:36.098105 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:36.097823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerStarted","Data":"f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b"}
Jul 22 04:29:36.124163 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:36.124100    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.6285749059999999 podStartE2EDuration="7.124078505s" totalImagesPullingTime="5.47638985s" totalInitContainerRuntime="19.113749ms" isStatefulPod=false podCreationTimestamp="2026-07-22 04:29:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:29:36.121950052 +0000 UTC m=+291.405815446" watchObservedRunningTime="2026-07-22 04:29:36.124078505 +0000 UTC m=+291.407943906"
Jul 22 04:29:37.017157 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:37.017126    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f8b4c7d56-mjbkm"
Jul 22 04:29:39.763260 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:39.763225    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:29:42.167750 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:29:42.167689    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xms64" podUID="206eec8a-5ac8-477f-9797-cec90e3236da"
Jul 22 04:29:43.086969 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:43.086937    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xsd82"
Jul 22 04:29:45.022486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:45.022454    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:29:45.023728 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:45.023700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:29:45.030307 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:45.030287    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 04:29:54.165996 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:29:54.165964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:30:08.774932 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:08.774893    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" podUID="c659d77a-3b3b-47ec-8af6-1e169e243c17" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 04:30:18.775116 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:18.775075    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" podUID="c659d77a-3b3b-47ec-8af6-1e169e243c17" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 04:30:28.774350 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:28.774312    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" podUID="c659d77a-3b3b-47ec-8af6-1e169e243c17" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 04:30:28.774828 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:28.774389    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx"
Jul 22 04:30:28.774889 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:28.774859    2564 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"20495be85fc8ebddc8e9d08c740b9dad47a6069d1b8d3ebee0559ebdd79bcf96"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 22 04:30:28.774928 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:28.774908    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" podUID="c659d77a-3b3b-47ec-8af6-1e169e243c17" containerName="service-proxy" containerID="cri-o://20495be85fc8ebddc8e9d08c740b9dad47a6069d1b8d3ebee0559ebdd79bcf96" gracePeriod=30
Jul 22 04:30:29.269581 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:29.269545    2564 generic.go:356] "Generic (PLEG): container finished" podID="c659d77a-3b3b-47ec-8af6-1e169e243c17" containerID="20495be85fc8ebddc8e9d08c740b9dad47a6069d1b8d3ebee0559ebdd79bcf96" exitCode=2
Jul 22 04:30:29.269581 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:29.269585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" event={"ID":"c659d77a-3b3b-47ec-8af6-1e169e243c17","Type":"ContainerDied","Data":"20495be85fc8ebddc8e9d08c740b9dad47a6069d1b8d3ebee0559ebdd79bcf96"}
Jul 22 04:30:29.269812 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:29.269617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-997df7866-xggxx" event={"ID":"c659d77a-3b3b-47ec-8af6-1e169e243c17","Type":"ContainerStarted","Data":"29df2afeebb23e78d65bef5d5ee130faaa68c0cc55742d91aec751f72456e3f3"}
Jul 22 04:30:29.763144 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:29.763102    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:29.781392 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:29.781369    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:30.288062 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:30.288034    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:47.811819 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:47.811725    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:30:47.812306 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:47.812043    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="prometheus" containerID="cri-o://18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e" gracePeriod=600
Jul 22 04:30:47.812306 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:47.812073    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy" containerID="cri-o://4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54" gracePeriod=600
Jul 22 04:30:47.812306 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:47.812100    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="thanos-sidecar" containerID="cri-o://f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b" gracePeriod=600
Jul 22 04:30:47.812306 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:47.812134    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy-web" containerID="cri-o://baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52" gracePeriod=600
Jul 22 04:30:47.812306 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:47.812141    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b" gracePeriod=600
Jul 22 04:30:47.812306 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:47.812100    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="config-reloader" containerID="cri-o://cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055" gracePeriod=600
Jul 22 04:30:48.334906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.334875    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerID="836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b" exitCode=0
Jul 22 04:30:48.334906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.334899    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerID="4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54" exitCode=0
Jul 22 04:30:48.334906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.334906    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerID="f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b" exitCode=0
Jul 22 04:30:48.334906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.334911    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerID="cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055" exitCode=0
Jul 22 04:30:48.335159 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.334918    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerID="18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e" exitCode=0
Jul 22 04:30:48.335159 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.334957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerDied","Data":"836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b"}
Jul 22 04:30:48.335159 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.335022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerDied","Data":"4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54"}
Jul 22 04:30:48.335159 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.335047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerDied","Data":"f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b"}
Jul 22 04:30:48.335159 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.335071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerDied","Data":"cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055"}
Jul 22 04:30:48.335159 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:48.335094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerDied","Data":"18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e"}
Jul 22 04:30:49.054315 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.054293    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.085515 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085477    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-tls\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.085515 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085522    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-trusted-ca-bundle\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.085727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085545    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-serving-certs-ca-bundle\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.085727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085594    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.085727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085630    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-0\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.085727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085655    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-tls-assets\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.085727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085683    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-grpc-tls\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.085727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085723    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-2\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085772    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-1\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085799    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-metrics-client-ca\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-thanos-prometheus-http-client-file\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085852    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config-out\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085876    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-web-config\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085903    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-kube-rbac-proxy\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085948    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m827\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-kube-api-access-7m827\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.085988    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.086019    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-db\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086055 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.086042    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-metrics-client-certs\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086769 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.086065    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-kubelet-serving-ca-bundle\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086769 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.086102    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\" (UID: \"ff41d82f-ee09-407a-b6b4-b7deca4db9b5\") "
Jul 22 04:30:49.086769 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.086213    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:49.086769 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.086440    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.087351    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.087783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.089330    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.090299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.090709    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.091128    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.091187    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.091712    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.092765 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.092424    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:30:49.093266 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.093249    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-kube-api-access-7m827" (OuterVolumeSpecName: "kube-api-access-7m827") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "kube-api-access-7m827". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:30:49.093544 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.093417    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.093544 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.093517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.094320 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.093681    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.094320 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.093794    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.094320 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.093854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.095026 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.095002    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config" (OuterVolumeSpecName: "config") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.095161 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.095125    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.095814 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.095571    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config-out" (OuterVolumeSpecName: "config-out") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:30:49.103713 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.103693    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-web-config" (OuterVolumeSpecName: "web-config") pod "ff41d82f-ee09-407a-b6b4-b7deca4db9b5" (UID: "ff41d82f-ee09-407a-b6b4-b7deca4db9b5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:30:49.187333 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187304    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m827\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-kube-api-access-7m827\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187333 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187331    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187340    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-db\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187349    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-metrics-client-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187359    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187370    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187378    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187388    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187396    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187405    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187413    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187421    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-tls-assets\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187429    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-grpc-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187437    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187444    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-configmap-metrics-client-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187452    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187461    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-config-out\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187468    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-web-config\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.187472 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.187476    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff41d82f-ee09-407a-b6b4-b7deca4db9b5-secret-kube-rbac-proxy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:30:49.342121 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.342089    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerID="baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52" exitCode=0
Jul 22 04:30:49.342304 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.342130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerDied","Data":"baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52"}
Jul 22 04:30:49.342304 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.342179    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.342304 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.342189    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff41d82f-ee09-407a-b6b4-b7deca4db9b5","Type":"ContainerDied","Data":"85265fbdf59362d240b9a93d445a155a13a15c28d60f5baedabe50b1a664f3fe"}
Jul 22 04:30:49.342304 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.342238    2564 scope.go:117] "RemoveContainer" containerID="836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b"
Jul 22 04:30:49.350666 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.350648    2564 scope.go:117] "RemoveContainer" containerID="4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54"
Jul 22 04:30:49.357004 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.356987    2564 scope.go:117] "RemoveContainer" containerID="baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52"
Jul 22 04:30:49.363124 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.363106    2564 scope.go:117] "RemoveContainer" containerID="f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b"
Jul 22 04:30:49.369134 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.369094    2564 scope.go:117] "RemoveContainer" containerID="cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055"
Jul 22 04:30:49.372486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.372464    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:30:49.375825 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.375802    2564 scope.go:117] "RemoveContainer" containerID="18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e"
Jul 22 04:30:49.382492 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.382478    2564 scope.go:117] "RemoveContainer" containerID="913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9"
Jul 22 04:30:49.387449 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.387419    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:30:49.389579 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.389560    2564 scope.go:117] "RemoveContainer" containerID="836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b"
Jul 22 04:30:49.389868 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:30:49.389842    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b\": container with ID starting with 836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b not found: ID does not exist" containerID="836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b"
Jul 22 04:30:49.389933 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.389877    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b"} err="failed to get container status \"836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b\": rpc error: code = NotFound desc = could not find container \"836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b\": container with ID starting with 836a4eef928aa4beb8f3fdf7e901e940fa69c07fcdd9db5aa322971a1231c46b not found: ID does not exist"
Jul 22 04:30:49.389933 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.389896    2564 scope.go:117] "RemoveContainer" containerID="4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54"
Jul 22 04:30:49.390168 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:30:49.390148    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54\": container with ID starting with 4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54 not found: ID does not exist" containerID="4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54"
Jul 22 04:30:49.390234 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.390179    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54"} err="failed to get container status \"4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54\": rpc error: code = NotFound desc = could not find container \"4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54\": container with ID starting with 4901b7a422e5e13584ba58726ab705ca063f4602d8a4c435f4f710e03a3f5c54 not found: ID does not exist"
Jul 22 04:30:49.390234 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.390203    2564 scope.go:117] "RemoveContainer" containerID="baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52"
Jul 22 04:30:49.390426 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:30:49.390403    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52\": container with ID starting with baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52 not found: ID does not exist" containerID="baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52"
Jul 22 04:30:49.390463 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.390430    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52"} err="failed to get container status \"baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52\": rpc error: code = NotFound desc = could not find container \"baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52\": container with ID starting with baa273b4a892ece01bfd438fe9093b8a9c34d86902463f18c796177a0ce75c52 not found: ID does not exist"
Jul 22 04:30:49.390463 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.390443    2564 scope.go:117] "RemoveContainer" containerID="f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b"
Jul 22 04:30:49.390669 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:30:49.390651    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b\": container with ID starting with f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b not found: ID does not exist" containerID="f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b"
Jul 22 04:30:49.390707 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.390673    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b"} err="failed to get container status \"f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b\": rpc error: code = NotFound desc = could not find container \"f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b\": container with ID starting with f9e5cb1afa16a78e2cb5b9de4ddcb0736b20c4336f2e34eae7689e067af5ae7b not found: ID does not exist"
Jul 22 04:30:49.390707 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.390687    2564 scope.go:117] "RemoveContainer" containerID="cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055"
Jul 22 04:30:49.390896 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:30:49.390876    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055\": container with ID starting with cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055 not found: ID does not exist" containerID="cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055"
Jul 22 04:30:49.390950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.390900    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055"} err="failed to get container status \"cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055\": rpc error: code = NotFound desc = could not find container \"cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055\": container with ID starting with cf94a44bc2bf4546ea9ed3a8ff5af22d5c9df033aad235c818b2a0bf4cb52055 not found: ID does not exist"
Jul 22 04:30:49.390950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.390915    2564 scope.go:117] "RemoveContainer" containerID="18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e"
Jul 22 04:30:49.391167 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:30:49.391151    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e\": container with ID starting with 18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e not found: ID does not exist" containerID="18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e"
Jul 22 04:30:49.391216 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.391170    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e"} err="failed to get container status \"18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e\": rpc error: code = NotFound desc = could not find container \"18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e\": container with ID starting with 18449b562ed5d35ad795a6cd1687ad9ed2893ac2a56c6e1e3865eb94d50ba38e not found: ID does not exist"
Jul 22 04:30:49.391216 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.391184    2564 scope.go:117] "RemoveContainer" containerID="913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9"
Jul 22 04:30:49.391400 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:30:49.391384    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9\": container with ID starting with 913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9 not found: ID does not exist" containerID="913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9"
Jul 22 04:30:49.391439 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.391403    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9"} err="failed to get container status \"913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9\": rpc error: code = NotFound desc = could not find container \"913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9\": container with ID starting with 913fa55dd09fe8f70e19b8452740ebacf4b8a8fb8b575102b753207024eba2c9 not found: ID does not exist"
Jul 22 04:30:49.445552 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445463    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:30:49.445695 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445682    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="prometheus"
Jul 22 04:30:49.445695 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445696    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="prometheus"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445704    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy-web"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445710    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy-web"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445723    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="config-reloader"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445728    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="config-reloader"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445749    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445754    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445762    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="init-config-reloader"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445767    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="init-config-reloader"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445777    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="thanos-sidecar"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445783    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="thanos-sidecar"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445788    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy-thanos"
Jul 22 04:30:49.445807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445793    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy-thanos"
Jul 22 04:30:49.446182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445842    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy-thanos"
Jul 22 04:30:49.446182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445850    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="config-reloader"
Jul 22 04:30:49.446182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445857    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy"
Jul 22 04:30:49.446182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445862    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="prometheus"
Jul 22 04:30:49.446182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445868    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="thanos-sidecar"
Jul 22 04:30:49.446182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.445873    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" containerName="kube-rbac-proxy-web"
Jul 22 04:30:49.450920 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.450904    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.453722 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.453700    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 04:30:49.453874 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.453700    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 04:30:49.453874 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.453801    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 04:30:49.454110 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.454092    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 04:30:49.454536 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.454314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 04:30:49.454536 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.454327    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8z25j\""
Jul 22 04:30:49.454536 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.454368    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 04:30:49.454707 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.454621    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 04:30:49.454707 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.454693    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 04:30:49.454798 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.454703    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 04:30:49.455036 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.455008    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-205m6cb7gm958\""
Jul 22 04:30:49.455036 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.455015    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 04:30:49.455193 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.455088    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 04:30:49.455193 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.455102    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 04:30:49.456214 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.456175    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 04:30:49.458469 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.458227    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 04:30:49.459544 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.459521    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 04:30:49.468808 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.468786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:30:49.489690 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489812 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489812 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489812 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489812 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-web-config\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489940 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489940 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489940 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-config\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489940 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.489940 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32924019-c9f6-4d23-87b3-701d435ea62f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490077 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490077 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490077 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.489991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xspx9\" (UniqueName: \"kubernetes.io/projected/32924019-c9f6-4d23-87b3-701d435ea62f-kube-api-access-xspx9\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490077 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.490039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490077 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.490060    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490222 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.490086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490222 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.490118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490222 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.490139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490222 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.490154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.490222 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.490181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32924019-c9f6-4d23-87b3-701d435ea62f-config-out\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.590499 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-config\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.590683 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.590683 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590531    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32924019-c9f6-4d23-87b3-701d435ea62f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.590683 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.590683 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.590683 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xspx9\" (UniqueName: \"kubernetes.io/projected/32924019-c9f6-4d23-87b3-701d435ea62f-kube-api-access-xspx9\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.590683 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591027 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591027 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591027 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591027 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591027 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.590962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591027 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32924019-c9f6-4d23-87b3-701d435ea62f-config-out\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-web-config\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591201    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.591319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.593577 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.593577 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.593577 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.591884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.593577 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.592045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.593577 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.592872    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.593950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.593781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-config\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.593950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.593827    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.593950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.593925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32924019-c9f6-4d23-87b3-701d435ea62f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.594665 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.594227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.594665 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.594363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.594665 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.594558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32924019-c9f6-4d23-87b3-701d435ea62f-config-out\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.594665 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.594634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.594954 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.594923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.595782 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.595762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-web-config\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.596180 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.596164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.596229 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.596183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.596229 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.596223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.596354 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.596338    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32924019-c9f6-4d23-87b3-701d435ea62f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.596556 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.596541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32924019-c9f6-4d23-87b3-701d435ea62f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.599272 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.599256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xspx9\" (UniqueName: \"kubernetes.io/projected/32924019-c9f6-4d23-87b3-701d435ea62f-kube-api-access-xspx9\") pod \"prometheus-k8s-0\" (UID: \"32924019-c9f6-4d23-87b3-701d435ea62f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.761328 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.761296    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:49.896234 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:49.896198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:30:49.899744 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:30:49.899708    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32924019_c9f6_4d23_87b3_701d435ea62f.slice/crio-ae8e6742ec40b3f19d303b83ff94de2d2679f9ab20a007c01bd382437d2d46b2 WatchSource:0}: Error finding container ae8e6742ec40b3f19d303b83ff94de2d2679f9ab20a007c01bd382437d2d46b2: Status 404 returned error can't find the container with id ae8e6742ec40b3f19d303b83ff94de2d2679f9ab20a007c01bd382437d2d46b2
Jul 22 04:30:50.347415 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:50.347366    2564 generic.go:356] "Generic (PLEG): container finished" podID="32924019-c9f6-4d23-87b3-701d435ea62f" containerID="b7709d7750d3c9895f7c73d52901e89bd81d2e927f5ad759dd9d1c90efa2d91c" exitCode=0
Jul 22 04:30:50.348096 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:50.348057    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32924019-c9f6-4d23-87b3-701d435ea62f","Type":"ContainerDied","Data":"b7709d7750d3c9895f7c73d52901e89bd81d2e927f5ad759dd9d1c90efa2d91c"}
Jul 22 04:30:50.348342 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:50.348325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32924019-c9f6-4d23-87b3-701d435ea62f","Type":"ContainerStarted","Data":"ae8e6742ec40b3f19d303b83ff94de2d2679f9ab20a007c01bd382437d2d46b2"}
Jul 22 04:30:51.170594 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:51.170553    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff41d82f-ee09-407a-b6b4-b7deca4db9b5" path="/var/lib/kubelet/pods/ff41d82f-ee09-407a-b6b4-b7deca4db9b5/volumes"
Jul 22 04:30:51.359591 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:51.359554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32924019-c9f6-4d23-87b3-701d435ea62f","Type":"ContainerStarted","Data":"e54553f1b428a713192ec1a309371adef9892b3ed7ff1dd70e4aaf99e634a1b2"}
Jul 22 04:30:51.360026 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:51.359619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32924019-c9f6-4d23-87b3-701d435ea62f","Type":"ContainerStarted","Data":"8de17492e5ea6866c7fab833a7f021c80068c0e536ff14008317a59a63586fe8"}
Jul 22 04:30:51.360026 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:51.359645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32924019-c9f6-4d23-87b3-701d435ea62f","Type":"ContainerStarted","Data":"d74a5c47574274b2608b1d1aecc76771f19e3d5844cef519951d06d2b9beff95"}
Jul 22 04:30:51.360026 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:51.359668    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32924019-c9f6-4d23-87b3-701d435ea62f","Type":"ContainerStarted","Data":"1e78fa0851a290eb854cc577e3c391eafffa4e45aa46984c77adf54b418bd98b"}
Jul 22 04:30:51.360026 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:51.359690    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32924019-c9f6-4d23-87b3-701d435ea62f","Type":"ContainerStarted","Data":"9a8e0ad6be80f75b5b0d7c28dce9da374da5c2d68de4230d9e2405f9e78af978"}
Jul 22 04:30:51.360026 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:51.359719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32924019-c9f6-4d23-87b3-701d435ea62f","Type":"ContainerStarted","Data":"21435fa0d2adba0e2d87402086cb61c08002fdbbeab999e30cec7ee33efe631a"}
Jul 22 04:30:51.388932 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:51.388875    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.36990837 podStartE2EDuration="2.388857054s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.948684ms" isStatefulPod=false podCreationTimestamp="2026-07-22 04:30:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:30:51.387772763 +0000 UTC m=+366.671638159" watchObservedRunningTime="2026-07-22 04:30:51.388857054 +0000 UTC m=+366.672722449"
Jul 22 04:30:54.762266 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:54.762215    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:30:59.072796 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:59.072728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:30:59.075028 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:59.075007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206eec8a-5ac8-477f-9797-cec90e3236da-metrics-certs\") pod \"network-metrics-daemon-xms64\" (UID: \"206eec8a-5ac8-477f-9797-cec90e3236da\") " pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:30:59.268999 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:59.268965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s9hfn\""
Jul 22 04:30:59.277028 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:59.277003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xms64"
Jul 22 04:30:59.403906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:59.403874    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xms64"]
Jul 22 04:30:59.407412 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:30:59.407385    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206eec8a_5ac8_477f_9797_cec90e3236da.slice/crio-e31e1d09efd0316d8c29a33d022ce099b24ce653c30a9262522a89c1a512ecfb WatchSource:0}: Error finding container e31e1d09efd0316d8c29a33d022ce099b24ce653c30a9262522a89c1a512ecfb: Status 404 returned error can't find the container with id e31e1d09efd0316d8c29a33d022ce099b24ce653c30a9262522a89c1a512ecfb
Jul 22 04:30:59.409209 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:30:59.409195    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:31:00.391460 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:31:00.391431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xms64" event={"ID":"206eec8a-5ac8-477f-9797-cec90e3236da","Type":"ContainerStarted","Data":"e31e1d09efd0316d8c29a33d022ce099b24ce653c30a9262522a89c1a512ecfb"}
Jul 22 04:31:01.396958 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:31:01.396923    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xms64" event={"ID":"206eec8a-5ac8-477f-9797-cec90e3236da","Type":"ContainerStarted","Data":"76843177ae631f7ec535dc445033e42286dac1b3e71e57c80b7c85302c182e7f"}
Jul 22 04:31:01.397337 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:31:01.396978    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xms64" event={"ID":"206eec8a-5ac8-477f-9797-cec90e3236da","Type":"ContainerStarted","Data":"e14756992b58a7f523e30ca94bce24efeaca78a6bc41f80076af3f733d48984d"}
Jul 22 04:31:01.427194 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:31:01.427144    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xms64" podStartSLOduration=375.462131735 podStartE2EDuration="6m16.427127915s" totalImagesPullingTime="964.99618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:31:01.426906004 +0000 UTC m=+376.710771398" watchObservedRunningTime="2026-07-22 04:31:01.427127915 +0000 UTC m=+376.710993310"
Jul 22 04:31:49.761920 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:31:49.761884    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:31:49.776954 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:31:49.776927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:31:50.580513 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:31:50.580479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:04.865868 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.865832    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"]
Jul 22 04:34:04.868976 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.868960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:04.871863 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.871842    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 04:34:04.871997 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.871842    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 04:34:04.871997 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.871948    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vs5b6\""
Jul 22 04:34:04.871997 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.871965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 04:34:04.872307 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.872293    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 04:34:04.887451 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.887430    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"]
Jul 22 04:34:04.994172 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.994143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99bff39b-20e1-468d-95c4-320df8124174-manifests\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:04.994352 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.994191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99bff39b-20e1-468d-95c4-320df8124174-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:04.994352 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.994209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99bff39b-20e1-468d-95c4-320df8124174-webhook-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:04.994352 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.994288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5hbs\" (UniqueName: \"kubernetes.io/projected/99bff39b-20e1-468d-95c4-320df8124174-kube-api-access-p5hbs\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:04.994352 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:04.994335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99bff39b-20e1-468d-95c4-320df8124174-tmp\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.095410 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.095358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99bff39b-20e1-468d-95c4-320df8124174-manifests\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.095410 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.095426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99bff39b-20e1-468d-95c4-320df8124174-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.095632 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.095442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99bff39b-20e1-468d-95c4-320df8124174-webhook-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.095632 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.095465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5hbs\" (UniqueName: \"kubernetes.io/projected/99bff39b-20e1-468d-95c4-320df8124174-kube-api-access-p5hbs\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.095632 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.095488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99bff39b-20e1-468d-95c4-320df8124174-tmp\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.095890 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.095856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99bff39b-20e1-468d-95c4-320df8124174-manifests\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.097897 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.097872    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99bff39b-20e1-468d-95c4-320df8124174-tmp\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.098061 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.098047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99bff39b-20e1-468d-95c4-320df8124174-webhook-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.098201 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.098181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99bff39b-20e1-468d-95c4-320df8124174-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.113492 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.113464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5hbs\" (UniqueName: \"kubernetes.io/projected/99bff39b-20e1-468d-95c4-320df8124174-kube-api-access-p5hbs\") pod \"opendatahub-operator-controller-manager-5676cbf8df-8tx22\" (UID: \"99bff39b-20e1-468d-95c4-320df8124174\") " pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.179062 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.178992    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:05.310657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:05.310626    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"]
Jul 22 04:34:05.314054 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:34:05.314025    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99bff39b_20e1_468d_95c4_320df8124174.slice/crio-bf34044b8c6879cf0d1bba83ae1187fa61f1fe88ecb4a43791e7f1de488a1a45 WatchSource:0}: Error finding container bf34044b8c6879cf0d1bba83ae1187fa61f1fe88ecb4a43791e7f1de488a1a45: Status 404 returned error can't find the container with id bf34044b8c6879cf0d1bba83ae1187fa61f1fe88ecb4a43791e7f1de488a1a45
Jul 22 04:34:06.024338 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:06.024300    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22" event={"ID":"99bff39b-20e1-468d-95c4-320df8124174","Type":"ContainerStarted","Data":"bf34044b8c6879cf0d1bba83ae1187fa61f1fe88ecb4a43791e7f1de488a1a45"}
Jul 22 04:34:09.037874 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:09.037836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22" event={"ID":"99bff39b-20e1-468d-95c4-320df8124174","Type":"ContainerStarted","Data":"db70c4c2b7868b666aa26f3a9f03e32073d73125ea3a8698455c86c1e75875e2"}
Jul 22 04:34:10.042966 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:10.042933    2564 generic.go:356] "Generic (PLEG): container finished" podID="99bff39b-20e1-468d-95c4-320df8124174" containerID="db70c4c2b7868b666aa26f3a9f03e32073d73125ea3a8698455c86c1e75875e2" exitCode=0
Jul 22 04:34:10.043342 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:10.042985    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22" event={"ID":"99bff39b-20e1-468d-95c4-320df8124174","Type":"ContainerDied","Data":"db70c4c2b7868b666aa26f3a9f03e32073d73125ea3a8698455c86c1e75875e2"}
Jul 22 04:34:11.048841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:11.048800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22" event={"ID":"99bff39b-20e1-468d-95c4-320df8124174","Type":"ContainerStarted","Data":"565e8f6b722c7546c0fccc215cc8cfd2ffb1bdad72d99ec4c2365a1fa2bac760"}
Jul 22 04:34:11.049296 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:11.049021    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:11.070710 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:11.070658    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22" podStartSLOduration=2.446958468 podStartE2EDuration="7.070644193s" totalImagesPullingTime="3.539868316s" totalInitContainerRuntime="1.083817409s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:11.06851607 +0000 UTC m=+566.352381474" watchObservedRunningTime="2026-07-22 04:34:11.070644193 +0000 UTC m=+566.354509649"
Jul 22 04:34:22.054603 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:22.054572    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5676cbf8df-8tx22"
Jul 22 04:34:25.161504 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.161471    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"]
Jul 22 04:34:25.172774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.172718    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.175551 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.175525    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 04:34:25.175710 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.175610    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 04:34:25.175710 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.175533    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 04:34:25.175710 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.175705    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cp2gc\""
Jul 22 04:34:25.176407 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.176390    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 04:34:25.181312 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.181288    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"]
Jul 22 04:34:25.258610 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.258577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e25a94-8993-4151-8dde-cc9331f8e55f-tls-certs\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.258797 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.258651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32e25a94-8993-4151-8dde-cc9331f8e55f-tmp\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.258867 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.258790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb4p8\" (UniqueName: \"kubernetes.io/projected/32e25a94-8993-4151-8dde-cc9331f8e55f-kube-api-access-rb4p8\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.276712 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.276677    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4r2r"]
Jul 22 04:34:25.279907 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.279882    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:25.282362 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.282339    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 22 04:34:25.282493 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.282393    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2vw6w\""
Jul 22 04:34:25.290513 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.290490    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4r2r"]
Jul 22 04:34:25.360075 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.360034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32e25a94-8993-4151-8dde-cc9331f8e55f-tmp\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.360243 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.360092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwj2p\" (UniqueName: \"kubernetes.io/projected/dbdaeb51-ae4e-445c-8922-3405a5334afa-kube-api-access-dwj2p\") pod \"odh-model-controller-7998c67dc4-z4r2r\" (UID: \"dbdaeb51-ae4e-445c-8922-3405a5334afa\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:25.360243 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.360181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4p8\" (UniqueName: \"kubernetes.io/projected/32e25a94-8993-4151-8dde-cc9331f8e55f-kube-api-access-rb4p8\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.360243 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.360212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbdaeb51-ae4e-445c-8922-3405a5334afa-cert\") pod \"odh-model-controller-7998c67dc4-z4r2r\" (UID: \"dbdaeb51-ae4e-445c-8922-3405a5334afa\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:25.360389 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.360264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e25a94-8993-4151-8dde-cc9331f8e55f-tls-certs\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.360389 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:25.360378    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 22 04:34:25.360466 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:25.360453    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e25a94-8993-4151-8dde-cc9331f8e55f-tls-certs podName:32e25a94-8993-4151-8dde-cc9331f8e55f nodeName:}" failed. No retries permitted until 2026-07-22 04:34:25.860431878 +0000 UTC m=+581.144297258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/32e25a94-8993-4151-8dde-cc9331f8e55f-tls-certs") pod "kube-auth-proxy-86559b66b8-pdgwd" (UID: "32e25a94-8993-4151-8dde-cc9331f8e55f") : secret "kube-auth-proxy-tls" not found
Jul 22 04:34:25.362442 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.362408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32e25a94-8993-4151-8dde-cc9331f8e55f-tmp\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.370540 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.370499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb4p8\" (UniqueName: \"kubernetes.io/projected/32e25a94-8993-4151-8dde-cc9331f8e55f-kube-api-access-rb4p8\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.460958 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.460842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbdaeb51-ae4e-445c-8922-3405a5334afa-cert\") pod \"odh-model-controller-7998c67dc4-z4r2r\" (UID: \"dbdaeb51-ae4e-445c-8922-3405a5334afa\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:25.461129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.460985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwj2p\" (UniqueName: \"kubernetes.io/projected/dbdaeb51-ae4e-445c-8922-3405a5334afa-kube-api-access-dwj2p\") pod \"odh-model-controller-7998c67dc4-z4r2r\" (UID: \"dbdaeb51-ae4e-445c-8922-3405a5334afa\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:25.461129 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:25.461057    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 22 04:34:25.461252 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:25.461180    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdaeb51-ae4e-445c-8922-3405a5334afa-cert podName:dbdaeb51-ae4e-445c-8922-3405a5334afa nodeName:}" failed. No retries permitted until 2026-07-22 04:34:25.961158272 +0000 UTC m=+581.245023665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dbdaeb51-ae4e-445c-8922-3405a5334afa-cert") pod "odh-model-controller-7998c67dc4-z4r2r" (UID: "dbdaeb51-ae4e-445c-8922-3405a5334afa") : secret "odh-model-controller-webhook-cert" not found
Jul 22 04:34:25.480623 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.480592    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwj2p\" (UniqueName: \"kubernetes.io/projected/dbdaeb51-ae4e-445c-8922-3405a5334afa-kube-api-access-dwj2p\") pod \"odh-model-controller-7998c67dc4-z4r2r\" (UID: \"dbdaeb51-ae4e-445c-8922-3405a5334afa\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:25.864380 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.864346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e25a94-8993-4151-8dde-cc9331f8e55f-tls-certs\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.866963 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.866930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e25a94-8993-4151-8dde-cc9331f8e55f-tls-certs\") pod \"kube-auth-proxy-86559b66b8-pdgwd\" (UID: \"32e25a94-8993-4151-8dde-cc9331f8e55f\") " pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:25.965391 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.965344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbdaeb51-ae4e-445c-8922-3405a5334afa-cert\") pod \"odh-model-controller-7998c67dc4-z4r2r\" (UID: \"dbdaeb51-ae4e-445c-8922-3405a5334afa\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:25.967789 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:25.967730    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbdaeb51-ae4e-445c-8922-3405a5334afa-cert\") pod \"odh-model-controller-7998c67dc4-z4r2r\" (UID: \"dbdaeb51-ae4e-445c-8922-3405a5334afa\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:26.018572 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.018533    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8bm5n"]
Jul 22 04:34:26.022728 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.022710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:26.025973 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.025947    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 22 04:34:26.025973 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.025959    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-fvrcm\""
Jul 22 04:34:26.050598 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.050565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8bm5n"]
Jul 22 04:34:26.084591 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.084560    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"
Jul 22 04:34:26.167093 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.167063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a04f94ca-49c8-4149-8040-a5b9d51f6729-tls-certs\") pod \"model-serving-api-54d89bd5fc-8bm5n\" (UID: \"a04f94ca-49c8-4149-8040-a5b9d51f6729\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:26.167510 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.167105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmjp\" (UniqueName: \"kubernetes.io/projected/a04f94ca-49c8-4149-8040-a5b9d51f6729-kube-api-access-tpmjp\") pod \"model-serving-api-54d89bd5fc-8bm5n\" (UID: \"a04f94ca-49c8-4149-8040-a5b9d51f6729\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:26.191215 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.191185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:26.218621 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.218594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd"]
Jul 22 04:34:26.221179 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:34:26.221149    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e25a94_8993_4151_8dde_cc9331f8e55f.slice/crio-0f7a94282f43c3ddb6e699ce4e8d79266bd5e50b706336ebc17abc96db659632 WatchSource:0}: Error finding container 0f7a94282f43c3ddb6e699ce4e8d79266bd5e50b706336ebc17abc96db659632: Status 404 returned error can't find the container with id 0f7a94282f43c3ddb6e699ce4e8d79266bd5e50b706336ebc17abc96db659632
Jul 22 04:34:26.268440 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.268410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a04f94ca-49c8-4149-8040-a5b9d51f6729-tls-certs\") pod \"model-serving-api-54d89bd5fc-8bm5n\" (UID: \"a04f94ca-49c8-4149-8040-a5b9d51f6729\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:26.268604 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.268472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmjp\" (UniqueName: \"kubernetes.io/projected/a04f94ca-49c8-4149-8040-a5b9d51f6729-kube-api-access-tpmjp\") pod \"model-serving-api-54d89bd5fc-8bm5n\" (UID: \"a04f94ca-49c8-4149-8040-a5b9d51f6729\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:26.270960 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.270934    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a04f94ca-49c8-4149-8040-a5b9d51f6729-tls-certs\") pod \"model-serving-api-54d89bd5fc-8bm5n\" (UID: \"a04f94ca-49c8-4149-8040-a5b9d51f6729\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:26.276636 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.276564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmjp\" (UniqueName: \"kubernetes.io/projected/a04f94ca-49c8-4149-8040-a5b9d51f6729-kube-api-access-tpmjp\") pod \"model-serving-api-54d89bd5fc-8bm5n\" (UID: \"a04f94ca-49c8-4149-8040-a5b9d51f6729\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:26.327358 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.327324    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4r2r"]
Jul 22 04:34:26.329727 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:34:26.329691    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdaeb51_ae4e_445c_8922_3405a5334afa.slice/crio-4028d6a4d96e2d5f13f97668ea88811024783cead81f970fcc7ae808794e2a37 WatchSource:0}: Error finding container 4028d6a4d96e2d5f13f97668ea88811024783cead81f970fcc7ae808794e2a37: Status 404 returned error can't find the container with id 4028d6a4d96e2d5f13f97668ea88811024783cead81f970fcc7ae808794e2a37
Jul 22 04:34:26.334889 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.334865    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:26.448509 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.448475    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"]
Jul 22 04:34:26.453225 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.453200    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.456066 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.456036    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 04:34:26.456178 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.456119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 04:34:26.456234 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.456167    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7j8lf\""
Jul 22 04:34:26.456334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.456312    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 04:34:26.456455 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.456046    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 04:34:26.475828 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.475804    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"]
Jul 22 04:34:26.490229 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.490194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8bm5n"]
Jul 22 04:34:26.497645 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:34:26.497616    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04f94ca_49c8_4149_8040_a5b9d51f6729.slice/crio-1118ca1393e58c7d0679b696820678609606901fa61da61cf63c527d939ae3ae WatchSource:0}: Error finding container 1118ca1393e58c7d0679b696820678609606901fa61da61cf63c527d939ae3ae: Status 404 returned error can't find the container with id 1118ca1393e58c7d0679b696820678609606901fa61da61cf63c527d939ae3ae
Jul 22 04:34:26.571412 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.571369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-token\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.571602 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.571438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.571602 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.571506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/556c315b-6963-420f-b4e1-c3c11d42ee15-local-certs\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.571602 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.571534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.571602 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.571572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-cacerts\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.571774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.571617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.571774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.571652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswgp\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-kube-api-access-wswgp\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.672600 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.672503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/556c315b-6963-420f-b4e1-c3c11d42ee15-local-certs\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.672600 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.672546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.672600 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.672570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-cacerts\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.672600 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.672585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.672979 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.672612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswgp\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-kube-api-access-wswgp\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.672979 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.672637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-token\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.672979 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.672678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.673364 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.673331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.675029 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.675007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/556c315b-6963-420f-b4e1-c3c11d42ee15-local-certs\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.675133 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.675111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.675323 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.675304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-cacerts\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.675374 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.675327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.680924 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.680901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-token\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.681184 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.681165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswgp\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-kube-api-access-wswgp\") pod \"istiod-openshift-gateway-7574459656-ppwqg\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.765236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.765190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:26.927890 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:26.927797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"]
Jul 22 04:34:26.931771 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:34:26.931724    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556c315b_6963_420f_b4e1_c3c11d42ee15.slice/crio-b2c960e6ad7ec582956a78fbc630c3db3d79b93fd21c51f80cc49b2dfc93e1f9 WatchSource:0}: Error finding container b2c960e6ad7ec582956a78fbc630c3db3d79b93fd21c51f80cc49b2dfc93e1f9: Status 404 returned error can't find the container with id b2c960e6ad7ec582956a78fbc630c3db3d79b93fd21c51f80cc49b2dfc93e1f9
Jul 22 04:34:27.108682 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:27.108588    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg" event={"ID":"556c315b-6963-420f-b4e1-c3c11d42ee15","Type":"ContainerStarted","Data":"b2c960e6ad7ec582956a78fbc630c3db3d79b93fd21c51f80cc49b2dfc93e1f9"}
Jul 22 04:34:27.110394 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:27.110331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd" event={"ID":"32e25a94-8993-4151-8dde-cc9331f8e55f","Type":"ContainerStarted","Data":"0f7a94282f43c3ddb6e699ce4e8d79266bd5e50b706336ebc17abc96db659632"}
Jul 22 04:34:27.111800 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:27.111725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n" event={"ID":"a04f94ca-49c8-4149-8040-a5b9d51f6729","Type":"ContainerStarted","Data":"1118ca1393e58c7d0679b696820678609606901fa61da61cf63c527d939ae3ae"}
Jul 22 04:34:27.114843 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:27.114642    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r" event={"ID":"dbdaeb51-ae4e-445c-8922-3405a5334afa","Type":"ContainerStarted","Data":"4028d6a4d96e2d5f13f97668ea88811024783cead81f970fcc7ae808794e2a37"}
Jul 22 04:34:31.677049 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:31.677014    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:34:31.677357 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:31.677085    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:34:32.139308 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.139273    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n" event={"ID":"a04f94ca-49c8-4149-8040-a5b9d51f6729","Type":"ContainerStarted","Data":"533e3c10cdc754dec94f396e59a478b921d3c9f8cdc17c315b40a8eca1c3aff3"}
Jul 22 04:34:32.139955 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.139933    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:32.141239 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.141214    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r" event={"ID":"dbdaeb51-ae4e-445c-8922-3405a5334afa","Type":"ContainerStarted","Data":"92170ecd20305fc303a705fe10d90a9aa6d08204291cf876f5aa763bf5d6d72b"}
Jul 22 04:34:32.141505 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.141483    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:32.143214 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.143185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg" event={"ID":"556c315b-6963-420f-b4e1-c3c11d42ee15","Type":"ContainerStarted","Data":"2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd"}
Jul 22 04:34:32.143318 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.143234    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:32.145073 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.145047    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ppwqg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 04:34:32.145233 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.145168    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg" podUID="556c315b-6963-420f-b4e1-c3c11d42ee15" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 04:34:32.145301 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.145266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd" event={"ID":"32e25a94-8993-4151-8dde-cc9331f8e55f","Type":"ContainerStarted","Data":"33ce0352ecfcb66ec2bd693c8fe8d643b736ccb744a7055818d88a0c6286429c"}
Jul 22 04:34:32.160202 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.160154    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n" podStartSLOduration=1.986422124 podStartE2EDuration="7.16013981s" totalImagesPullingTime="5.173717686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:32.157842758 +0000 UTC m=+587.441708154" watchObservedRunningTime="2026-07-22 04:34:32.16013981 +0000 UTC m=+587.444005205"
Jul 22 04:34:32.176486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.176437    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86559b66b8-pdgwd" podStartSLOduration=1.725627067 podStartE2EDuration="7.176421413s" totalImagesPullingTime="5.450794346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:32.174862407 +0000 UTC m=+587.458727805" watchObservedRunningTime="2026-07-22 04:34:32.176421413 +0000 UTC m=+587.460286807"
Jul 22 04:34:32.201384 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.201331    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r" podStartSLOduration=1.848322606 podStartE2EDuration="7.201315232s" totalImagesPullingTime="5.352992626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:32.200050113 +0000 UTC m=+587.483915520" watchObservedRunningTime="2026-07-22 04:34:32.201315232 +0000 UTC m=+587.485180627"
Jul 22 04:34:32.224183 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:32.224118    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg" podStartSLOduration=1.4820209850000001 podStartE2EDuration="6.22409432s" totalImagesPullingTime="4.742073335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:32.221900744 +0000 UTC m=+587.505766140" watchObservedRunningTime="2026-07-22 04:34:32.22409432 +0000 UTC m=+587.507959717"
Jul 22 04:34:33.149691 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:33.149651    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ppwqg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 04:34:33.150085 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:33.149710    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg" podUID="556c315b-6963-420f-b4e1-c3c11d42ee15" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 04:34:36.150375 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.150341    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:36.431266 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.430842    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"]
Jul 22 04:34:36.435909 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.435880    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"]
Jul 22 04:34:36.436042 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.435995    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:36.438749 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.438717    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 22 04:34:36.438871 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.438787    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rf48b\""
Jul 22 04:34:36.438871 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.438846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:36.441632 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.441611    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 22 04:34:36.441762 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.441659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wl7gn\""
Jul 22 04:34:36.444679 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.444658    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"]
Jul 22 04:34:36.450586 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.450567    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"]
Jul 22 04:34:36.562343 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.562306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6512fe5d-839d-482c-b8c8-28e351827d00-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7xbk\" (UID: \"6512fe5d-839d-482c-b8c8-28e351827d00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:36.562343 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.562344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d518e5b-e537-4597-a05c-391bad138f7e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c9nsr\" (UID: \"2d518e5b-e537-4597-a05c-391bad138f7e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:36.562583 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.562389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgrxq\" (UniqueName: \"kubernetes.io/projected/2d518e5b-e537-4597-a05c-391bad138f7e-kube-api-access-wgrxq\") pod \"llmisvc-controller-manager-777c6bd7d5-c9nsr\" (UID: \"2d518e5b-e537-4597-a05c-391bad138f7e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:36.562583 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.562459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdbnl\" (UniqueName: \"kubernetes.io/projected/6512fe5d-839d-482c-b8c8-28e351827d00-kube-api-access-mdbnl\") pod \"kserve-controller-manager-d6f4b65b8-d7xbk\" (UID: \"6512fe5d-839d-482c-b8c8-28e351827d00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:36.663619 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.663585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6512fe5d-839d-482c-b8c8-28e351827d00-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7xbk\" (UID: \"6512fe5d-839d-482c-b8c8-28e351827d00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:36.663619 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.663619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d518e5b-e537-4597-a05c-391bad138f7e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c9nsr\" (UID: \"2d518e5b-e537-4597-a05c-391bad138f7e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:36.663895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.663651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgrxq\" (UniqueName: \"kubernetes.io/projected/2d518e5b-e537-4597-a05c-391bad138f7e-kube-api-access-wgrxq\") pod \"llmisvc-controller-manager-777c6bd7d5-c9nsr\" (UID: \"2d518e5b-e537-4597-a05c-391bad138f7e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:36.663895 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.663671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdbnl\" (UniqueName: \"kubernetes.io/projected/6512fe5d-839d-482c-b8c8-28e351827d00-kube-api-access-mdbnl\") pod \"kserve-controller-manager-d6f4b65b8-d7xbk\" (UID: \"6512fe5d-839d-482c-b8c8-28e351827d00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:36.663895 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:36.663777    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 22 04:34:36.663895 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:36.663857    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d518e5b-e537-4597-a05c-391bad138f7e-cert podName:2d518e5b-e537-4597-a05c-391bad138f7e nodeName:}" failed. No retries permitted until 2026-07-22 04:34:37.163837089 +0000 UTC m=+592.447702477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2d518e5b-e537-4597-a05c-391bad138f7e-cert") pod "llmisvc-controller-manager-777c6bd7d5-c9nsr" (UID: "2d518e5b-e537-4597-a05c-391bad138f7e") : secret "llmisvc-webhook-server-cert" not found
Jul 22 04:34:36.663895 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:36.663774    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 22 04:34:36.664137 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:36.663946    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6512fe5d-839d-482c-b8c8-28e351827d00-cert podName:6512fe5d-839d-482c-b8c8-28e351827d00 nodeName:}" failed. No retries permitted until 2026-07-22 04:34:37.163926112 +0000 UTC m=+592.447791496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6512fe5d-839d-482c-b8c8-28e351827d00-cert") pod "kserve-controller-manager-d6f4b65b8-d7xbk" (UID: "6512fe5d-839d-482c-b8c8-28e351827d00") : secret "kserve-webhook-server-cert" not found
Jul 22 04:34:36.679679 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.679646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdbnl\" (UniqueName: \"kubernetes.io/projected/6512fe5d-839d-482c-b8c8-28e351827d00-kube-api-access-mdbnl\") pod \"kserve-controller-manager-d6f4b65b8-d7xbk\" (UID: \"6512fe5d-839d-482c-b8c8-28e351827d00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:36.696651 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:36.696598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgrxq\" (UniqueName: \"kubernetes.io/projected/2d518e5b-e537-4597-a05c-391bad138f7e-kube-api-access-wgrxq\") pod \"llmisvc-controller-manager-777c6bd7d5-c9nsr\" (UID: \"2d518e5b-e537-4597-a05c-391bad138f7e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:37.168383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:37.168349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6512fe5d-839d-482c-b8c8-28e351827d00-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7xbk\" (UID: \"6512fe5d-839d-482c-b8c8-28e351827d00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:37.168383 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:37.168385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d518e5b-e537-4597-a05c-391bad138f7e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c9nsr\" (UID: \"2d518e5b-e537-4597-a05c-391bad138f7e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:37.170938 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:37.170907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d518e5b-e537-4597-a05c-391bad138f7e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c9nsr\" (UID: \"2d518e5b-e537-4597-a05c-391bad138f7e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:37.171052 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:37.170974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6512fe5d-839d-482c-b8c8-28e351827d00-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7xbk\" (UID: \"6512fe5d-839d-482c-b8c8-28e351827d00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:37.349259 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:37.349211    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:37.355611 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:37.355594    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:37.508077 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:37.508046    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"]
Jul 22 04:34:37.510506 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:34:37.510482    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6512fe5d_839d_482c_b8c8_28e351827d00.slice/crio-c66868f5a38dfc1cae1b0f3def8a37d78a37869405ced2d558d8545d4b8394ae WatchSource:0}: Error finding container c66868f5a38dfc1cae1b0f3def8a37d78a37869405ced2d558d8545d4b8394ae: Status 404 returned error can't find the container with id c66868f5a38dfc1cae1b0f3def8a37d78a37869405ced2d558d8545d4b8394ae
Jul 22 04:34:37.520804 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:37.520783    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"]
Jul 22 04:34:37.522065 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:34:37.522038    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d518e5b_e537_4597_a05c_391bad138f7e.slice/crio-0ec3f99c6f366f85e660fe17ab04108d779c851ba44b929567e0fa5dad36af7b WatchSource:0}: Error finding container 0ec3f99c6f366f85e660fe17ab04108d779c851ba44b929567e0fa5dad36af7b: Status 404 returned error can't find the container with id 0ec3f99c6f366f85e660fe17ab04108d779c851ba44b929567e0fa5dad36af7b
Jul 22 04:34:38.174359 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:38.174317    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr" event={"ID":"2d518e5b-e537-4597-a05c-391bad138f7e","Type":"ContainerStarted","Data":"0ec3f99c6f366f85e660fe17ab04108d779c851ba44b929567e0fa5dad36af7b"}
Jul 22 04:34:38.175636 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:38.175609    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk" event={"ID":"6512fe5d-839d-482c-b8c8-28e351827d00","Type":"ContainerStarted","Data":"c66868f5a38dfc1cae1b0f3def8a37d78a37869405ced2d558d8545d4b8394ae"}
Jul 22 04:34:39.210168 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.210130    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"]
Jul 22 04:34:39.210631 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.210340    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg" podUID="556c315b-6963-420f-b4e1-c3c11d42ee15" containerName="discovery" containerID="cri-o://2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd" gracePeriod=30
Jul 22 04:34:39.876007 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.875983    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:39.990093 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.990068    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-token\") pod \"556c315b-6963-420f-b4e1-c3c11d42ee15\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") "
Jul 22 04:34:39.990271 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.990111    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wswgp\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-kube-api-access-wswgp\") pod \"556c315b-6963-420f-b4e1-c3c11d42ee15\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") "
Jul 22 04:34:39.990271 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.990140    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/556c315b-6963-420f-b4e1-c3c11d42ee15-local-certs\") pod \"556c315b-6963-420f-b4e1-c3c11d42ee15\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") "
Jul 22 04:34:39.990271 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.990155    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-cacerts\") pod \"556c315b-6963-420f-b4e1-c3c11d42ee15\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") "
Jul 22 04:34:39.990271 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.990169    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-kubeconfig\") pod \"556c315b-6963-420f-b4e1-c3c11d42ee15\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") "
Jul 22 04:34:39.990488 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.990446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-dns-cert\") pod \"556c315b-6963-420f-b4e1-c3c11d42ee15\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") "
Jul 22 04:34:39.990549 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.990538    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-ca-configmap\") pod \"556c315b-6963-420f-b4e1-c3c11d42ee15\" (UID: \"556c315b-6963-420f-b4e1-c3c11d42ee15\") "
Jul 22 04:34:39.991062 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.991018    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "556c315b-6963-420f-b4e1-c3c11d42ee15" (UID: "556c315b-6963-420f-b4e1-c3c11d42ee15"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:34:39.993144 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.993108    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-cacerts" (OuterVolumeSpecName: "cacerts") pod "556c315b-6963-420f-b4e1-c3c11d42ee15" (UID: "556c315b-6963-420f-b4e1-c3c11d42ee15"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:34:39.993288 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.993258    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/556c315b-6963-420f-b4e1-c3c11d42ee15-local-certs" (OuterVolumeSpecName: "local-certs") pod "556c315b-6963-420f-b4e1-c3c11d42ee15" (UID: "556c315b-6963-420f-b4e1-c3c11d42ee15"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:34:39.993448 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.993420    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-token" (OuterVolumeSpecName: "istio-token") pod "556c315b-6963-420f-b4e1-c3c11d42ee15" (UID: "556c315b-6963-420f-b4e1-c3c11d42ee15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:34:39.993448 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.993435    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "556c315b-6963-420f-b4e1-c3c11d42ee15" (UID: "556c315b-6963-420f-b4e1-c3c11d42ee15"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:34:39.993595 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.993541    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-kube-api-access-wswgp" (OuterVolumeSpecName: "kube-api-access-wswgp") pod "556c315b-6963-420f-b4e1-c3c11d42ee15" (UID: "556c315b-6963-420f-b4e1-c3c11d42ee15"). InnerVolumeSpecName "kube-api-access-wswgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:34:39.993635 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:39.993586    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "556c315b-6963-420f-b4e1-c3c11d42ee15" (UID: "556c315b-6963-420f-b4e1-c3c11d42ee15"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:34:40.091854 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.091818    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:34:40.091854 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.091849    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wswgp\" (UniqueName: \"kubernetes.io/projected/556c315b-6963-420f-b4e1-c3c11d42ee15-kube-api-access-wswgp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:34:40.091854 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.091862    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/556c315b-6963-420f-b4e1-c3c11d42ee15-local-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:34:40.092083 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.091874    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-cacerts\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:34:40.092083 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.091885    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-kubeconfig\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:34:40.092083 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.091896    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-dns-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:34:40.092083 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.091906    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/556c315b-6963-420f-b4e1-c3c11d42ee15-istio-csr-ca-configmap\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:34:40.186434 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.186159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk" event={"ID":"6512fe5d-839d-482c-b8c8-28e351827d00","Type":"ContainerStarted","Data":"258788b1278b40320bc176a50717085b764ccc627f3c75f56ac462050d36687b"}
Jul 22 04:34:40.186434 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.186273    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:34:40.187727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.187702    2564 generic.go:356] "Generic (PLEG): container finished" podID="556c315b-6963-420f-b4e1-c3c11d42ee15" containerID="2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd" exitCode=0
Jul 22 04:34:40.187867 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.187787    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"
Jul 22 04:34:40.187867 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.187817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg" event={"ID":"556c315b-6963-420f-b4e1-c3c11d42ee15","Type":"ContainerDied","Data":"2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd"}
Jul 22 04:34:40.187867 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.187860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg" event={"ID":"556c315b-6963-420f-b4e1-c3c11d42ee15","Type":"ContainerDied","Data":"b2c960e6ad7ec582956a78fbc630c3db3d79b93fd21c51f80cc49b2dfc93e1f9"}
Jul 22 04:34:40.188029 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.187884    2564 scope.go:117] "RemoveContainer" containerID="2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd"
Jul 22 04:34:40.205708 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.205650    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk" podStartSLOduration=1.959704844 podStartE2EDuration="4.205627777s" totalImagesPullingTime="2.245922933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:40.204676947 +0000 UTC m=+595.488542343" watchObservedRunningTime="2026-07-22 04:34:40.205627777 +0000 UTC m=+595.489493192"
Jul 22 04:34:40.220756 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.220708    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"]
Jul 22 04:34:40.224720 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.224694    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ppwqg"]
Jul 22 04:34:40.453052 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.452878    2564 scope.go:117] "RemoveContainer" containerID="2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd"
Jul 22 04:34:40.453245 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:34:40.453223    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd\": container with ID starting with 2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd not found: ID does not exist" containerID="2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd"
Jul 22 04:34:40.453317 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:40.453274    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd"} err="failed to get container status \"2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd\": rpc error: code = NotFound desc = could not find container \"2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd\": container with ID starting with 2b932efedbd0dfc7dbb84c71e3c9611e0133cad90047ac36a7ad8165c04272cd not found: ID does not exist"
Jul 22 04:34:41.170099 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:41.170065    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="556c315b-6963-420f-b4e1-c3c11d42ee15" path="/var/lib/kubelet/pods/556c315b-6963-420f-b4e1-c3c11d42ee15/volumes"
Jul 22 04:34:41.193638 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:41.193598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr" event={"ID":"2d518e5b-e537-4597-a05c-391bad138f7e","Type":"ContainerStarted","Data":"40882abb6d7f603003015897a45b310b4e12fc0f993f29244ee54a74bfa70bec"}
Jul 22 04:34:41.193932 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:41.193899    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:34:41.213166 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:41.213120    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr" podStartSLOduration=2.234552238 podStartE2EDuration="5.213104916s" totalImagesPullingTime="2.978552678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:41.212039802 +0000 UTC m=+596.495905197" watchObservedRunningTime="2026-07-22 04:34:41.213104916 +0000 UTC m=+596.496970344"
Jul 22 04:34:43.151369 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:43.151338    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-z4r2r"
Jul 22 04:34:43.153071 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:43.153049    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8bm5n"
Jul 22 04:34:45.063464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:45.063341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:34:45.063824 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:34:45.063812    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:35:11.198890 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:11.198813    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7xbk"
Jul 22 04:35:12.200224 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:12.200190    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9nsr"
Jul 22 04:35:26.078646 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.078605    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2hfc"]
Jul 22 04:35:26.079226 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.079080    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556c315b-6963-420f-b4e1-c3c11d42ee15" containerName="discovery"
Jul 22 04:35:26.079226 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.079100    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="556c315b-6963-420f-b4e1-c3c11d42ee15" containerName="discovery"
Jul 22 04:35:26.079226 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.079182    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="556c315b-6963-420f-b4e1-c3c11d42ee15" containerName="discovery"
Jul 22 04:35:26.082291 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.082270    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc"
Jul 22 04:35:26.085528 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.085506    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6nbqp\""
Jul 22 04:35:26.085858 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.085834    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 04:35:26.085957 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.085892    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 04:35:26.104937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.104899    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2hfc"]
Jul 22 04:35:26.169640 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.169611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8824k\" (UniqueName: \"kubernetes.io/projected/6bf69b28-57b9-45c8-b6e6-e8974f528625-kube-api-access-8824k\") pod \"kuadrant-operator-catalog-k2hfc\" (UID: \"6bf69b28-57b9-45c8-b6e6-e8974f528625\") " pod="kuadrant-system/kuadrant-operator-catalog-k2hfc"
Jul 22 04:35:26.270218 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.270192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8824k\" (UniqueName: \"kubernetes.io/projected/6bf69b28-57b9-45c8-b6e6-e8974f528625-kube-api-access-8824k\") pod \"kuadrant-operator-catalog-k2hfc\" (UID: \"6bf69b28-57b9-45c8-b6e6-e8974f528625\") " pod="kuadrant-system/kuadrant-operator-catalog-k2hfc"
Jul 22 04:35:26.278486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.278451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8824k\" (UniqueName: \"kubernetes.io/projected/6bf69b28-57b9-45c8-b6e6-e8974f528625-kube-api-access-8824k\") pod \"kuadrant-operator-catalog-k2hfc\" (UID: \"6bf69b28-57b9-45c8-b6e6-e8974f528625\") " pod="kuadrant-system/kuadrant-operator-catalog-k2hfc"
Jul 22 04:35:26.391792 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.391711    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc"
Jul 22 04:35:26.408155 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.408124    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2hfc"]
Jul 22 04:35:26.517927 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.517885    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2hfc"]
Jul 22 04:35:26.521990 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:35:26.521962    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf69b28_57b9_45c8_b6e6_e8974f528625.slice/crio-f41a41ef449bc1b1c6c2d8db4a2c2121ed0e88b7e60c02da10655fd6da2f744c WatchSource:0}: Error finding container f41a41ef449bc1b1c6c2d8db4a2c2121ed0e88b7e60c02da10655fd6da2f744c: Status 404 returned error can't find the container with id f41a41ef449bc1b1c6c2d8db4a2c2121ed0e88b7e60c02da10655fd6da2f744c
Jul 22 04:35:26.617477 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.617441    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-99wvf"]
Jul 22 04:35:26.621708 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.621690    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:26.627145 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.627114    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-99wvf"]
Jul 22 04:35:26.774464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.774430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4wq8\" (UniqueName: \"kubernetes.io/projected/502f8546-5e48-4820-a60c-43c662391207-kube-api-access-n4wq8\") pod \"kuadrant-operator-catalog-99wvf\" (UID: \"502f8546-5e48-4820-a60c-43c662391207\") " pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:26.875760 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.875702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4wq8\" (UniqueName: \"kubernetes.io/projected/502f8546-5e48-4820-a60c-43c662391207-kube-api-access-n4wq8\") pod \"kuadrant-operator-catalog-99wvf\" (UID: \"502f8546-5e48-4820-a60c-43c662391207\") " pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:26.883280 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.883255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4wq8\" (UniqueName: \"kubernetes.io/projected/502f8546-5e48-4820-a60c-43c662391207-kube-api-access-n4wq8\") pod \"kuadrant-operator-catalog-99wvf\" (UID: \"502f8546-5e48-4820-a60c-43c662391207\") " pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:26.931909 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:26.931878    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:27.064369 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:27.064256    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-99wvf"]
Jul 22 04:35:27.066349 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:35:27.066324    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502f8546_5e48_4820_a60c_43c662391207.slice/crio-d69c3c3a07996a036281daf03479995c02053ad5cddb82d36d4b7abfc69fbcef WatchSource:0}: Error finding container d69c3c3a07996a036281daf03479995c02053ad5cddb82d36d4b7abfc69fbcef: Status 404 returned error can't find the container with id d69c3c3a07996a036281daf03479995c02053ad5cddb82d36d4b7abfc69fbcef
Jul 22 04:35:27.370180 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:27.370098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc" event={"ID":"6bf69b28-57b9-45c8-b6e6-e8974f528625","Type":"ContainerStarted","Data":"f41a41ef449bc1b1c6c2d8db4a2c2121ed0e88b7e60c02da10655fd6da2f744c"}
Jul 22 04:35:27.371371 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:27.371334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-99wvf" event={"ID":"502f8546-5e48-4820-a60c-43c662391207","Type":"ContainerStarted","Data":"d69c3c3a07996a036281daf03479995c02053ad5cddb82d36d4b7abfc69fbcef"}
Jul 22 04:35:29.385198 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.385148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-99wvf" event={"ID":"502f8546-5e48-4820-a60c-43c662391207","Type":"ContainerStarted","Data":"0ad6fd9287f2370ee6c7400cff4cd27201c5787e08cff5d9ca8747ac15e61ac1"}
Jul 22 04:35:29.386562 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.386540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc" event={"ID":"6bf69b28-57b9-45c8-b6e6-e8974f528625","Type":"ContainerStarted","Data":"a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26"}
Jul 22 04:35:29.386642 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.386601    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc" podUID="6bf69b28-57b9-45c8-b6e6-e8974f528625" containerName="registry-server" containerID="cri-o://a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26" gracePeriod=2
Jul 22 04:35:29.400523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.400485    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-99wvf" podStartSLOduration=1.948169229 podStartE2EDuration="3.400469958s" totalImagesPullingTime="1.452300729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:35:29.398850864 +0000 UTC m=+644.682716260" watchObservedRunningTime="2026-07-22 04:35:29.400469958 +0000 UTC m=+644.684335352"
Jul 22 04:35:29.412102 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.412055    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc" podStartSLOduration=1.416864161 podStartE2EDuration="3.412037393s" totalImagesPullingTime="1.995173232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:35:29.411840868 +0000 UTC m=+644.695706275" watchObservedRunningTime="2026-07-22 04:35:29.412037393 +0000 UTC m=+644.695902789"
Jul 22 04:35:29.636120 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.636060    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc"
Jul 22 04:35:29.799000 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.798969    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8824k\" (UniqueName: \"kubernetes.io/projected/6bf69b28-57b9-45c8-b6e6-e8974f528625-kube-api-access-8824k\") pod \"6bf69b28-57b9-45c8-b6e6-e8974f528625\" (UID: \"6bf69b28-57b9-45c8-b6e6-e8974f528625\") "
Jul 22 04:35:29.800998 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.800976    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf69b28-57b9-45c8-b6e6-e8974f528625-kube-api-access-8824k" (OuterVolumeSpecName: "kube-api-access-8824k") pod "6bf69b28-57b9-45c8-b6e6-e8974f528625" (UID: "6bf69b28-57b9-45c8-b6e6-e8974f528625"). InnerVolumeSpecName "kube-api-access-8824k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:35:29.899657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:29.899574    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8824k\" (UniqueName: \"kubernetes.io/projected/6bf69b28-57b9-45c8-b6e6-e8974f528625-kube-api-access-8824k\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:35:30.391493 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.391463    2564 generic.go:356] "Generic (PLEG): container finished" podID="6bf69b28-57b9-45c8-b6e6-e8974f528625" containerID="a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26" exitCode=0
Jul 22 04:35:30.391907 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.391507    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc"
Jul 22 04:35:30.391907 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.391535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc" event={"ID":"6bf69b28-57b9-45c8-b6e6-e8974f528625","Type":"ContainerDied","Data":"a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26"}
Jul 22 04:35:30.391907 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.391576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k2hfc" event={"ID":"6bf69b28-57b9-45c8-b6e6-e8974f528625","Type":"ContainerDied","Data":"f41a41ef449bc1b1c6c2d8db4a2c2121ed0e88b7e60c02da10655fd6da2f744c"}
Jul 22 04:35:30.391907 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.391594    2564 scope.go:117] "RemoveContainer" containerID="a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26"
Jul 22 04:35:30.400468 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.400452    2564 scope.go:117] "RemoveContainer" containerID="a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26"
Jul 22 04:35:30.400695 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:35:30.400675    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26\": container with ID starting with a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26 not found: ID does not exist" containerID="a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26"
Jul 22 04:35:30.400806 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.400708    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26"} err="failed to get container status \"a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26\": rpc error: code = NotFound desc = could not find container \"a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26\": container with ID starting with a9f6f3ed3d02a1bcb533bf2bf4d15bf15901db705a840d696a48b9bbfeb8ca26 not found: ID does not exist"
Jul 22 04:35:30.410986 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.410961    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2hfc"]
Jul 22 04:35:30.416442 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:30.416419    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2hfc"]
Jul 22 04:35:31.170516 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:31.170483    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bf69b28-57b9-45c8-b6e6-e8974f528625" path="/var/lib/kubelet/pods/6bf69b28-57b9-45c8-b6e6-e8974f528625/volumes"
Jul 22 04:35:36.932832 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:36.932794    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:36.933327 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:36.932855    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:36.954650 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:36.954624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:37.441974 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:37.441948    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-99wvf"
Jul 22 04:35:58.684877 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.684843    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"]
Jul 22 04:35:58.685272 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.685155    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf69b28-57b9-45c8-b6e6-e8974f528625" containerName="registry-server"
Jul 22 04:35:58.685272 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.685165    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf69b28-57b9-45c8-b6e6-e8974f528625" containerName="registry-server"
Jul 22 04:35:58.685272 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.685227    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf69b28-57b9-45c8-b6e6-e8974f528625" containerName="registry-server"
Jul 22 04:35:58.692508 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.692485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"
Jul 22 04:35:58.698003 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.697983    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2cqwt\""
Jul 22 04:35:58.706020 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.705986    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"]
Jul 22 04:35:58.736467 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.736435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7b9n\" (UniqueName: \"kubernetes.io/projected/85d8c642-1ffd-41d9-95ca-f6a5fec98584-kube-api-access-k7b9n\") pod \"authorino-operator-75cc8d5cb7-zlpgb\" (UID: \"85d8c642-1ffd-41d9-95ca-f6a5fec98584\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"
Jul 22 04:35:58.837497 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.837459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7b9n\" (UniqueName: \"kubernetes.io/projected/85d8c642-1ffd-41d9-95ca-f6a5fec98584-kube-api-access-k7b9n\") pod \"authorino-operator-75cc8d5cb7-zlpgb\" (UID: \"85d8c642-1ffd-41d9-95ca-f6a5fec98584\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"
Jul 22 04:35:58.850708 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:58.850674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7b9n\" (UniqueName: \"kubernetes.io/projected/85d8c642-1ffd-41d9-95ca-f6a5fec98584-kube-api-access-k7b9n\") pod \"authorino-operator-75cc8d5cb7-zlpgb\" (UID: \"85d8c642-1ffd-41d9-95ca-f6a5fec98584\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"
Jul 22 04:35:59.004537 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:59.004504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"
Jul 22 04:35:59.136151 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:59.136126    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"]
Jul 22 04:35:59.138769 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:35:59.138712    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d8c642_1ffd_41d9_95ca_f6a5fec98584.slice/crio-44ae94bccb338027da774e1567d96f6803ab7d0e69ec57f14e0c8f076f5547ec WatchSource:0}: Error finding container 44ae94bccb338027da774e1567d96f6803ab7d0e69ec57f14e0c8f076f5547ec: Status 404 returned error can't find the container with id 44ae94bccb338027da774e1567d96f6803ab7d0e69ec57f14e0c8f076f5547ec
Jul 22 04:35:59.510087 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:35:59.510053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb" event={"ID":"85d8c642-1ffd-41d9-95ca-f6a5fec98584","Type":"ContainerStarted","Data":"44ae94bccb338027da774e1567d96f6803ab7d0e69ec57f14e0c8f076f5547ec"}
Jul 22 04:36:01.522606 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.522570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb" event={"ID":"85d8c642-1ffd-41d9-95ca-f6a5fec98584","Type":"ContainerStarted","Data":"1b97ca829167c7c8bdff43eef7eff239f65a5c752c56cb5a0b4d7cd92ae58804"}
Jul 22 04:36:01.522984 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.522700    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"
Jul 22 04:36:01.539660 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.539612    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb" podStartSLOduration=1.231388949 podStartE2EDuration="3.53959556s" totalImagesPullingTime="2.308206611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:36:01.537375851 +0000 UTC m=+676.821241246" watchObservedRunningTime="2026-07-22 04:36:01.53959556 +0000 UTC m=+676.823460955"
Jul 22 04:36:01.875637 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.875593    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"]
Jul 22 04:36:01.879426 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.879401    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"
Jul 22 04:36:01.881650 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.881631    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 04:36:01.881766 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.881655    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5cd76\""
Jul 22 04:36:01.887890 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.887868    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"]
Jul 22 04:36:01.967628 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:01.967581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qnvr\" (UniqueName: \"kubernetes.io/projected/7859cd74-2e30-4fc1-bc4f-87359c89a9c0-kube-api-access-4qnvr\") pod \"dns-operator-controller-manager-864dd78c4c-tnsrg\" (UID: \"7859cd74-2e30-4fc1-bc4f-87359c89a9c0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"
Jul 22 04:36:02.068550 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:02.068511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qnvr\" (UniqueName: \"kubernetes.io/projected/7859cd74-2e30-4fc1-bc4f-87359c89a9c0-kube-api-access-4qnvr\") pod \"dns-operator-controller-manager-864dd78c4c-tnsrg\" (UID: \"7859cd74-2e30-4fc1-bc4f-87359c89a9c0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"
Jul 22 04:36:02.078439 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:02.078409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qnvr\" (UniqueName: \"kubernetes.io/projected/7859cd74-2e30-4fc1-bc4f-87359c89a9c0-kube-api-access-4qnvr\") pod \"dns-operator-controller-manager-864dd78c4c-tnsrg\" (UID: \"7859cd74-2e30-4fc1-bc4f-87359c89a9c0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"
Jul 22 04:36:02.190165 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:02.190072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"
Jul 22 04:36:02.327529 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:02.327497    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"]
Jul 22 04:36:02.330605 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:36:02.330578    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7859cd74_2e30_4fc1_bc4f_87359c89a9c0.slice/crio-3778390dc34e72691d9fb283975f6fed2f2c3db3dd9e68ccb7cd59b4222ce327 WatchSource:0}: Error finding container 3778390dc34e72691d9fb283975f6fed2f2c3db3dd9e68ccb7cd59b4222ce327: Status 404 returned error can't find the container with id 3778390dc34e72691d9fb283975f6fed2f2c3db3dd9e68ccb7cd59b4222ce327
Jul 22 04:36:02.332983 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:02.332965    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:36:02.528025 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:02.527995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg" event={"ID":"7859cd74-2e30-4fc1-bc4f-87359c89a9c0","Type":"ContainerStarted","Data":"3778390dc34e72691d9fb283975f6fed2f2c3db3dd9e68ccb7cd59b4222ce327"}
Jul 22 04:36:04.538831 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:04.538793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg" event={"ID":"7859cd74-2e30-4fc1-bc4f-87359c89a9c0","Type":"ContainerStarted","Data":"6463dc9ad4c76c7f053dd3d11eaae90364be38ff8583124ecd04805e71245855"}
Jul 22 04:36:04.539230 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:04.538901    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"
Jul 22 04:36:04.558388 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:04.558334    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg" podStartSLOduration=1.784675732 podStartE2EDuration="3.558318993s" totalImagesPullingTime="1.773643261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:36:04.557185266 +0000 UTC m=+679.841050661" watchObservedRunningTime="2026-07-22 04:36:04.558318993 +0000 UTC m=+679.842184388"
Jul 22 04:36:05.268237 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.268199    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"]
Jul 22 04:36:05.271405 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.271387    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:05.273693 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.273672    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qbgd6\""
Jul 22 04:36:05.281814 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.281793    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"]
Jul 22 04:36:05.396704 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.396666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54hng\" (UniqueName: \"kubernetes.io/projected/12953545-a7ee-4ab4-a604-f62da24cdab4-kube-api-access-54hng\") pod \"limitador-operator-controller-manager-859d7b78bd-g2htb\" (UID: \"12953545-a7ee-4ab4-a604-f62da24cdab4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:05.497338 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.497298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54hng\" (UniqueName: \"kubernetes.io/projected/12953545-a7ee-4ab4-a604-f62da24cdab4-kube-api-access-54hng\") pod \"limitador-operator-controller-manager-859d7b78bd-g2htb\" (UID: \"12953545-a7ee-4ab4-a604-f62da24cdab4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:05.505489 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.505456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54hng\" (UniqueName: \"kubernetes.io/projected/12953545-a7ee-4ab4-a604-f62da24cdab4-kube-api-access-54hng\") pod \"limitador-operator-controller-manager-859d7b78bd-g2htb\" (UID: \"12953545-a7ee-4ab4-a604-f62da24cdab4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:05.581122 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.581049    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:05.713855 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:05.713823    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"]
Jul 22 04:36:05.717906 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:36:05.717876    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12953545_a7ee_4ab4_a604_f62da24cdab4.slice/crio-0713a96fb30f31a151cd7e73f22cf69229aa0ad945fe4cd2c99fed1a3403e5af WatchSource:0}: Error finding container 0713a96fb30f31a151cd7e73f22cf69229aa0ad945fe4cd2c99fed1a3403e5af: Status 404 returned error can't find the container with id 0713a96fb30f31a151cd7e73f22cf69229aa0ad945fe4cd2c99fed1a3403e5af
Jul 22 04:36:06.550999 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:06.550952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb" event={"ID":"12953545-a7ee-4ab4-a604-f62da24cdab4","Type":"ContainerStarted","Data":"0713a96fb30f31a151cd7e73f22cf69229aa0ad945fe4cd2c99fed1a3403e5af"}
Jul 22 04:36:07.556867 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:07.556828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb" event={"ID":"12953545-a7ee-4ab4-a604-f62da24cdab4","Type":"ContainerStarted","Data":"0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0"}
Jul 22 04:36:07.557254 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:07.556940    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:07.573330 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:07.573263    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb" podStartSLOduration=1.079822814 podStartE2EDuration="2.573242451s" totalImagesPullingTime="1.493419637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:36:07.572309847 +0000 UTC m=+682.856175243" watchObservedRunningTime="2026-07-22 04:36:07.573242451 +0000 UTC m=+682.857107856"
Jul 22 04:36:10.218183 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.218140    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"]
Jul 22 04:36:10.221353 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.221337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:10.224223 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.224201    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bjcws\""
Jul 22 04:36:10.233330 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.233303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"]
Jul 22 04:36:10.340480 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.340441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e400568f-825e-4ec9-ae78-14ac7648e598-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" (UID: \"e400568f-825e-4ec9-ae78-14ac7648e598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:10.340665 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.340494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghwlr\" (UniqueName: \"kubernetes.io/projected/e400568f-825e-4ec9-ae78-14ac7648e598-kube-api-access-ghwlr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" (UID: \"e400568f-825e-4ec9-ae78-14ac7648e598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:10.441495 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.441459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghwlr\" (UniqueName: \"kubernetes.io/projected/e400568f-825e-4ec9-ae78-14ac7648e598-kube-api-access-ghwlr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" (UID: \"e400568f-825e-4ec9-ae78-14ac7648e598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:10.441646 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.441552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e400568f-825e-4ec9-ae78-14ac7648e598-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" (UID: \"e400568f-825e-4ec9-ae78-14ac7648e598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:10.441984 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.441965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e400568f-825e-4ec9-ae78-14ac7648e598-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" (UID: \"e400568f-825e-4ec9-ae78-14ac7648e598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:10.450464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.450442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghwlr\" (UniqueName: \"kubernetes.io/projected/e400568f-825e-4ec9-ae78-14ac7648e598-kube-api-access-ghwlr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" (UID: \"e400568f-825e-4ec9-ae78-14ac7648e598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:10.530989 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.530958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:10.666132 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:10.666071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"]
Jul 22 04:36:10.668960 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:36:10.668922    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode400568f_825e_4ec9_ae78_14ac7648e598.slice/crio-e13d65a2f373f60baca783e835eaf6091d9b1ba3efd0ad3fbea49d6790756a7d WatchSource:0}: Error finding container e13d65a2f373f60baca783e835eaf6091d9b1ba3efd0ad3fbea49d6790756a7d: Status 404 returned error can't find the container with id e13d65a2f373f60baca783e835eaf6091d9b1ba3efd0ad3fbea49d6790756a7d
Jul 22 04:36:11.577660 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:11.577619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5" event={"ID":"e400568f-825e-4ec9-ae78-14ac7648e598","Type":"ContainerStarted","Data":"e13d65a2f373f60baca783e835eaf6091d9b1ba3efd0ad3fbea49d6790756a7d"}
Jul 22 04:36:12.530858 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:12.530826    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zlpgb"
Jul 22 04:36:15.546203 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:15.546163    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tnsrg"
Jul 22 04:36:16.599818 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:16.599784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5" event={"ID":"e400568f-825e-4ec9-ae78-14ac7648e598","Type":"ContainerStarted","Data":"4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922"}
Jul 22 04:36:16.600214 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:16.599890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:16.620671 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:16.620594    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5" podStartSLOduration=1.228874091 podStartE2EDuration="6.620576376s" totalImagesPullingTime="5.391702285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:36:16.620350921 +0000 UTC m=+691.904216320" watchObservedRunningTime="2026-07-22 04:36:16.620576376 +0000 UTC m=+691.904441771"
Jul 22 04:36:18.565153 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:18.565124    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:27.607325 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:27.607290    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:28.648928 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.648892    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"]
Jul 22 04:36:28.652523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.652502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:28.670153 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.670125    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"]
Jul 22 04:36:28.806309 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.806273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753a7dab-9333-41d0-9f62-2556c686f726-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" (UID: \"753a7dab-9333-41d0-9f62-2556c686f726\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:28.806543 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.806331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg2qb\" (UniqueName: \"kubernetes.io/projected/753a7dab-9333-41d0-9f62-2556c686f726-kube-api-access-hg2qb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" (UID: \"753a7dab-9333-41d0-9f62-2556c686f726\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:28.907184 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.907089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753a7dab-9333-41d0-9f62-2556c686f726-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" (UID: \"753a7dab-9333-41d0-9f62-2556c686f726\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:28.907184 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.907168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg2qb\" (UniqueName: \"kubernetes.io/projected/753a7dab-9333-41d0-9f62-2556c686f726-kube-api-access-hg2qb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" (UID: \"753a7dab-9333-41d0-9f62-2556c686f726\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:28.907572 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.907552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753a7dab-9333-41d0-9f62-2556c686f726-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" (UID: \"753a7dab-9333-41d0-9f62-2556c686f726\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:28.914694 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.914673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg2qb\" (UniqueName: \"kubernetes.io/projected/753a7dab-9333-41d0-9f62-2556c686f726-kube-api-access-hg2qb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" (UID: \"753a7dab-9333-41d0-9f62-2556c686f726\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:28.966663 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:28.966624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:29.100182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.100160    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"]
Jul 22 04:36:29.103016 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:36:29.102988    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753a7dab_9333_41d0_9f62_2556c686f726.slice/crio-255382ba861081b157c65e4b84cc7e83508a06beb873f9ec3d555e74e9c41b38 WatchSource:0}: Error finding container 255382ba861081b157c65e4b84cc7e83508a06beb873f9ec3d555e74e9c41b38: Status 404 returned error can't find the container with id 255382ba861081b157c65e4b84cc7e83508a06beb873f9ec3d555e74e9c41b38
Jul 22 04:36:29.223553 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.223517    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"]
Jul 22 04:36:29.232685 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.232656    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"]
Jul 22 04:36:29.242834 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.242804    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"]
Jul 22 04:36:29.243020 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.242984    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" containerName="manager" containerID="cri-o://4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922" gracePeriod=2
Jul 22 04:36:29.256342 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.256314    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"]
Jul 22 04:36:29.262822 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.262778    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e400568f-825e-4ec9-ae78-14ac7648e598\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\": pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.272006 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.271979    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"]
Jul 22 04:36:29.272273 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.272220    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" containerName="manager" containerID="cri-o://0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0" gracePeriod=2
Jul 22 04:36:29.276574 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.276513    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"]
Jul 22 04:36:29.276881 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.276867    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" containerName="manager"
Jul 22 04:36:29.276937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.276883    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" containerName="manager"
Jul 22 04:36:29.276937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.276897    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753a7dab-9333-41d0-9f62-2556c686f726" containerName="manager"
Jul 22 04:36:29.276937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.276903    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="753a7dab-9333-41d0-9f62-2556c686f726" containerName="manager"
Jul 22 04:36:29.277046 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.276960    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="753a7dab-9333-41d0-9f62-2556c686f726" containerName="manager"
Jul 22 04:36:29.277046 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.276971    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" containerName="manager"
Jul 22 04:36:29.278486 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.278451    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.280068 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.280046    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"]
Jul 22 04:36:29.280191 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.280170    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:29.285089 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.285057    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.294064 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.294038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"]
Jul 22 04:36:29.296484 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.296459    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"]
Jul 22 04:36:29.296926 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.296905    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" containerName="manager"
Jul 22 04:36:29.296988 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.296928    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" containerName="manager"
Jul 22 04:36:29.297027 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.297008    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" containerName="manager"
Jul 22 04:36:29.300527 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.300511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"
Jul 22 04:36:29.315412 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.315378    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.318509 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.318475    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.318657 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.318606    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"]
Jul 22 04:36:29.320409 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.320383    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.410909 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.410822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvlwj\" (UniqueName: \"kubernetes.io/projected/690e3913-0ccc-4fda-95e4-d11a8d4748a9-kube-api-access-vvlwj\") pod \"limitador-operator-controller-manager-859d7b78bd-226b9\" (UID: \"690e3913-0ccc-4fda-95e4-d11a8d4748a9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"
Jul 22 04:36:29.410909 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.410883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c36809a-ba4f-4824-90a9-72de73029299-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4k2jf\" (UID: \"2c36809a-ba4f-4824-90a9-72de73029299\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:29.411119 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.410916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9tx\" (UniqueName: \"kubernetes.io/projected/2c36809a-ba4f-4824-90a9-72de73029299-kube-api-access-pg9tx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4k2jf\" (UID: \"2c36809a-ba4f-4824-90a9-72de73029299\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:29.502542 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.502511    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.504704 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.504637    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.506696 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.506671    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.511243 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.511225    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.511500 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.511481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvlwj\" (UniqueName: \"kubernetes.io/projected/690e3913-0ccc-4fda-95e4-d11a8d4748a9-kube-api-access-vvlwj\") pod \"limitador-operator-controller-manager-859d7b78bd-226b9\" (UID: \"690e3913-0ccc-4fda-95e4-d11a8d4748a9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"
Jul 22 04:36:29.511551 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.511520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c36809a-ba4f-4824-90a9-72de73029299-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4k2jf\" (UID: \"2c36809a-ba4f-4824-90a9-72de73029299\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:29.511551 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.511538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9tx\" (UniqueName: \"kubernetes.io/projected/2c36809a-ba4f-4824-90a9-72de73029299-kube-api-access-pg9tx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4k2jf\" (UID: \"2c36809a-ba4f-4824-90a9-72de73029299\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:29.511888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.511867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c36809a-ba4f-4824-90a9-72de73029299-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4k2jf\" (UID: \"2c36809a-ba4f-4824-90a9-72de73029299\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:29.513686 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.513664    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.515430 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.515408    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.532150 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.532129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvlwj\" (UniqueName: \"kubernetes.io/projected/690e3913-0ccc-4fda-95e4-d11a8d4748a9-kube-api-access-vvlwj\") pod \"limitador-operator-controller-manager-859d7b78bd-226b9\" (UID: \"690e3913-0ccc-4fda-95e4-d11a8d4748a9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"
Jul 22 04:36:29.532237 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.532177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9tx\" (UniqueName: \"kubernetes.io/projected/2c36809a-ba4f-4824-90a9-72de73029299-kube-api-access-pg9tx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4k2jf\" (UID: \"2c36809a-ba4f-4824-90a9-72de73029299\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:29.612802 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.612771    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e400568f-825e-4ec9-ae78-14ac7648e598-extensions-socket-volume\") pod \"e400568f-825e-4ec9-ae78-14ac7648e598\" (UID: \"e400568f-825e-4ec9-ae78-14ac7648e598\") "
Jul 22 04:36:29.612949 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.612852    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghwlr\" (UniqueName: \"kubernetes.io/projected/e400568f-825e-4ec9-ae78-14ac7648e598-kube-api-access-ghwlr\") pod \"e400568f-825e-4ec9-ae78-14ac7648e598\" (UID: \"e400568f-825e-4ec9-ae78-14ac7648e598\") "
Jul 22 04:36:29.612949 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.612883    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54hng\" (UniqueName: \"kubernetes.io/projected/12953545-a7ee-4ab4-a604-f62da24cdab4-kube-api-access-54hng\") pod \"12953545-a7ee-4ab4-a604-f62da24cdab4\" (UID: \"12953545-a7ee-4ab4-a604-f62da24cdab4\") "
Jul 22 04:36:29.613208 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.613186    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e400568f-825e-4ec9-ae78-14ac7648e598-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e400568f-825e-4ec9-ae78-14ac7648e598" (UID: "e400568f-825e-4ec9-ae78-14ac7648e598"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:36:29.615050 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.615026    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12953545-a7ee-4ab4-a604-f62da24cdab4-kube-api-access-54hng" (OuterVolumeSpecName: "kube-api-access-54hng") pod "12953545-a7ee-4ab4-a604-f62da24cdab4" (UID: "12953545-a7ee-4ab4-a604-f62da24cdab4"). InnerVolumeSpecName "kube-api-access-54hng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:36:29.615285 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.615264    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e400568f-825e-4ec9-ae78-14ac7648e598-kube-api-access-ghwlr" (OuterVolumeSpecName: "kube-api-access-ghwlr") pod "e400568f-825e-4ec9-ae78-14ac7648e598" (UID: "e400568f-825e-4ec9-ae78-14ac7648e598"). InnerVolumeSpecName "kube-api-access-ghwlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:36:29.658211 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.658167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:29.663466 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.663444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"
Jul 22 04:36:29.664730 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.664710    2564 generic.go:356] "Generic (PLEG): container finished" podID="12953545-a7ee-4ab4-a604-f62da24cdab4" containerID="0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0" exitCode=0
Jul 22 04:36:29.664848 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.664784    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.664848 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.664809    2564 scope.go:117] "RemoveContainer" containerID="0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0"
Jul 22 04:36:29.666506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.666419    2564 generic.go:356] "Generic (PLEG): container finished" podID="e400568f-825e-4ec9-ae78-14ac7648e598" containerID="4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922" exitCode=0
Jul 22 04:36:29.666506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.666461    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.667157 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.667134    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.668713 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.668690    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x" container="manager"
Jul 22 04:36:29.669193 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.669154    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.671145 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.671117    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.672981 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.672950    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="753a7dab-9333-41d0-9f62-2556c686f726" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:29.674804 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.674776    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.676825 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.676785    2564 scope.go:117] "RemoveContainer" containerID="0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0"
Jul 22 04:36:29.677114 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.677087    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0\": container with ID starting with 0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0 not found: ID does not exist" containerID="0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0"
Jul 22 04:36:29.677189 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.677128    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0"} err="failed to get container status \"0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0\": rpc error: code = NotFound desc = could not find container \"0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0\": container with ID starting with 0c2abad24510519830fa59262c0411962d0d7e32b044ac36c4f8feb65b124cf0 not found: ID does not exist"
Jul 22 04:36:29.677189 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.677152    2564 scope.go:117] "RemoveContainer" containerID="4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922"
Jul 22 04:36:29.683255 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.683231    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.685182 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.685160    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.687075 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.687051    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="753a7dab-9333-41d0-9f62-2556c686f726" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:29.687842 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.687816    2564 scope.go:117] "RemoveContainer" containerID="4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922"
Jul 22 04:36:29.688112 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.688092    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922\": container with ID starting with 4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922 not found: ID does not exist" containerID="4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922"
Jul 22 04:36:29.688206 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.688119    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922"} err="failed to get container status \"4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922\": rpc error: code = NotFound desc = could not find container \"4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922\": container with ID starting with 4ac918de2b95e212a0433fa3fc093df4935e13e5529a8c74e2b77d6cd1a0c922 not found: ID does not exist"
Jul 22 04:36:29.688924 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.688897    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:29.690702 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.690673    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:29.692667 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:29.692642    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="753a7dab-9333-41d0-9f62-2556c686f726" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:29.714244 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.714187    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e400568f-825e-4ec9-ae78-14ac7648e598-extensions-socket-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:36:29.714244 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.714241    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghwlr\" (UniqueName: \"kubernetes.io/projected/e400568f-825e-4ec9-ae78-14ac7648e598-kube-api-access-ghwlr\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:36:29.714777 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.714257    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54hng\" (UniqueName: \"kubernetes.io/projected/12953545-a7ee-4ab4-a604-f62da24cdab4-kube-api-access-54hng\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:36:29.806483 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.806450    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"]
Jul 22 04:36:29.809709 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:36:29.809682    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c36809a_ba4f_4824_90a9_72de73029299.slice/crio-27ab92456d4539f2449e2e0df639197dbd0c122eff1dacc7760ed11b13cf0174 WatchSource:0}: Error finding container 27ab92456d4539f2449e2e0df639197dbd0c122eff1dacc7760ed11b13cf0174: Status 404 returned error can't find the container with id 27ab92456d4539f2449e2e0df639197dbd0c122eff1dacc7760ed11b13cf0174
Jul 22 04:36:29.824836 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:29.824808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"]
Jul 22 04:36:29.830662 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:36:29.830504    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690e3913_0ccc_4fda_95e4_d11a8d4748a9.slice/crio-a488bb32d7f0111d4df632f4fd887298192a8cc140e8f3e9a05c37938f5e030c WatchSource:0}: Error finding container a488bb32d7f0111d4df632f4fd887298192a8cc140e8f3e9a05c37938f5e030c: Status 404 returned error can't find the container with id a488bb32d7f0111d4df632f4fd887298192a8cc140e8f3e9a05c37938f5e030c
Jul 22 04:36:30.675514 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.675475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9" event={"ID":"690e3913-0ccc-4fda-95e4-d11a8d4748a9","Type":"ContainerStarted","Data":"ac2c31d9a5cabcd3d930a358340c52c289733f1d531abf2b8a30a60ee71d7ee4"}
Jul 22 04:36:30.675973 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.675676    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"
Jul 22 04:36:30.675973 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.675713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9" event={"ID":"690e3913-0ccc-4fda-95e4-d11a8d4748a9","Type":"ContainerStarted","Data":"a488bb32d7f0111d4df632f4fd887298192a8cc140e8f3e9a05c37938f5e030c"}
Jul 22 04:36:30.677142 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.677112    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x" podUID="753a7dab-9333-41d0-9f62-2556c686f726" containerName="manager" containerID="cri-o://8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6" gracePeriod=2
Jul 22 04:36:30.677834 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.677798    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:30.678774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.678753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf" event={"ID":"2c36809a-ba4f-4824-90a9-72de73029299","Type":"ContainerStarted","Data":"4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67"}
Jul 22 04:36:30.678876 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.678802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf" event={"ID":"2c36809a-ba4f-4824-90a9-72de73029299","Type":"ContainerStarted","Data":"27ab92456d4539f2449e2e0df639197dbd0c122eff1dacc7760ed11b13cf0174"}
Jul 22 04:36:30.678876 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.678831    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:30.695076 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.695025    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9" podStartSLOduration=1.695011197 podStartE2EDuration="1.695011197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:36:30.694215306 +0000 UTC m=+705.978080702" watchObservedRunningTime="2026-07-22 04:36:30.695011197 +0000 UTC m=+705.978876591"
Jul 22 04:36:30.696557 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.696535    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:30.698475 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.698454    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="753a7dab-9333-41d0-9f62-2556c686f726" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:30.700479 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.700458    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:30.722053 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.722021    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:30.722248 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.722211    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf" podStartSLOduration=1.7221958320000001 podStartE2EDuration="1.722195832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:36:30.720016028 +0000 UTC m=+706.003881419" watchObservedRunningTime="2026-07-22 04:36:30.722195832 +0000 UTC m=+706.006061281"
Jul 22 04:36:30.724007 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.723984    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="753a7dab-9333-41d0-9f62-2556c686f726" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:30.918384 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:30.918357    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:30.921109 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.921078    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rx6v5\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rx6v5"
Jul 22 04:36:30.923162 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.923136    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="753a7dab-9333-41d0-9f62-2556c686f726" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:30.925098 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:30.925075    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g2htb\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2htb"
Jul 22 04:36:31.025440 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.025409    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg2qb\" (UniqueName: \"kubernetes.io/projected/753a7dab-9333-41d0-9f62-2556c686f726-kube-api-access-hg2qb\") pod \"753a7dab-9333-41d0-9f62-2556c686f726\" (UID: \"753a7dab-9333-41d0-9f62-2556c686f726\") "
Jul 22 04:36:31.025621 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.025501    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753a7dab-9333-41d0-9f62-2556c686f726-extensions-socket-volume\") pod \"753a7dab-9333-41d0-9f62-2556c686f726\" (UID: \"753a7dab-9333-41d0-9f62-2556c686f726\") "
Jul 22 04:36:31.025795 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.025770    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753a7dab-9333-41d0-9f62-2556c686f726-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "753a7dab-9333-41d0-9f62-2556c686f726" (UID: "753a7dab-9333-41d0-9f62-2556c686f726"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:36:31.027401 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.027382    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753a7dab-9333-41d0-9f62-2556c686f726-kube-api-access-hg2qb" (OuterVolumeSpecName: "kube-api-access-hg2qb") pod "753a7dab-9333-41d0-9f62-2556c686f726" (UID: "753a7dab-9333-41d0-9f62-2556c686f726"). InnerVolumeSpecName "kube-api-access-hg2qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:36:31.126906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.126877    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg2qb\" (UniqueName: \"kubernetes.io/projected/753a7dab-9333-41d0-9f62-2556c686f726-kube-api-access-hg2qb\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:36:31.126906 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.126905    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/753a7dab-9333-41d0-9f62-2556c686f726-extensions-socket-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:36:31.170694 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.170652    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12953545-a7ee-4ab4-a604-f62da24cdab4" path="/var/lib/kubelet/pods/12953545-a7ee-4ab4-a604-f62da24cdab4/volumes"
Jul 22 04:36:31.171106 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.171087    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753a7dab-9333-41d0-9f62-2556c686f726" path="/var/lib/kubelet/pods/753a7dab-9333-41d0-9f62-2556c686f726/volumes"
Jul 22 04:36:31.171452 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.171434    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e400568f-825e-4ec9-ae78-14ac7648e598" path="/var/lib/kubelet/pods/e400568f-825e-4ec9-ae78-14ac7648e598/volumes"
Jul 22 04:36:31.684911 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.684877    2564 generic.go:356] "Generic (PLEG): container finished" podID="753a7dab-9333-41d0-9f62-2556c686f726" containerID="8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6" exitCode=2
Jul 22 04:36:31.685339 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.684918    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:31.685339 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.684979    2564 scope.go:117] "RemoveContainer" containerID="8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6"
Jul 22 04:36:31.689813 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:31.689788    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-85l6x\" is forbidden: User \"system:node:ip-10-0-131-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-26.ec2.internal' and this object" podUID="753a7dab-9333-41d0-9f62-2556c686f726" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-85l6x"
Jul 22 04:36:31.693505 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.693484    2564 scope.go:117] "RemoveContainer" containerID="8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6"
Jul 22 04:36:31.693781 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:31.693764    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6\": container with ID starting with 8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6 not found: ID does not exist" containerID="8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6"
Jul 22 04:36:31.693833 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:31.693789    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6"} err="failed to get container status \"8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6\": rpc error: code = NotFound desc = could not find container \"8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6\": container with ID starting with 8a053c66f3bacfb1d07cb0ace1fff0172d081efa32259f924ec94889eff980b6 not found: ID does not exist"
Jul 22 04:36:41.687249 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:41.687163    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-226b9"
Jul 22 04:36:41.687700 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:41.687327    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:56.009347 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.009306    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"]
Jul 22 04:36:56.009832 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.009504    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf" podUID="2c36809a-ba4f-4824-90a9-72de73029299" containerName="manager" containerID="cri-o://4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67" gracePeriod=10
Jul 22 04:36:56.189528 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.189498    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"]
Jul 22 04:36:56.193043 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.193021    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.210169 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.210137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"]
Jul 22 04:36:56.235108 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.235076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97bbx\" (UniqueName: \"kubernetes.io/projected/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-kube-api-access-97bbx\") pod \"kuadrant-operator-controller-manager-86878c769f-6mvwj\" (UID: \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.235280 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.235227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6mvwj\" (UID: \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.253908 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.253879    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:56.336088 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.336001    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c36809a-ba4f-4824-90a9-72de73029299-extensions-socket-volume\") pod \"2c36809a-ba4f-4824-90a9-72de73029299\" (UID: \"2c36809a-ba4f-4824-90a9-72de73029299\") "
Jul 22 04:36:56.336088 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.336048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg9tx\" (UniqueName: \"kubernetes.io/projected/2c36809a-ba4f-4824-90a9-72de73029299-kube-api-access-pg9tx\") pod \"2c36809a-ba4f-4824-90a9-72de73029299\" (UID: \"2c36809a-ba4f-4824-90a9-72de73029299\") "
Jul 22 04:36:56.336319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.336184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6mvwj\" (UID: \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.336319 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.336222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97bbx\" (UniqueName: \"kubernetes.io/projected/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-kube-api-access-97bbx\") pod \"kuadrant-operator-controller-manager-86878c769f-6mvwj\" (UID: \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.336469 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.336444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c36809a-ba4f-4824-90a9-72de73029299-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c36809a-ba4f-4824-90a9-72de73029299" (UID: "2c36809a-ba4f-4824-90a9-72de73029299"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:36:56.336563 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.336543    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6mvwj\" (UID: \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.338578 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.338550    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c36809a-ba4f-4824-90a9-72de73029299-kube-api-access-pg9tx" (OuterVolumeSpecName: "kube-api-access-pg9tx") pod "2c36809a-ba4f-4824-90a9-72de73029299" (UID: "2c36809a-ba4f-4824-90a9-72de73029299"). InnerVolumeSpecName "kube-api-access-pg9tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:36:56.344934 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.344914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97bbx\" (UniqueName: \"kubernetes.io/projected/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-kube-api-access-97bbx\") pod \"kuadrant-operator-controller-manager-86878c769f-6mvwj\" (UID: \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.437170 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.437135    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c36809a-ba4f-4824-90a9-72de73029299-extensions-socket-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:36:56.437170 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.437164    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg9tx\" (UniqueName: \"kubernetes.io/projected/2c36809a-ba4f-4824-90a9-72de73029299-kube-api-access-pg9tx\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:36:56.505307 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.505272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.643943 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.643910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"]
Jul 22 04:36:56.649410 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:36:56.649385    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8995a9_0daf_4e06_a0e2_0fc37ad9d847.slice/crio-8512575b7c45fa6c38ff51b3c255203d99fec3fd3e1b641d724b0be24d79dabd WatchSource:0}: Error finding container 8512575b7c45fa6c38ff51b3c255203d99fec3fd3e1b641d724b0be24d79dabd: Status 404 returned error can't find the container with id 8512575b7c45fa6c38ff51b3c255203d99fec3fd3e1b641d724b0be24d79dabd
Jul 22 04:36:56.793750 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.793703    2564 generic.go:356] "Generic (PLEG): container finished" podID="2c36809a-ba4f-4824-90a9-72de73029299" containerID="4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67" exitCode=0
Jul 22 04:36:56.793937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.793780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"
Jul 22 04:36:56.793937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.793792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf" event={"ID":"2c36809a-ba4f-4824-90a9-72de73029299","Type":"ContainerDied","Data":"4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67"}
Jul 22 04:36:56.793937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.793840    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf" event={"ID":"2c36809a-ba4f-4824-90a9-72de73029299","Type":"ContainerDied","Data":"27ab92456d4539f2449e2e0df639197dbd0c122eff1dacc7760ed11b13cf0174"}
Jul 22 04:36:56.793937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.793869    2564 scope.go:117] "RemoveContainer" containerID="4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67"
Jul 22 04:36:56.795571 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.795546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj" event={"ID":"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847","Type":"ContainerStarted","Data":"c9a7db97da073b9c5616344144deb88b69604175caf025fd79f157262c8c9306"}
Jul 22 04:36:56.795679 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.795596    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj" event={"ID":"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847","Type":"ContainerStarted","Data":"8512575b7c45fa6c38ff51b3c255203d99fec3fd3e1b641d724b0be24d79dabd"}
Jul 22 04:36:56.795723 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.795689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:36:56.802728 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.802711    2564 scope.go:117] "RemoveContainer" containerID="4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67"
Jul 22 04:36:56.802978 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:36:56.802960    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67\": container with ID starting with 4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67 not found: ID does not exist" containerID="4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67"
Jul 22 04:36:56.803034 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.802985    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67"} err="failed to get container status \"4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67\": rpc error: code = NotFound desc = could not find container \"4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67\": container with ID starting with 4c483a71570710c9b5c8f32ea23fa057815a44435a5bd4e858009ba1a64c2a67 not found: ID does not exist"
Jul 22 04:36:56.815858 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.815817    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj" podStartSLOduration=0.815795454 podStartE2EDuration="815.795454ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:36:56.814373925 +0000 UTC m=+732.098239336" watchObservedRunningTime="2026-07-22 04:36:56.815795454 +0000 UTC m=+732.099660891"
Jul 22 04:36:56.826879 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.826858    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"]
Jul 22 04:36:56.834753 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:56.834714    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4k2jf"]
Jul 22 04:36:57.170559 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:36:57.170528    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c36809a-ba4f-4824-90a9-72de73029299" path="/var/lib/kubelet/pods/2c36809a-ba4f-4824-90a9-72de73029299/volumes"
Jul 22 04:37:07.802973 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:07.802937    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:37:12.291891 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.291853    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"]
Jul 22 04:37:12.292259 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.292175    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c36809a-ba4f-4824-90a9-72de73029299" containerName="manager"
Jul 22 04:37:12.292259 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.292186    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c36809a-ba4f-4824-90a9-72de73029299" containerName="manager"
Jul 22 04:37:12.292259 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.292243    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c36809a-ba4f-4824-90a9-72de73029299" containerName="manager"
Jul 22 04:37:12.295389 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.295366    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.297961 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.297938    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 04:37:12.298071 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.297971    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-99nqg\""
Jul 22 04:37:12.307042 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.307016    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"]
Jul 22 04:37:12.378518 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.378518 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4rjs\" (UniqueName: \"kubernetes.io/projected/fc415b1e-575c-4c32-81ee-fc2acd699833-kube-api-access-r4rjs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.378704 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.378704 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.378704 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc415b1e-575c-4c32-81ee-fc2acd699833-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.378704 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.378898 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.378898 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.378898 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.378816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.479893 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.479861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.479893 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.479897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480122 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.479916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480122 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.479934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480122 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.479958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4rjs\" (UniqueName: \"kubernetes.io/projected/fc415b1e-575c-4c32-81ee-fc2acd699833-kube-api-access-r4rjs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480122 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.479987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480122 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.480032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480122 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.480062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc415b1e-575c-4c32-81ee-fc2acd699833-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480122 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.480099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480453 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.480321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480453 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.480362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480555 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.480509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480604 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.480575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.480791 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.480774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc415b1e-575c-4c32-81ee-fc2acd699833-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.482834 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.482806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.482989 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.482971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.487425 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.487401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc415b1e-575c-4c32-81ee-fc2acd699833-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.487630 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.487614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4rjs\" (UniqueName: \"kubernetes.io/projected/fc415b1e-575c-4c32-81ee-fc2acd699833-kube-api-access-r4rjs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5n4q\" (UID: \"fc415b1e-575c-4c32-81ee-fc2acd699833\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.606901 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.606801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:12.746126 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.746095    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"]
Jul 22 04:37:12.748154 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:37:12.748129    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc415b1e_575c_4c32_81ee_fc2acd699833.slice/crio-da6952bf85a49e1771c5e8ec8e0c7ea43b405e00c8c39fbcc800ef49b46b0950 WatchSource:0}: Error finding container da6952bf85a49e1771c5e8ec8e0c7ea43b405e00c8c39fbcc800ef49b46b0950: Status 404 returned error can't find the container with id da6952bf85a49e1771c5e8ec8e0c7ea43b405e00c8c39fbcc800ef49b46b0950
Jul 22 04:37:12.866666 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:12.866577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" event={"ID":"fc415b1e-575c-4c32-81ee-fc2acd699833","Type":"ContainerStarted","Data":"da6952bf85a49e1771c5e8ec8e0c7ea43b405e00c8c39fbcc800ef49b46b0950"}
Jul 22 04:37:15.533793 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:15.533746    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:37:15.534072 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:15.533827    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:37:15.534072 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:15.533857    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:37:15.885003 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:15.884919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" event={"ID":"fc415b1e-575c-4c32-81ee-fc2acd699833","Type":"ContainerStarted","Data":"31fed2ebb6e2f71b32d2d97457d120f2c827107fd71b9f0fc77382f024455232"}
Jul 22 04:37:15.905177 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:15.905120    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" podStartSLOduration=1.121868303 podStartE2EDuration="3.905105132s" totalImagesPullingTime="2.783236829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:37:15.903092593 +0000 UTC m=+751.186957979" watchObservedRunningTime="2026-07-22 04:37:15.905105132 +0000 UTC m=+751.188970528"
Jul 22 04:37:16.607687 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:16.607653    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:16.612132 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:16.612108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:16.890351 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:16.890273    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:16.891304 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:16.891286    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:37:17.715520 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:17.715485    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7mlp7"]
Jul 22 04:37:17.719070 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:17.719050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7mlp7"
Jul 22 04:37:17.721344 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:17.721324    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c6jjg\""
Jul 22 04:37:17.725416 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:17.725391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7mlp7"]
Jul 22 04:37:17.825904 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:17.825862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2sg\" (UniqueName: \"kubernetes.io/projected/046328f9-f867-4d4c-b34b-c0831af329be-kube-api-access-wk2sg\") pod \"authorino-58cd955675-7mlp7\" (UID: \"046328f9-f867-4d4c-b34b-c0831af329be\") " pod="kuadrant-system/authorino-58cd955675-7mlp7"
Jul 22 04:37:17.926460 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:17.926422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2sg\" (UniqueName: \"kubernetes.io/projected/046328f9-f867-4d4c-b34b-c0831af329be-kube-api-access-wk2sg\") pod \"authorino-58cd955675-7mlp7\" (UID: \"046328f9-f867-4d4c-b34b-c0831af329be\") " pod="kuadrant-system/authorino-58cd955675-7mlp7"
Jul 22 04:37:17.934150 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:17.934122    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2sg\" (UniqueName: \"kubernetes.io/projected/046328f9-f867-4d4c-b34b-c0831af329be-kube-api-access-wk2sg\") pod \"authorino-58cd955675-7mlp7\" (UID: \"046328f9-f867-4d4c-b34b-c0831af329be\") " pod="kuadrant-system/authorino-58cd955675-7mlp7"
Jul 22 04:37:18.030347 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:18.030315    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7mlp7"
Jul 22 04:37:18.156958 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:18.156928    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7mlp7"]
Jul 22 04:37:18.160451 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:37:18.160425    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod046328f9_f867_4d4c_b34b_c0831af329be.slice/crio-cf50938fb6c1aa87d19d70c6eecfab2e8665d7e4bda7b053ce8034bbf67248a9 WatchSource:0}: Error finding container cf50938fb6c1aa87d19d70c6eecfab2e8665d7e4bda7b053ce8034bbf67248a9: Status 404 returned error can't find the container with id cf50938fb6c1aa87d19d70c6eecfab2e8665d7e4bda7b053ce8034bbf67248a9
Jul 22 04:37:18.900690 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:18.900656    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7mlp7" event={"ID":"046328f9-f867-4d4c-b34b-c0831af329be","Type":"ContainerStarted","Data":"cf50938fb6c1aa87d19d70c6eecfab2e8665d7e4bda7b053ce8034bbf67248a9"}
Jul 22 04:37:21.917991 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:21.917714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7mlp7" event={"ID":"046328f9-f867-4d4c-b34b-c0831af329be","Type":"ContainerStarted","Data":"c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe"}
Jul 22 04:37:21.932013 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:21.931958    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7mlp7" podStartSLOduration=1.695732907 podStartE2EDuration="4.931943672s" totalImagesPullingTime="3.236210765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:37:21.930166726 +0000 UTC m=+757.214032121" watchObservedRunningTime="2026-07-22 04:37:21.931943672 +0000 UTC m=+757.215809068"
Jul 22 04:37:23.203666 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:23.203635    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7mlp7"]
Jul 22 04:37:23.927623 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:23.927579    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7mlp7" podUID="046328f9-f867-4d4c-b34b-c0831af329be" containerName="authorino" containerID="cri-o://c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe" gracePeriod=30
Jul 22 04:37:24.177039 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.177010    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7mlp7"
Jul 22 04:37:24.283290 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.283256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk2sg\" (UniqueName: \"kubernetes.io/projected/046328f9-f867-4d4c-b34b-c0831af329be-kube-api-access-wk2sg\") pod \"046328f9-f867-4d4c-b34b-c0831af329be\" (UID: \"046328f9-f867-4d4c-b34b-c0831af329be\") "
Jul 22 04:37:24.285341 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.285321    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/046328f9-f867-4d4c-b34b-c0831af329be-kube-api-access-wk2sg" (OuterVolumeSpecName: "kube-api-access-wk2sg") pod "046328f9-f867-4d4c-b34b-c0831af329be" (UID: "046328f9-f867-4d4c-b34b-c0831af329be"). InnerVolumeSpecName "kube-api-access-wk2sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:37:24.384056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.384008    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk2sg\" (UniqueName: \"kubernetes.io/projected/046328f9-f867-4d4c-b34b-c0831af329be-kube-api-access-wk2sg\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:37:24.932665 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.932625    2564 generic.go:356] "Generic (PLEG): container finished" podID="046328f9-f867-4d4c-b34b-c0831af329be" containerID="c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe" exitCode=0
Jul 22 04:37:24.932665 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.932668    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7mlp7"
Jul 22 04:37:24.932902 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.932670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7mlp7" event={"ID":"046328f9-f867-4d4c-b34b-c0831af329be","Type":"ContainerDied","Data":"c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe"}
Jul 22 04:37:24.932902 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.932710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7mlp7" event={"ID":"046328f9-f867-4d4c-b34b-c0831af329be","Type":"ContainerDied","Data":"cf50938fb6c1aa87d19d70c6eecfab2e8665d7e4bda7b053ce8034bbf67248a9"}
Jul 22 04:37:24.932902 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.932749    2564 scope.go:117] "RemoveContainer" containerID="c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe"
Jul 22 04:37:24.941189 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.941165    2564 scope.go:117] "RemoveContainer" containerID="c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe"
Jul 22 04:37:24.941431 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:37:24.941412    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe\": container with ID starting with c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe not found: ID does not exist" containerID="c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe"
Jul 22 04:37:24.941473 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.941440    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe"} err="failed to get container status \"c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe\": rpc error: code = NotFound desc = could not find container \"c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe\": container with ID starting with c4ff50f7ddf036eb728108a4fa193ffa01632c031090240716784e08a064fdbe not found: ID does not exist"
Jul 22 04:37:24.952270 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.952247    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7mlp7"]
Jul 22 04:37:24.954025 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:24.954006    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7mlp7"]
Jul 22 04:37:25.170782 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:25.170750    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="046328f9-f867-4d4c-b34b-c0831af329be" path="/var/lib/kubelet/pods/046328f9-f867-4d4c-b34b-c0831af329be/volumes"
Jul 22 04:37:33.338157 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.338119    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"]
Jul 22 04:37:33.338640 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.338625    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="046328f9-f867-4d4c-b34b-c0831af329be" containerName="authorino"
Jul 22 04:37:33.338717 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.338643    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="046328f9-f867-4d4c-b34b-c0831af329be" containerName="authorino"
Jul 22 04:37:33.338773 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.338718    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="046328f9-f867-4d4c-b34b-c0831af329be" containerName="authorino"
Jul 22 04:37:33.343301 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.343277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:33.345829 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.345809    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 04:37:33.346891 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.346873    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 04:37:33.346968 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.346898    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-8q2hh\""
Jul 22 04:37:33.346968 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.346926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 04:37:33.349368 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.349344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c06ea0f3-19d2-4416-b04c-b3627b0dcf4c-data\") pod \"postgres-69fb4594cf-4mnzp\" (UID: \"c06ea0f3-19d2-4416-b04c-b3627b0dcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:33.349605 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.349586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqg2\" (UniqueName: \"kubernetes.io/projected/c06ea0f3-19d2-4416-b04c-b3627b0dcf4c-kube-api-access-hhqg2\") pod \"postgres-69fb4594cf-4mnzp\" (UID: \"c06ea0f3-19d2-4416-b04c-b3627b0dcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:33.351276 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.351190    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"]
Jul 22 04:37:33.450857 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.450822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c06ea0f3-19d2-4416-b04c-b3627b0dcf4c-data\") pod \"postgres-69fb4594cf-4mnzp\" (UID: \"c06ea0f3-19d2-4416-b04c-b3627b0dcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:33.451047 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.450959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqg2\" (UniqueName: \"kubernetes.io/projected/c06ea0f3-19d2-4416-b04c-b3627b0dcf4c-kube-api-access-hhqg2\") pod \"postgres-69fb4594cf-4mnzp\" (UID: \"c06ea0f3-19d2-4416-b04c-b3627b0dcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:33.451262 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.451239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c06ea0f3-19d2-4416-b04c-b3627b0dcf4c-data\") pod \"postgres-69fb4594cf-4mnzp\" (UID: \"c06ea0f3-19d2-4416-b04c-b3627b0dcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:33.459453 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.459429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqg2\" (UniqueName: \"kubernetes.io/projected/c06ea0f3-19d2-4416-b04c-b3627b0dcf4c-kube-api-access-hhqg2\") pod \"postgres-69fb4594cf-4mnzp\" (UID: \"c06ea0f3-19d2-4416-b04c-b3627b0dcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:33.653628 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.653539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:33.779688 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.779667    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"]
Jul 22 04:37:33.782066 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:37:33.782042    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06ea0f3_19d2_4416_b04c_b3627b0dcf4c.slice/crio-5a7edfc54c770930d51ab8706f586208800223e7c0a5bdc14b5749bd4412a259 WatchSource:0}: Error finding container 5a7edfc54c770930d51ab8706f586208800223e7c0a5bdc14b5749bd4412a259: Status 404 returned error can't find the container with id 5a7edfc54c770930d51ab8706f586208800223e7c0a5bdc14b5749bd4412a259
Jul 22 04:37:33.974887 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:33.974804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp" event={"ID":"c06ea0f3-19d2-4416-b04c-b3627b0dcf4c","Type":"ContainerStarted","Data":"5a7edfc54c770930d51ab8706f586208800223e7c0a5bdc14b5749bd4412a259"}
Jul 22 04:37:39.003034 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:39.002995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp" event={"ID":"c06ea0f3-19d2-4416-b04c-b3627b0dcf4c","Type":"ContainerStarted","Data":"6222783414ec5be9c8f3429fb9f40d9ac16480e4e959d137af486abc65e90ac7"}
Jul 22 04:37:39.003423 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:39.003074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:39.020753 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:39.020686    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp" podStartSLOduration=1.212840967 podStartE2EDuration="6.020670907s" totalImagesPullingTime="4.80782994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:37:39.019521823 +0000 UTC m=+774.303387237" watchObservedRunningTime="2026-07-22 04:37:39.020670907 +0000 UTC m=+774.304536302"
Jul 22 04:37:45.038491 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:45.038465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4mnzp"
Jul 22 04:37:51.929949 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:51.929917    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-rnm44"]
Jul 22 04:37:51.934821 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:51.934796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:51.937608 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:51.937584    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 04:37:51.937742 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:51.937584    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xfh4m\""
Jul 22 04:37:51.937742 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:51.937632    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 04:37:51.943324 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:51.943301    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-rnm44"]
Jul 22 04:37:52.012779 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:52.012723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/957dd243-1609-4113-9cee-16bc01a2b439-webhook-cert\") pod \"maas-controller-58cbd5b4c4-rnm44\" (UID: \"957dd243-1609-4113-9cee-16bc01a2b439\") " pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:52.012970 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:52.012889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jx4z\" (UniqueName: \"kubernetes.io/projected/957dd243-1609-4113-9cee-16bc01a2b439-kube-api-access-7jx4z\") pod \"maas-controller-58cbd5b4c4-rnm44\" (UID: \"957dd243-1609-4113-9cee-16bc01a2b439\") " pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:52.113342 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:52.113301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jx4z\" (UniqueName: \"kubernetes.io/projected/957dd243-1609-4113-9cee-16bc01a2b439-kube-api-access-7jx4z\") pod \"maas-controller-58cbd5b4c4-rnm44\" (UID: \"957dd243-1609-4113-9cee-16bc01a2b439\") " pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:52.113498 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:52.113383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/957dd243-1609-4113-9cee-16bc01a2b439-webhook-cert\") pod \"maas-controller-58cbd5b4c4-rnm44\" (UID: \"957dd243-1609-4113-9cee-16bc01a2b439\") " pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:52.115891 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:52.115865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/957dd243-1609-4113-9cee-16bc01a2b439-webhook-cert\") pod \"maas-controller-58cbd5b4c4-rnm44\" (UID: \"957dd243-1609-4113-9cee-16bc01a2b439\") " pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:52.121722 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:52.121688    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jx4z\" (UniqueName: \"kubernetes.io/projected/957dd243-1609-4113-9cee-16bc01a2b439-kube-api-access-7jx4z\") pod \"maas-controller-58cbd5b4c4-rnm44\" (UID: \"957dd243-1609-4113-9cee-16bc01a2b439\") " pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:52.246092 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:52.246054    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:52.402067 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:52.402042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-rnm44"]
Jul 22 04:37:52.404046 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:37:52.404014    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957dd243_1609_4113_9cee_16bc01a2b439.slice/crio-8e4505d5d269e87b3c1f98aacc4cc866878ae594e530a7729c0d9cc00e95ac27 WatchSource:0}: Error finding container 8e4505d5d269e87b3c1f98aacc4cc866878ae594e530a7729c0d9cc00e95ac27: Status 404 returned error can't find the container with id 8e4505d5d269e87b3c1f98aacc4cc866878ae594e530a7729c0d9cc00e95ac27
Jul 22 04:37:53.066620 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:53.066577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44" event={"ID":"957dd243-1609-4113-9cee-16bc01a2b439","Type":"ContainerStarted","Data":"8e4505d5d269e87b3c1f98aacc4cc866878ae594e530a7729c0d9cc00e95ac27"}
Jul 22 04:37:55.080236 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:55.080200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44" event={"ID":"957dd243-1609-4113-9cee-16bc01a2b439","Type":"ContainerStarted","Data":"36bd138f299770e0dd2a76882c546ac3fc82ff86ba5219e5652a454debeddc45"}
Jul 22 04:37:55.080611 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:55.080326    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:37:55.114120 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:37:55.114060    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44" podStartSLOduration=2.021393519 podStartE2EDuration="4.114045232s" totalImagesPullingTime="2.092651713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:37:55.113759831 +0000 UTC m=+790.397625223" watchObservedRunningTime="2026-07-22 04:37:55.114045232 +0000 UTC m=+790.397910627"
Jul 22 04:38:06.087407 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:06.087376    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:38:26.403163 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.403127    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"]
Jul 22 04:38:26.409846 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.409824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:26.412542 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.412518    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 04:38:26.415026 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.415000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"]
Jul 22 04:38:26.517784 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.517721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1454bef6-8b27-4579-828f-192f25d381de-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gvg6g\" (UID: \"1454bef6-8b27-4579-828f-192f25d381de\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:26.517964 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.517808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68h8s\" (UniqueName: \"kubernetes.io/projected/1454bef6-8b27-4579-828f-192f25d381de-kube-api-access-68h8s\") pod \"payload-pre-processing-7677b774bb-gvg6g\" (UID: \"1454bef6-8b27-4579-828f-192f25d381de\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:26.619186 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.619150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1454bef6-8b27-4579-828f-192f25d381de-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gvg6g\" (UID: \"1454bef6-8b27-4579-828f-192f25d381de\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:26.619380 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.619201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68h8s\" (UniqueName: \"kubernetes.io/projected/1454bef6-8b27-4579-828f-192f25d381de-kube-api-access-68h8s\") pod \"payload-pre-processing-7677b774bb-gvg6g\" (UID: \"1454bef6-8b27-4579-828f-192f25d381de\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:26.619956 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.619934    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1454bef6-8b27-4579-828f-192f25d381de-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gvg6g\" (UID: \"1454bef6-8b27-4579-828f-192f25d381de\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:26.627840 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.627806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68h8s\" (UniqueName: \"kubernetes.io/projected/1454bef6-8b27-4579-828f-192f25d381de-kube-api-access-68h8s\") pod \"payload-pre-processing-7677b774bb-gvg6g\" (UID: \"1454bef6-8b27-4579-828f-192f25d381de\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:26.722252 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.722161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:26.875754 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:26.875706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"]
Jul 22 04:38:26.877991 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:38:26.877964    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1454bef6_8b27_4579_828f_192f25d381de.slice/crio-1a39730b189168269900abb0d8a1b5d279fe61aef631e04ec0132a909f5a287b WatchSource:0}: Error finding container 1a39730b189168269900abb0d8a1b5d279fe61aef631e04ec0132a909f5a287b: Status 404 returned error can't find the container with id 1a39730b189168269900abb0d8a1b5d279fe61aef631e04ec0132a909f5a287b
Jul 22 04:38:27.221214 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:27.221170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g" event={"ID":"1454bef6-8b27-4579-828f-192f25d381de","Type":"ContainerStarted","Data":"1a39730b189168269900abb0d8a1b5d279fe61aef631e04ec0132a909f5a287b"}
Jul 22 04:38:30.250582 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:30.250547    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g" event={"ID":"1454bef6-8b27-4579-828f-192f25d381de","Type":"ContainerStarted","Data":"ec15ba5ae798afe2a0e456370d7f66b0db7b77d4f9043a355030dd14557d57d7"}
Jul 22 04:38:30.251014 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:30.250677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:30.265170 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:30.265122    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g" podStartSLOduration=1.501429686 podStartE2EDuration="4.265109082s" totalImagesPullingTime="2.763679396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:38:30.263702794 +0000 UTC m=+825.547568189" watchObservedRunningTime="2026-07-22 04:38:30.265109082 +0000 UTC m=+825.548974477"
Jul 22 04:38:32.932933 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:32.932892    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5n4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 04:38:32.933317 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:32.932957    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" podUID="fc415b1e-575c-4c32-81ee-fc2acd699833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 04:38:34.271057 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:34.271018    2564 generic.go:356] "Generic (PLEG): container finished" podID="fc415b1e-575c-4c32-81ee-fc2acd699833" containerID="31fed2ebb6e2f71b32d2d97457d120f2c827107fd71b9f0fc77382f024455232" exitCode=0
Jul 22 04:38:34.271579 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:34.271069    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" event={"ID":"fc415b1e-575c-4c32-81ee-fc2acd699833","Type":"ContainerDied","Data":"31fed2ebb6e2f71b32d2d97457d120f2c827107fd71b9f0fc77382f024455232"}
Jul 22 04:38:34.271579 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:34.271566    2564 scope.go:117] "RemoveContainer" containerID="31fed2ebb6e2f71b32d2d97457d120f2c827107fd71b9f0fc77382f024455232"
Jul 22 04:38:34.272610 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:34.272574    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:38:34.272691 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:34.272648    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:38:34.272691 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:34.272679    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:38:35.276781 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:35.276750    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" event={"ID":"fc415b1e-575c-4c32-81ee-fc2acd699833","Type":"ContainerStarted","Data":"2d24df06806b8070bea848321a2c7c105e2ee38ff028ffadc06973ae65ebdfa7"}
Jul 22 04:38:35.607525 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:35.607436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:38:35.607719 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:35.607697    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5n4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 22 04:38:35.607805 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:35.607787    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" podUID="fc415b1e-575c-4c32-81ee-fc2acd699833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 22 04:38:36.607335 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:36.607297    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5n4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 22 04:38:36.607769 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:36.607351    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" podUID="fc415b1e-575c-4c32-81ee-fc2acd699833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 22 04:38:37.607824 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:37.607794    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5n4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 22 04:38:37.608204 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:37.607848    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" podUID="fc415b1e-575c-4c32-81ee-fc2acd699833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 22 04:38:38.607792 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:38.607728    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5n4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 22 04:38:38.607976 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:38.607815    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q" podUID="fc415b1e-575c-4c32-81ee-fc2acd699833" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 22 04:38:39.610823 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:39.610791    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:38:39.611200 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:39.611051    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:38:39.611764 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:39.611729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5n4q"
Jul 22 04:38:41.257915 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:41.257886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-gvg6g"
Jul 22 04:38:45.161465 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.161424    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"]
Jul 22 04:38:45.165485 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.165452    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.170130 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.170106    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 04:38:45.171178 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.171160    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 22 04:38:45.171276 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.171225    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qkdmg\""
Jul 22 04:38:45.171384 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.171368    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 04:38:45.177082 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.177057    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"]
Jul 22 04:38:45.202232 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.202200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.202399 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.202242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.202399 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.202324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.202399 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.202389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dqc\" (UniqueName: \"kubernetes.io/projected/e3b566fd-7ac5-4975-aece-8924bd9005a6-kube-api-access-j7dqc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.202524 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.202439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3b566fd-7ac5-4975-aece-8924bd9005a6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.202524 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.202488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303035 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.302994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303226 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.303049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303226 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.303074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303226 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.303136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303226 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.303168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dqc\" (UniqueName: \"kubernetes.io/projected/e3b566fd-7ac5-4975-aece-8924bd9005a6-kube-api-access-j7dqc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303226 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.303218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3b566fd-7ac5-4975-aece-8924bd9005a6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303508 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.303454    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303637 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.303515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.303637 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.303535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.305414 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.305384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3b566fd-7ac5-4975-aece-8924bd9005a6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.305700 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.305681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3b566fd-7ac5-4975-aece-8924bd9005a6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.311783 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.311729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dqc\" (UniqueName: \"kubernetes.io/projected/e3b566fd-7ac5-4975-aece-8924bd9005a6-kube-api-access-j7dqc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xx8pp\" (UID: \"e3b566fd-7ac5-4975-aece-8924bd9005a6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.479045 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.478966    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:45.618859 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:45.618816    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"]
Jul 22 04:38:45.621621 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:38:45.621597    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b566fd_7ac5_4975_aece_8924bd9005a6.slice/crio-c848c48ca0c1cc52462c11cefc03ed25ac82c6a49447780847f12c93a536d85f WatchSource:0}: Error finding container c848c48ca0c1cc52462c11cefc03ed25ac82c6a49447780847f12c93a536d85f: Status 404 returned error can't find the container with id c848c48ca0c1cc52462c11cefc03ed25ac82c6a49447780847f12c93a536d85f
Jul 22 04:38:46.337754 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:46.337693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp" event={"ID":"e3b566fd-7ac5-4975-aece-8924bd9005a6","Type":"ContainerStarted","Data":"c848c48ca0c1cc52462c11cefc03ed25ac82c6a49447780847f12c93a536d85f"}
Jul 22 04:38:47.345170 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:47.345132    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp" event={"ID":"e3b566fd-7ac5-4975-aece-8924bd9005a6","Type":"ContainerStarted","Data":"4282e69ec1b8c11c9831685733fe5db546fcb17f2fc411b049bfdc14dd8ff986"}
Jul 22 04:38:47.362012 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:47.361963    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp" podStartSLOduration=1.347647396 podStartE2EDuration="2.361948848s" totalImagesPullingTime="1.014301452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:38:47.360376689 +0000 UTC m=+842.644242086" watchObservedRunningTime="2026-07-22 04:38:47.361948848 +0000 UTC m=+842.645814306"
Jul 22 04:38:51.975157 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:51.975117    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"]
Jul 22 04:38:51.978940 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:51.978915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:51.981266 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:51.981244    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 04:38:51.985566 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:51.985534    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"]
Jul 22 04:38:52.071001 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.070957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.071001 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.071005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.071196 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.071057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.071196 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.071091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.071196 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.071175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.071294 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.071227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf24s\" (UniqueName: \"kubernetes.io/projected/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-kube-api-access-hf24s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172310 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172477 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf24s\" (UniqueName: \"kubernetes.io/projected/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-kube-api-access-hf24s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172477 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172477 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172611 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172611 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172712 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172901 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.172965 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.172905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.174570 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.174550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.174850 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.174834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.180976 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.180947    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf24s\" (UniqueName: \"kubernetes.io/projected/da29f7ae-9ad2-4074-af3f-23a555a6d9ec-kube-api-access-hf24s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lt9jl\" (UID: \"da29f7ae-9ad2-4074-af3f-23a555a6d9ec\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.290207 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.290171    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:38:52.431838 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:52.431797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"]
Jul 22 04:38:52.434683 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:38:52.434655    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda29f7ae_9ad2_4074_af3f_23a555a6d9ec.slice/crio-b48b4dd1c77215e14a6fcc37ed530acd8ebf3db8a5e45ef8512ed1490623d61c WatchSource:0}: Error finding container b48b4dd1c77215e14a6fcc37ed530acd8ebf3db8a5e45ef8512ed1490623d61c: Status 404 returned error can't find the container with id b48b4dd1c77215e14a6fcc37ed530acd8ebf3db8a5e45ef8512ed1490623d61c
Jul 22 04:38:53.379086 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:53.379047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl" event={"ID":"da29f7ae-9ad2-4074-af3f-23a555a6d9ec","Type":"ContainerStarted","Data":"d82c9cd5fa59be3a068a78713014d973a4cbb724b10ff29f36eb3c112b3a3a2d"}
Jul 22 04:38:53.379465 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:53.379109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl" event={"ID":"da29f7ae-9ad2-4074-af3f-23a555a6d9ec","Type":"ContainerStarted","Data":"b48b4dd1c77215e14a6fcc37ed530acd8ebf3db8a5e45ef8512ed1490623d61c"}
Jul 22 04:38:53.398052 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:53.397970    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl" podStartSLOduration=2.229537325 podStartE2EDuration="2.397952114s" totalImagesPullingTime="168.414789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:38:53.397622421 +0000 UTC m=+848.681487820" watchObservedRunningTime="2026-07-22 04:38:53.397952114 +0000 UTC m=+848.681817511"
Jul 22 04:38:55.479228 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:55.479172    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:55.479667 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:55.479253    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:55.491842 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:55.491811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:38:56.405140 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:38:56.405106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xx8pp"
Jul 22 04:39:02.290724 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:39:02.290690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:39:02.291167 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:39:02.290764    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:39:02.303554 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:39:02.303525    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:39:02.440031 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:39:02.439995    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lt9jl"
Jul 22 04:39:45.093538 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:39:45.093458    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:39:45.094502 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:39:45.094485    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:40:53.726552 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:53.726515    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-rnm44"]
Jul 22 04:40:53.727199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:53.726705    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44" podUID="957dd243-1609-4113-9cee-16bc01a2b439" containerName="manager" containerID="cri-o://36bd138f299770e0dd2a76882c546ac3fc82ff86ba5219e5652a454debeddc45" gracePeriod=30
Jul 22 04:40:53.938968 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:53.938932    2564 generic.go:356] "Generic (PLEG): container finished" podID="957dd243-1609-4113-9cee-16bc01a2b439" containerID="36bd138f299770e0dd2a76882c546ac3fc82ff86ba5219e5652a454debeddc45" exitCode=0
Jul 22 04:40:53.939150 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:53.939004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44" event={"ID":"957dd243-1609-4113-9cee-16bc01a2b439","Type":"ContainerDied","Data":"36bd138f299770e0dd2a76882c546ac3fc82ff86ba5219e5652a454debeddc45"}
Jul 22 04:40:53.978828 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:53.978763    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:40:54.129124 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.129083    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jx4z\" (UniqueName: \"kubernetes.io/projected/957dd243-1609-4113-9cee-16bc01a2b439-kube-api-access-7jx4z\") pod \"957dd243-1609-4113-9cee-16bc01a2b439\" (UID: \"957dd243-1609-4113-9cee-16bc01a2b439\") "
Jul 22 04:40:54.129322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.129191    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/957dd243-1609-4113-9cee-16bc01a2b439-webhook-cert\") pod \"957dd243-1609-4113-9cee-16bc01a2b439\" (UID: \"957dd243-1609-4113-9cee-16bc01a2b439\") "
Jul 22 04:40:54.131292 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.131259    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/957dd243-1609-4113-9cee-16bc01a2b439-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "957dd243-1609-4113-9cee-16bc01a2b439" (UID: "957dd243-1609-4113-9cee-16bc01a2b439"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:40:54.131397 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.131330    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/957dd243-1609-4113-9cee-16bc01a2b439-kube-api-access-7jx4z" (OuterVolumeSpecName: "kube-api-access-7jx4z") pod "957dd243-1609-4113-9cee-16bc01a2b439" (UID: "957dd243-1609-4113-9cee-16bc01a2b439"). InnerVolumeSpecName "kube-api-access-7jx4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:40:54.230129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.230027    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/957dd243-1609-4113-9cee-16bc01a2b439-webhook-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:40:54.230129 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.230065    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jx4z\" (UniqueName: \"kubernetes.io/projected/957dd243-1609-4113-9cee-16bc01a2b439-kube-api-access-7jx4z\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:40:54.945364 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.945329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44" event={"ID":"957dd243-1609-4113-9cee-16bc01a2b439","Type":"ContainerDied","Data":"8e4505d5d269e87b3c1f98aacc4cc866878ae594e530a7729c0d9cc00e95ac27"}
Jul 22 04:40:54.945781 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.945392    2564 scope.go:117] "RemoveContainer" containerID="36bd138f299770e0dd2a76882c546ac3fc82ff86ba5219e5652a454debeddc45"
Jul 22 04:40:54.945781 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.945346    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-rnm44"
Jul 22 04:40:54.966374 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.966337    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-rnm44"]
Jul 22 04:40:54.969523 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:54.969497    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-rnm44"]
Jul 22 04:40:55.171516 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:40:55.171474    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="957dd243-1609-4113-9cee-16bc01a2b439" path="/var/lib/kubelet/pods/957dd243-1609-4113-9cee-16bc01a2b439/volumes"
Jul 22 04:41:55.731210 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.731156    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-xcchc"]
Jul 22 04:41:55.731790 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.731716    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957dd243-1609-4113-9cee-16bc01a2b439" containerName="manager"
Jul 22 04:41:55.731790 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.731756    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="957dd243-1609-4113-9cee-16bc01a2b439" containerName="manager"
Jul 22 04:41:55.731918 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.731850    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="957dd243-1609-4113-9cee-16bc01a2b439" containerName="manager"
Jul 22 04:41:55.736025 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.736005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:55.740311 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.740282    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xfh4m\""
Jul 22 04:41:55.740431 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.740396    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 04:41:55.740779 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.740759    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 04:41:55.743036 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.742930    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-xcchc"]
Jul 22 04:41:55.891182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.891143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-webhook-cert\") pod \"maas-controller-58cbd5b4c4-xcchc\" (UID: \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\") " pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:55.891182 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.891185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5mbk\" (UniqueName: \"kubernetes.io/projected/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-kube-api-access-m5mbk\") pod \"maas-controller-58cbd5b4c4-xcchc\" (UID: \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\") " pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:55.992322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.992290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mbk\" (UniqueName: \"kubernetes.io/projected/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-kube-api-access-m5mbk\") pod \"maas-controller-58cbd5b4c4-xcchc\" (UID: \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\") " pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:55.992484 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.992406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-webhook-cert\") pod \"maas-controller-58cbd5b4c4-xcchc\" (UID: \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\") " pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:55.994827 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:55.994803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-webhook-cert\") pod \"maas-controller-58cbd5b4c4-xcchc\" (UID: \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\") " pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:56.000433 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:56.000396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5mbk\" (UniqueName: \"kubernetes.io/projected/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-kube-api-access-m5mbk\") pod \"maas-controller-58cbd5b4c4-xcchc\" (UID: \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\") " pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:56.049419 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:56.049384    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:56.182371 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:56.182345    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-xcchc"]
Jul 22 04:41:56.184901 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:41:56.184876    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ed2e49_f894_4c81_83ee_4a7ca179ea7f.slice/crio-fc83f544e3a3d099fab97740ca6645d44ec629668c21a64a48808ba0ee13bd7d WatchSource:0}: Error finding container fc83f544e3a3d099fab97740ca6645d44ec629668c21a64a48808ba0ee13bd7d: Status 404 returned error can't find the container with id fc83f544e3a3d099fab97740ca6645d44ec629668c21a64a48808ba0ee13bd7d
Jul 22 04:41:56.186334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:56.186317    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:41:56.246756 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:56.246649    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc" event={"ID":"38ed2e49-f894-4c81-83ee-4a7ca179ea7f","Type":"ContainerStarted","Data":"fc83f544e3a3d099fab97740ca6645d44ec629668c21a64a48808ba0ee13bd7d"}
Jul 22 04:41:57.252256 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:57.252218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc" event={"ID":"38ed2e49-f894-4c81-83ee-4a7ca179ea7f","Type":"ContainerStarted","Data":"0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a"}
Jul 22 04:41:57.252696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:57.252286    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:41:57.268851 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:41:57.268806    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc" podStartSLOduration=1.899091443 podStartE2EDuration="2.268790321s" totalImagesPullingTime="369.698878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:41:57.267297313 +0000 UTC m=+1032.551162709" watchObservedRunningTime="2026-07-22 04:41:57.268790321 +0000 UTC m=+1032.552655722"
Jul 22 04:42:08.259680 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:08.259651    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:42:12.862186 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:12.862149    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-xcchc"]
Jul 22 04:42:12.862634 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:12.862382    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc" podUID="38ed2e49-f894-4c81-83ee-4a7ca179ea7f" containerName="manager" containerID="cri-o://0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a" gracePeriod=30
Jul 22 04:42:13.118202 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.118137    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:42:13.244128 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.244093    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-webhook-cert\") pod \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\" (UID: \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\") "
Jul 22 04:42:13.244128 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.244134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5mbk\" (UniqueName: \"kubernetes.io/projected/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-kube-api-access-m5mbk\") pod \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\" (UID: \"38ed2e49-f894-4c81-83ee-4a7ca179ea7f\") "
Jul 22 04:42:13.246616 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.246584    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-kube-api-access-m5mbk" (OuterVolumeSpecName: "kube-api-access-m5mbk") pod "38ed2e49-f894-4c81-83ee-4a7ca179ea7f" (UID: "38ed2e49-f894-4c81-83ee-4a7ca179ea7f"). InnerVolumeSpecName "kube-api-access-m5mbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:42:13.246802 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.246786    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "38ed2e49-f894-4c81-83ee-4a7ca179ea7f" (UID: "38ed2e49-f894-4c81-83ee-4a7ca179ea7f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:42:13.323366 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.323323    2564 generic.go:356] "Generic (PLEG): container finished" podID="38ed2e49-f894-4c81-83ee-4a7ca179ea7f" containerID="0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a" exitCode=0
Jul 22 04:42:13.323571 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.323374    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc"
Jul 22 04:42:13.323571 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.323392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc" event={"ID":"38ed2e49-f894-4c81-83ee-4a7ca179ea7f","Type":"ContainerDied","Data":"0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a"}
Jul 22 04:42:13.323571 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.323511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-xcchc" event={"ID":"38ed2e49-f894-4c81-83ee-4a7ca179ea7f","Type":"ContainerDied","Data":"fc83f544e3a3d099fab97740ca6645d44ec629668c21a64a48808ba0ee13bd7d"}
Jul 22 04:42:13.323571 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.323542    2564 scope.go:117] "RemoveContainer" containerID="0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a"
Jul 22 04:42:13.332334 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.332312    2564 scope.go:117] "RemoveContainer" containerID="0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a"
Jul 22 04:42:13.332593 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:42:13.332570    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a\": container with ID starting with 0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a not found: ID does not exist" containerID="0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a"
Jul 22 04:42:13.332641 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.332608    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a"} err="failed to get container status \"0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a\": rpc error: code = NotFound desc = could not find container \"0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a\": container with ID starting with 0eae25553b07c57130e0615ab532de479fb755901fa9ac28562fc45ae705f46a not found: ID does not exist"
Jul 22 04:42:13.343322 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.343293    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-xcchc"]
Jul 22 04:42:13.346079 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.346056    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-webhook-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:42:13.346079 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.346080    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5mbk\" (UniqueName: \"kubernetes.io/projected/38ed2e49-f894-4c81-83ee-4a7ca179ea7f-kube-api-access-m5mbk\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:42:13.346482 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:13.346464    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-xcchc"]
Jul 22 04:42:14.076337 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.076300    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-m7lvb"]
Jul 22 04:42:14.076823 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.076658    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ed2e49-f894-4c81-83ee-4a7ca179ea7f" containerName="manager"
Jul 22 04:42:14.076823 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.076670    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ed2e49-f894-4c81-83ee-4a7ca179ea7f" containerName="manager"
Jul 22 04:42:14.076823 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.076749    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ed2e49-f894-4c81-83ee-4a7ca179ea7f" containerName="manager"
Jul 22 04:42:14.081023 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.081004    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:14.084723 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.084699    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 04:42:14.084869 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.084758    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 04:42:14.084869 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.084826    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xfh4m\""
Jul 22 04:42:14.087786 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.087758    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-m7lvb"]
Jul 22 04:42:14.153795 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.153729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef5c3e59-4193-4300-b62d-1e185f0b23d1-webhook-cert\") pod \"maas-controller-58cbd5b4c4-m7lvb\" (UID: \"ef5c3e59-4193-4300-b62d-1e185f0b23d1\") " pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:14.153958 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.153897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj6v7\" (UniqueName: \"kubernetes.io/projected/ef5c3e59-4193-4300-b62d-1e185f0b23d1-kube-api-access-nj6v7\") pod \"maas-controller-58cbd5b4c4-m7lvb\" (UID: \"ef5c3e59-4193-4300-b62d-1e185f0b23d1\") " pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:14.254531 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.254495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef5c3e59-4193-4300-b62d-1e185f0b23d1-webhook-cert\") pod \"maas-controller-58cbd5b4c4-m7lvb\" (UID: \"ef5c3e59-4193-4300-b62d-1e185f0b23d1\") " pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:14.254712 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.254572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj6v7\" (UniqueName: \"kubernetes.io/projected/ef5c3e59-4193-4300-b62d-1e185f0b23d1-kube-api-access-nj6v7\") pod \"maas-controller-58cbd5b4c4-m7lvb\" (UID: \"ef5c3e59-4193-4300-b62d-1e185f0b23d1\") " pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:14.256949 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.256930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef5c3e59-4193-4300-b62d-1e185f0b23d1-webhook-cert\") pod \"maas-controller-58cbd5b4c4-m7lvb\" (UID: \"ef5c3e59-4193-4300-b62d-1e185f0b23d1\") " pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:14.263287 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.263261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj6v7\" (UniqueName: \"kubernetes.io/projected/ef5c3e59-4193-4300-b62d-1e185f0b23d1-kube-api-access-nj6v7\") pod \"maas-controller-58cbd5b4c4-m7lvb\" (UID: \"ef5c3e59-4193-4300-b62d-1e185f0b23d1\") " pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:14.393256 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.393156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:14.526435 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:14.526401    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd5b4c4-m7lvb"]
Jul 22 04:42:14.529819 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:42:14.529791    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5c3e59_4193_4300_b62d_1e185f0b23d1.slice/crio-d4baddc9043f142aad36d9c9ae50053c6f9d054654f37b9f06a46bf02c808f84 WatchSource:0}: Error finding container d4baddc9043f142aad36d9c9ae50053c6f9d054654f37b9f06a46bf02c808f84: Status 404 returned error can't find the container with id d4baddc9043f142aad36d9c9ae50053c6f9d054654f37b9f06a46bf02c808f84
Jul 22 04:42:15.172328 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:15.172244    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ed2e49-f894-4c81-83ee-4a7ca179ea7f" path="/var/lib/kubelet/pods/38ed2e49-f894-4c81-83ee-4a7ca179ea7f/volumes"
Jul 22 04:42:15.334231 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:15.334197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb" event={"ID":"ef5c3e59-4193-4300-b62d-1e185f0b23d1","Type":"ContainerStarted","Data":"84e4a76084500e568ae250a318d0c4f765105fc63a01d403dd67d6d7011ae76e"}
Jul 22 04:42:15.334414 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:15.334260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb" event={"ID":"ef5c3e59-4193-4300-b62d-1e185f0b23d1","Type":"ContainerStarted","Data":"d4baddc9043f142aad36d9c9ae50053c6f9d054654f37b9f06a46bf02c808f84"}
Jul 22 04:42:15.334414 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:15.334290    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:42:15.349165 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:15.349101    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb" podStartSLOduration=0.980310414 podStartE2EDuration="1.34908445s" totalImagesPullingTime="368.774036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:42:15.347445101 +0000 UTC m=+1050.631310496" watchObservedRunningTime="2026-07-22 04:42:15.34908445 +0000 UTC m=+1050.632949844"
Jul 22 04:42:26.340881 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:42:26.340844    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58cbd5b4c4-m7lvb"
Jul 22 04:44:45.129393 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:44:45.129361    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:44:45.131961 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:44:45.130697    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:46:59.182819 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:46:59.182777    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"]
Jul 22 04:46:59.183454 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:46:59.182989    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj" podUID="5d8995a9-0daf-4e06-a0e2-0fc37ad9d847" containerName="manager" containerID="cri-o://c9a7db97da073b9c5616344144deb88b69604175caf025fd79f157262c8c9306" gracePeriod=10
Jul 22 04:47:02.680224 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:02.680188    2564 generic.go:356] "Generic (PLEG): container finished" podID="5d8995a9-0daf-4e06-a0e2-0fc37ad9d847" containerID="c9a7db97da073b9c5616344144deb88b69604175caf025fd79f157262c8c9306" exitCode=0
Jul 22 04:47:02.680604 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:02.680247    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj" event={"ID":"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847","Type":"ContainerDied","Data":"c9a7db97da073b9c5616344144deb88b69604175caf025fd79f157262c8c9306"}
Jul 22 04:47:03.143621 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.143594    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:47:03.201826 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.201786    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97bbx\" (UniqueName: \"kubernetes.io/projected/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-kube-api-access-97bbx\") pod \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\" (UID: \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\") "
Jul 22 04:47:03.202001 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.201845    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-extensions-socket-volume\") pod \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\" (UID: \"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847\") "
Jul 22 04:47:03.202219 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.202190    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5d8995a9-0daf-4e06-a0e2-0fc37ad9d847" (UID: "5d8995a9-0daf-4e06-a0e2-0fc37ad9d847"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:47:03.203907 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.203880    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-kube-api-access-97bbx" (OuterVolumeSpecName: "kube-api-access-97bbx") pod "5d8995a9-0daf-4e06-a0e2-0fc37ad9d847" (UID: "5d8995a9-0daf-4e06-a0e2-0fc37ad9d847"). InnerVolumeSpecName "kube-api-access-97bbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:47:03.303019 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.302938    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97bbx\" (UniqueName: \"kubernetes.io/projected/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-kube-api-access-97bbx\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:47:03.303019 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.302965    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847-extensions-socket-volume\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:47:03.686298 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.686213    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"
Jul 22 04:47:03.686298 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.686247    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj" event={"ID":"5d8995a9-0daf-4e06-a0e2-0fc37ad9d847","Type":"ContainerDied","Data":"8512575b7c45fa6c38ff51b3c255203d99fec3fd3e1b641d724b0be24d79dabd"}
Jul 22 04:47:03.686771 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.686302    2564 scope.go:117] "RemoveContainer" containerID="c9a7db97da073b9c5616344144deb88b69604175caf025fd79f157262c8c9306"
Jul 22 04:47:03.707010 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.706980    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"]
Jul 22 04:47:03.712330 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:03.712306    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6mvwj"]
Jul 22 04:47:05.170808 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:47:05.170776    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d8995a9-0daf-4e06-a0e2-0fc37ad9d847" path="/var/lib/kubelet/pods/5d8995a9-0daf-4e06-a0e2-0fc37ad9d847/volumes"
Jul 22 04:48:00.274237 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.274200    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"]
Jul 22 04:48:00.274625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.274553    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d8995a9-0daf-4e06-a0e2-0fc37ad9d847" containerName="manager"
Jul 22 04:48:00.274625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.274563    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d8995a9-0daf-4e06-a0e2-0fc37ad9d847" containerName="manager"
Jul 22 04:48:00.274625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.274625    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d8995a9-0daf-4e06-a0e2-0fc37ad9d847" containerName="manager"
Jul 22 04:48:00.278846 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.278829    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.281255 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.281237    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bjcws\""
Jul 22 04:48:00.290718 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.290688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"]
Jul 22 04:48:00.315691 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.315659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f602906-71e5-467e-95a1-4ebb044f020e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9n8gj\" (UID: \"7f602906-71e5-467e-95a1-4ebb044f020e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.315847 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.315697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xpf6\" (UniqueName: \"kubernetes.io/projected/7f602906-71e5-467e-95a1-4ebb044f020e-kube-api-access-4xpf6\") pod \"kuadrant-operator-controller-manager-86878c769f-9n8gj\" (UID: \"7f602906-71e5-467e-95a1-4ebb044f020e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.416496 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.416459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f602906-71e5-467e-95a1-4ebb044f020e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9n8gj\" (UID: \"7f602906-71e5-467e-95a1-4ebb044f020e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.416496 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.416500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xpf6\" (UniqueName: \"kubernetes.io/projected/7f602906-71e5-467e-95a1-4ebb044f020e-kube-api-access-4xpf6\") pod \"kuadrant-operator-controller-manager-86878c769f-9n8gj\" (UID: \"7f602906-71e5-467e-95a1-4ebb044f020e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.416948 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.416924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f602906-71e5-467e-95a1-4ebb044f020e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9n8gj\" (UID: \"7f602906-71e5-467e-95a1-4ebb044f020e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.426489 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.426466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xpf6\" (UniqueName: \"kubernetes.io/projected/7f602906-71e5-467e-95a1-4ebb044f020e-kube-api-access-4xpf6\") pod \"kuadrant-operator-controller-manager-86878c769f-9n8gj\" (UID: \"7f602906-71e5-467e-95a1-4ebb044f020e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.588762 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.588676    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.730780 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.730750    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"]
Jul 22 04:48:00.732573 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:48:00.732543    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f602906_71e5_467e_95a1_4ebb044f020e.slice/crio-9c0980217a829a628b61a8845e086711d5870826335f109c1fe5285213c48fae WatchSource:0}: Error finding container 9c0980217a829a628b61a8845e086711d5870826335f109c1fe5285213c48fae: Status 404 returned error can't find the container with id 9c0980217a829a628b61a8845e086711d5870826335f109c1fe5285213c48fae
Jul 22 04:48:00.960727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.960640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj" event={"ID":"7f602906-71e5-467e-95a1-4ebb044f020e","Type":"ContainerStarted","Data":"81d25c1573e1eed7381078e74c9450bf6f36aab71dfa24d4f92f689b3db2ffc5"}
Jul 22 04:48:00.960727 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.960692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj" event={"ID":"7f602906-71e5-467e-95a1-4ebb044f020e","Type":"ContainerStarted","Data":"9c0980217a829a628b61a8845e086711d5870826335f109c1fe5285213c48fae"}
Jul 22 04:48:00.960941 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.960775    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:48:00.980474 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:00.980419    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj" podStartSLOduration=0.980399695 podStartE2EDuration="980.399695ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:48:00.97911037 +0000 UTC m=+1396.262975775" watchObservedRunningTime="2026-07-22 04:48:00.980399695 +0000 UTC m=+1396.264265090"
Jul 22 04:48:11.968125 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:48:11.968093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9n8gj"
Jul 22 04:49:45.158797 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:49:45.158663    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:49:45.162749 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:49:45.161591    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:50:47.400698 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.400665    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"]
Jul 22 04:50:47.404070 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.404048    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.409837 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.409812    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4f9fb706-kserve-self-signed-certs\""
Jul 22 04:50:47.420084 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.420052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"]
Jul 22 04:50:47.501361 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.501324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-home\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.501361 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.501364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tls-certs\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.501625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.501396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-dshm\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.501625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.501462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xcss\" (UniqueName: \"kubernetes.io/projected/7e9e3f4e-4fa7-47c2-a173-365ad665c441-kube-api-access-9xcss\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.501625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.501549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-model-cache\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.501625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.501615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tmp-dir\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.602774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.602711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-home\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.602774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.602779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tls-certs\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.603032 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.602812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-dshm\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.603032 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.602842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xcss\" (UniqueName: \"kubernetes.io/projected/7e9e3f4e-4fa7-47c2-a173-365ad665c441-kube-api-access-9xcss\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.603032 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.602891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-model-cache\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.603032 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.602943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tmp-dir\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.603265 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.603130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-home\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.603309 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.603262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-model-cache\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.603309 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.603268    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tmp-dir\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.605110 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.605087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-dshm\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.605355 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.605336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tls-certs\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.610477 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.610455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xcss\" (UniqueName: \"kubernetes.io/projected/7e9e3f4e-4fa7-47c2-a173-365ad665c441-kube-api-access-9xcss\") pod \"e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") " pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.713144 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.712839    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:47.851284 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:47.851263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"]
Jul 22 04:50:47.853548 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:50:47.853521    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e9e3f4e_4fa7_47c2_a173_365ad665c441.slice/crio-c52c2dd8f436c03f6fb5250b824220976ea175b4c529e9b2477b5e332e9b6059 WatchSource:0}: Error finding container c52c2dd8f436c03f6fb5250b824220976ea175b4c529e9b2477b5e332e9b6059: Status 404 returned error can't find the container with id c52c2dd8f436c03f6fb5250b824220976ea175b4c529e9b2477b5e332e9b6059
Jul 22 04:50:48.777680 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:48.777641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn" event={"ID":"7e9e3f4e-4fa7-47c2-a173-365ad665c441","Type":"ContainerStarted","Data":"2fb2d9d98c09fba3023b6294b023a3fa0544bd426e85a8ccfb9427d25a002e1c"}
Jul 22 04:50:48.777680 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:48.777683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn" event={"ID":"7e9e3f4e-4fa7-47c2-a173-365ad665c441","Type":"ContainerStarted","Data":"c52c2dd8f436c03f6fb5250b824220976ea175b4c529e9b2477b5e332e9b6059"}
Jul 22 04:50:48.793925 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:48.793872    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn" podStartSLOduration=1.7938539850000002 podStartE2EDuration="1.793853985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:50:48.79310548 +0000 UTC m=+1564.076970876" watchObservedRunningTime="2026-07-22 04:50:48.793853985 +0000 UTC m=+1564.077719382"
Jul 22 04:50:57.713168 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:57.713129    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:57.713592 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:57.713182    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:57.725777 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:57.725749    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:50:57.833164 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:50:57.833135    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:51:24.846274 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:24.846238    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"]
Jul 22 04:51:39.867147 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:39.867054    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn" podUID="7e9e3f4e-4fa7-47c2-a173-365ad665c441" containerName="main" containerID="cri-o://2fb2d9d98c09fba3023b6294b023a3fa0544bd426e85a8ccfb9427d25a002e1c" gracePeriod=45
Jul 22 04:51:40.011673 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.011625    2564 generic.go:356] "Generic (PLEG): container finished" podID="7e9e3f4e-4fa7-47c2-a173-365ad665c441" containerID="2fb2d9d98c09fba3023b6294b023a3fa0544bd426e85a8ccfb9427d25a002e1c" exitCode=0
Jul 22 04:51:40.011864 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.011696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn" event={"ID":"7e9e3f4e-4fa7-47c2-a173-365ad665c441","Type":"ContainerDied","Data":"2fb2d9d98c09fba3023b6294b023a3fa0544bd426e85a8ccfb9427d25a002e1c"}
Jul 22 04:51:40.121946 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.121886    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:51:40.272430 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272349    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-model-cache\") pod \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") "
Jul 22 04:51:40.272430 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272385    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-dshm\") pod \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") "
Jul 22 04:51:40.272430 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-home\") pod \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") "
Jul 22 04:51:40.272430 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272431    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tmp-dir\") pod \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") "
Jul 22 04:51:40.272808 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272474    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xcss\" (UniqueName: \"kubernetes.io/projected/7e9e3f4e-4fa7-47c2-a173-365ad665c441-kube-api-access-9xcss\") pod \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") "
Jul 22 04:51:40.272808 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272536    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tls-certs\") pod \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\" (UID: \"7e9e3f4e-4fa7-47c2-a173-365ad665c441\") "
Jul 22 04:51:40.272808 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272678    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e9e3f4e-4fa7-47c2-a173-365ad665c441" (UID: "7e9e3f4e-4fa7-47c2-a173-365ad665c441"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:51:40.272808 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272717    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-home" (OuterVolumeSpecName: "home") pod "7e9e3f4e-4fa7-47c2-a173-365ad665c441" (UID: "7e9e3f4e-4fa7-47c2-a173-365ad665c441"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:51:40.272808 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e9e3f4e-4fa7-47c2-a173-365ad665c441" (UID: "7e9e3f4e-4fa7-47c2-a173-365ad665c441"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:51:40.273057 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272835    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:51:40.273057 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.272854    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:51:40.274644 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.274616    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-dshm" (OuterVolumeSpecName: "dshm") pod "7e9e3f4e-4fa7-47c2-a173-365ad665c441" (UID: "7e9e3f4e-4fa7-47c2-a173-365ad665c441"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:51:40.274644 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.274641    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e9e3f4e-4fa7-47c2-a173-365ad665c441" (UID: "7e9e3f4e-4fa7-47c2-a173-365ad665c441"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:51:40.274812 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.274685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e9e3f4e-4fa7-47c2-a173-365ad665c441-kube-api-access-9xcss" (OuterVolumeSpecName: "kube-api-access-9xcss") pod "7e9e3f4e-4fa7-47c2-a173-365ad665c441" (UID: "7e9e3f4e-4fa7-47c2-a173-365ad665c441"). InnerVolumeSpecName "kube-api-access-9xcss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:51:40.373551 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.373463    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:51:40.373551 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.373493    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:51:40.373551 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.373502    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e9e3f4e-4fa7-47c2-a173-365ad665c441-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:51:40.373551 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:40.373510    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xcss\" (UniqueName: \"kubernetes.io/projected/7e9e3f4e-4fa7-47c2-a173-365ad665c441-kube-api-access-9xcss\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:51:41.017633 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:41.017597    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn" event={"ID":"7e9e3f4e-4fa7-47c2-a173-365ad665c441","Type":"ContainerDied","Data":"c52c2dd8f436c03f6fb5250b824220976ea175b4c529e9b2477b5e332e9b6059"}
Jul 22 04:51:41.018100 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:41.017639    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"
Jul 22 04:51:41.018100 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:41.017651    2564 scope.go:117] "RemoveContainer" containerID="2fb2d9d98c09fba3023b6294b023a3fa0544bd426e85a8ccfb9427d25a002e1c"
Jul 22 04:51:41.042681 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:41.042655    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"]
Jul 22 04:51:41.044195 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:41.044173    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4f9fb706-kserve-566dc44c55-ptmwn"]
Jul 22 04:51:41.171908 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:51:41.171874    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e9e3f4e-4fa7-47c2-a173-365ad665c441" path="/var/lib/kubelet/pods/7e9e3f4e-4fa7-47c2-a173-365ad665c441/volumes"
Jul 22 04:54:45.186356 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:54:45.186251    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:54:45.192228 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:54:45.190809    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:55:02.094504 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.094465    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"]
Jul 22 04:55:02.094888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.094870    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e9e3f4e-4fa7-47c2-a173-365ad665c441" containerName="main"
Jul 22 04:55:02.094888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.094883    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e9e3f4e-4fa7-47c2-a173-365ad665c441" containerName="main"
Jul 22 04:55:02.094959 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.094940    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e9e3f4e-4fa7-47c2-a173-365ad665c441" containerName="main"
Jul 22 04:55:02.097951 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.097935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.101329 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.101311    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e1453556-openshift-default-dockercfg-tl8zk\""
Jul 22 04:55:02.121089 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.121058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"]
Jul 22 04:55:02.178723 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.178693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-credential-socket\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.178910 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.178729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcnrw\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-kube-api-access-vcnrw\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.178910 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.178807    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-socket\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.178910 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.178826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-data\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.178910 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.178854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c075d589-c42d-412d-8636-720ad2ce57c5-istio-podinfo\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.178910 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.178886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-certs\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.178910 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.178911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-envoy\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.179526 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.178995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-istio-token\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.179526 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.179054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c075d589-c42d-412d-8636-720ad2ce57c5-istiod-ca-cert\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.279541 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-certs\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.279541 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-envoy\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.279839 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-istio-token\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.279839 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c075d589-c42d-412d-8636-720ad2ce57c5-istiod-ca-cert\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.279839 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-credential-socket\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.279839 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnrw\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-kube-api-access-vcnrw\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.280068 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-socket\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.280068 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-data\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.280068 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.279938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c075d589-c42d-412d-8636-720ad2ce57c5-istio-podinfo\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.280273 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.280254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-certs\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.280357 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.280336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-credential-socket\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.280413 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.280377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-data\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.280470 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.280456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-socket\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.280652 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.280633    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c075d589-c42d-412d-8636-720ad2ce57c5-istiod-ca-cert\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.281953 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.281928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-envoy\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.282555 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.282536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c075d589-c42d-412d-8636-720ad2ce57c5-istio-podinfo\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.288437 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.288411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-istio-token\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.288655 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.288623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcnrw\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-kube-api-access-vcnrw\") pod \"e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") " pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.408422 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.408325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:02.554624 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.554598    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"]
Jul 22 04:55:02.557113 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:55:02.557083    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc075d589_c42d_412d_8636_720ad2ce57c5.slice/crio-3ae684b3f32367a01e19d5dec1c4f50b9c68b251bbd27de42405119ef126dc4b WatchSource:0}: Error finding container 3ae684b3f32367a01e19d5dec1c4f50b9c68b251bbd27de42405119ef126dc4b: Status 404 returned error can't find the container with id 3ae684b3f32367a01e19d5dec1c4f50b9c68b251bbd27de42405119ef126dc4b
Jul 22 04:55:02.559260 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.559229    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:55:02.559325 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.559316    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:55:02.559363 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.559348    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:55:02.954036 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.953997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" event={"ID":"c075d589-c42d-412d-8636-720ad2ce57c5","Type":"ContainerStarted","Data":"81ace3c30410d2120138491bd5e6dabf37f5c3a60c36eac5b1e70f3189b8b252"}
Jul 22 04:55:02.954235 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.954048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" event={"ID":"c075d589-c42d-412d-8636-720ad2ce57c5","Type":"ContainerStarted","Data":"3ae684b3f32367a01e19d5dec1c4f50b9c68b251bbd27de42405119ef126dc4b"}
Jul 22 04:55:02.972642 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:02.972560    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" podStartSLOduration=0.972542646 podStartE2EDuration="972.542646ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:55:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:55:02.971072901 +0000 UTC m=+1818.254938308" watchObservedRunningTime="2026-07-22 04:55:02.972542646 +0000 UTC m=+1818.256408042"
Jul 22 04:55:03.408981 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:03.408945    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:03.414545 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:03.414512    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:03.958283 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:03.958252    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:03.959126 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:03.959103    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:16.020217 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:16.020174    2564 generic.go:356] "Generic (PLEG): container finished" podID="c075d589-c42d-412d-8636-720ad2ce57c5" containerID="81ace3c30410d2120138491bd5e6dabf37f5c3a60c36eac5b1e70f3189b8b252" exitCode=0
Jul 22 04:55:16.020788 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:16.020248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" event={"ID":"c075d589-c42d-412d-8636-720ad2ce57c5","Type":"ContainerDied","Data":"81ace3c30410d2120138491bd5e6dabf37f5c3a60c36eac5b1e70f3189b8b252"}
Jul 22 04:55:16.020871 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:16.020786    2564 scope.go:117] "RemoveContainer" containerID="81ace3c30410d2120138491bd5e6dabf37f5c3a60c36eac5b1e70f3189b8b252"
Jul 22 04:55:16.021863 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:16.021832    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:55:16.021968 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:16.021924    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:55:16.022037 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:16.021973    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:55:17.031574 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:17.031528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" event={"ID":"c075d589-c42d-412d-8636-720ad2ce57c5","Type":"ContainerStarted","Data":"21f458af5e5061e865088606ea29b3afc043cc114a8a5aa25c6a8b44714f1b87"}
Jul 22 04:55:17.408664 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:17.408573    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:17.410044 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:17.410020    2564 patch_prober.go:28] interesting pod/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 04:55:17.410117 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:17.410072    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 04:55:18.409030 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:18.408989    2564 patch_prober.go:28] interesting pod/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 04:55:18.409426 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:18.409054    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 04:55:18.959212 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:18.959179    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:19.409214 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:19.409178    2564 patch_prober.go:28] interesting pod/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 04:55:19.409624 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:19.409238    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 04:55:20.409793 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:20.409755    2564 patch_prober.go:28] interesting pod/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 04:55:20.410194 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:20.409812    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 04:55:21.413143 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:21.413111    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:21.414263 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:21.414240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:45.002831 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:45.002793    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"]
Jul 22 04:55:45.003312 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:45.003058    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy" containerID="cri-o://21f458af5e5061e865088606ea29b3afc043cc114a8a5aa25c6a8b44714f1b87" gracePeriod=30
Jul 22 04:55:50.195406 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.195368    2564 generic.go:356] "Generic (PLEG): container finished" podID="c075d589-c42d-412d-8636-720ad2ce57c5" containerID="21f458af5e5061e865088606ea29b3afc043cc114a8a5aa25c6a8b44714f1b87" exitCode=0
Jul 22 04:55:50.195874 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.195462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" event={"ID":"c075d589-c42d-412d-8636-720ad2ce57c5","Type":"ContainerDied","Data":"21f458af5e5061e865088606ea29b3afc043cc114a8a5aa25c6a8b44714f1b87"}
Jul 22 04:55:50.195874 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.195532    2564 scope.go:117] "RemoveContainer" containerID="81ace3c30410d2120138491bd5e6dabf37f5c3a60c36eac5b1e70f3189b8b252"
Jul 22 04:55:50.260360 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.260330    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:50.342888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.342793    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-envoy\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.342888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.342830    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-istio-token\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.342888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.342873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c075d589-c42d-412d-8636-720ad2ce57c5-istiod-ca-cert\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.343167 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.342905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-socket\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.343167 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.342928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-data\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.343167 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.342945    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-certs\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.343167 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.342982    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-credential-socket\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.343167 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343040    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcnrw\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-kube-api-access-vcnrw\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.343167 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c075d589-c42d-412d-8636-720ad2ce57c5-istio-podinfo\") pod \"c075d589-c42d-412d-8636-720ad2ce57c5\" (UID: \"c075d589-c42d-412d-8636-720ad2ce57c5\") "
Jul 22 04:55:50.343464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343241    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:55:50.343464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343264    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:55:50.343464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343416    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c075d589-c42d-412d-8636-720ad2ce57c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:55:50.343464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343429    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:55:50.343464 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343424    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:50.343724 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343477    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:50.343830 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.343803    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:55:50.345154 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.345126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:55:50.345317 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.345295    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c075d589-c42d-412d-8636-720ad2ce57c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 04:55:50.345372 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.345303    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-kube-api-access-vcnrw" (OuterVolumeSpecName: "kube-api-access-vcnrw") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "kube-api-access-vcnrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:55:50.345372 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.345359    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c075d589-c42d-412d-8636-720ad2ce57c5" (UID: "c075d589-c42d-412d-8636-720ad2ce57c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:55:50.444125 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.444095    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:50.444125 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.444123    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:50.444125 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.444132    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcnrw\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-kube-api-access-vcnrw\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:50.444371 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.444142    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c075d589-c42d-412d-8636-720ad2ce57c5-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:50.444371 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.444151    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c075d589-c42d-412d-8636-720ad2ce57c5-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:50.444371 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.444158    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c075d589-c42d-412d-8636-720ad2ce57c5-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:50.444371 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:50.444165    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c075d589-c42d-412d-8636-720ad2ce57c5-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:55:51.200759 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:51.200717    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k" event={"ID":"c075d589-c42d-412d-8636-720ad2ce57c5","Type":"ContainerDied","Data":"3ae684b3f32367a01e19d5dec1c4f50b9c68b251bbd27de42405119ef126dc4b"}
Jul 22 04:55:51.200759 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:51.200764    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"
Jul 22 04:55:51.201216 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:51.200787    2564 scope.go:117] "RemoveContainer" containerID="21f458af5e5061e865088606ea29b3afc043cc114a8a5aa25c6a8b44714f1b87"
Jul 22 04:55:51.219982 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:51.219950    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"]
Jul 22 04:55:51.223394 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:51.223368    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e1453556-openshift-default-757b8bdbb7-ffn6k"]
Jul 22 04:55:53.171119 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:55:53.171085    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" path="/var/lib/kubelet/pods/c075d589-c42d-412d-8636-720ad2ce57c5/volumes"
Jul 22 04:56:13.044543 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.044505    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"]
Jul 22 04:56:13.044954 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.044940    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy"
Jul 22 04:56:13.044999 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.044955    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy"
Jul 22 04:56:13.044999 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.044974    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy"
Jul 22 04:56:13.044999 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.044982    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy"
Jul 22 04:56:13.045090 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.045042    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy"
Jul 22 04:56:13.049596 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.049577    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"
Jul 22 04:56:13.052380 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.052355    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 04:56:13.054118 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.054093    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"]
Jul 22 04:56:13.150114 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.150076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b742fe-3174-4c3b-882d-6c5fd31c1097-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp\" (UID: \"44b742fe-3174-4c3b-882d-6c5fd31c1097\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"
Jul 22 04:56:13.250661 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.250618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b742fe-3174-4c3b-882d-6c5fd31c1097-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp\" (UID: \"44b742fe-3174-4c3b-882d-6c5fd31c1097\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"
Jul 22 04:56:13.251312 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.251287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b742fe-3174-4c3b-882d-6c5fd31c1097-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp\" (UID: \"44b742fe-3174-4c3b-882d-6c5fd31c1097\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"
Jul 22 04:56:13.362404 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.362306    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"
Jul 22 04:56:13.702490 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.702381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"]
Jul 22 04:56:13.706047 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:56:13.706014    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b742fe_3174_4c3b_882d_6c5fd31c1097.slice/crio-d450a18ab113470620570e2bf13475c11c1abee921873360685a561e37d23109 WatchSource:0}: Error finding container d450a18ab113470620570e2bf13475c11c1abee921873360685a561e37d23109: Status 404 returned error can't find the container with id d450a18ab113470620570e2bf13475c11c1abee921873360685a561e37d23109
Jul 22 04:56:13.707968 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:13.707949    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:56:14.309920 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:14.309874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp" event={"ID":"44b742fe-3174-4c3b-882d-6c5fd31c1097","Type":"ContainerStarted","Data":"d450a18ab113470620570e2bf13475c11c1abee921873360685a561e37d23109"}
Jul 22 04:56:16.322114 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:16.322010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp" event={"ID":"44b742fe-3174-4c3b-882d-6c5fd31c1097","Type":"ContainerStarted","Data":"40c8fa5f973e3203f7a62e3b8c963d342d9ff0dc266e2c3a025f2f848cb80543"}
Jul 22 04:56:16.339265 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:16.339218    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp" podStartSLOduration=1.343882604 podStartE2EDuration="3.339202574s" totalImagesPullingTime="1.99531997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:56:16.337562972 +0000 UTC m=+1891.621428370" watchObservedRunningTime="2026-07-22 04:56:16.339202574 +0000 UTC m=+1891.623067968"
Jul 22 04:56:17.328288 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:17.328251    2564 generic.go:356] "Generic (PLEG): container finished" podID="44b742fe-3174-4c3b-882d-6c5fd31c1097" containerID="40c8fa5f973e3203f7a62e3b8c963d342d9ff0dc266e2c3a025f2f848cb80543" exitCode=0
Jul 22 04:56:17.328656 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:17.328330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp" event={"ID":"44b742fe-3174-4c3b-882d-6c5fd31c1097","Type":"ContainerDied","Data":"40c8fa5f973e3203f7a62e3b8c963d342d9ff0dc266e2c3a025f2f848cb80543"}
Jul 22 04:56:18.467041 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:18.467014    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"
Jul 22 04:56:18.492769 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:18.492720    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b742fe-3174-4c3b-882d-6c5fd31c1097-maas-api-service-ca\") pod \"44b742fe-3174-4c3b-882d-6c5fd31c1097\" (UID: \"44b742fe-3174-4c3b-882d-6c5fd31c1097\") "
Jul 22 04:56:18.493149 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:18.493118    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44b742fe-3174-4c3b-882d-6c5fd31c1097-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "44b742fe-3174-4c3b-882d-6c5fd31c1097" (UID: "44b742fe-3174-4c3b-882d-6c5fd31c1097"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:56:18.594041 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:18.593934    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b742fe-3174-4c3b-882d-6c5fd31c1097-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:56:19.338484 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:19.338453    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"
Jul 22 04:56:19.338484 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:19.338480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp" event={"ID":"44b742fe-3174-4c3b-882d-6c5fd31c1097","Type":"ContainerDied","Data":"d450a18ab113470620570e2bf13475c11c1abee921873360685a561e37d23109"}
Jul 22 04:56:19.338726 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:19.338528    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d450a18ab113470620570e2bf13475c11c1abee921873360685a561e37d23109"
Jul 22 04:56:28.120075 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.120019    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"]
Jul 22 04:56:28.121793 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.121769    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-90fa15ea-gp4qp"]
Jul 22 04:56:28.985555 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.985511    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"]
Jul 22 04:56:28.986071 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.986053    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b742fe-3174-4c3b-882d-6c5fd31c1097" containerName="revoke-keys"
Jul 22 04:56:28.986071 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.986072    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b742fe-3174-4c3b-882d-6c5fd31c1097" containerName="revoke-keys"
Jul 22 04:56:28.986199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.986151    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c075d589-c42d-412d-8636-720ad2ce57c5" containerName="istio-proxy"
Jul 22 04:56:28.986199 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.986164    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b742fe-3174-4c3b-882d-6c5fd31c1097" containerName="revoke-keys"
Jul 22 04:56:28.989314 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.989294    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:28.991776 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.991758    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e7529972-openshift-default-dockercfg-rwr6r\""
Jul 22 04:56:28.999514 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:28.999489    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"]
Jul 22 04:56:29.070202 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070166    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-socket\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.070202 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-token\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.070442 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070237    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnztn\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-kube-api-access-qnztn\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.070442 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-certs\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.070442 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-envoy\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.070442 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istiod-ca-cert\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.070442 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070423    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-data\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.070638 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-podinfo\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.070638 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.070501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-credential-socket\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171348 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-data\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-podinfo\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-credential-socket\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-socket\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171498    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-token\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnztn\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-kube-api-access-qnztn\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-certs\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-envoy\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istiod-ca-cert\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.171841 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-data\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.172328 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.171927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-credential-socket\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.172328 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.172076    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-socket\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.172328 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.172184    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b742fe-3174-4c3b-882d-6c5fd31c1097" path="/var/lib/kubelet/pods/44b742fe-3174-4c3b-882d-6c5fd31c1097/volumes"
Jul 22 04:56:29.172328 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.172261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-certs\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.172538 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.172407    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istiod-ca-cert\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.174233 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.174209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-envoy\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.174557 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.174539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-podinfo\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.179280 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.179251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-token\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.179400 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.179358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnztn\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-kube-api-access-qnztn\") pod \"e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") " pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.300321 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.300271    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:29.451601 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.451574    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"]
Jul 22 04:56:29.453811 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:56:29.453784    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded68f792_1b25_4a55_80cd_90c0cf5e8bf7.slice/crio-0fc9c44700c354354e50944fed6b97027caca85b0824a3e9078275be433990af WatchSource:0}: Error finding container 0fc9c44700c354354e50944fed6b97027caca85b0824a3e9078275be433990af: Status 404 returned error can't find the container with id 0fc9c44700c354354e50944fed6b97027caca85b0824a3e9078275be433990af
Jul 22 04:56:29.456017 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.455983    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:56:29.456101 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.456052    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:56:29.456101 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:29.456091    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:56:30.394275 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:30.394233    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" event={"ID":"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7","Type":"ContainerStarted","Data":"5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e"}
Jul 22 04:56:30.394677 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:30.394294    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" event={"ID":"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7","Type":"ContainerStarted","Data":"0fc9c44700c354354e50944fed6b97027caca85b0824a3e9078275be433990af"}
Jul 22 04:56:30.441832 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:30.441781    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" podStartSLOduration=2.441764837 podStartE2EDuration="2.441764837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:56:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:56:30.440973153 +0000 UTC m=+1905.724838550" watchObservedRunningTime="2026-07-22 04:56:30.441764837 +0000 UTC m=+1905.725630232"
Jul 22 04:56:31.301402 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:31.301361    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:31.306557 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:31.306530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:31.399455 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:31.399429    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:31.400411 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:31.400393    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:46.401258 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:46.401161    2564 patch_prober.go:28] interesting pod/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 22 04:56:46.401258 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:46.401217    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 22 04:56:46.476139 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:46.476105    2564 generic.go:356] "Generic (PLEG): container finished" podID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerID="5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e" exitCode=0
Jul 22 04:56:46.476330 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:46.476173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" event={"ID":"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7","Type":"ContainerDied","Data":"5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e"}
Jul 22 04:56:46.476593 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:46.476577    2564 scope.go:117] "RemoveContainer" containerID="5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e"
Jul 22 04:56:46.477541 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:46.477512    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:56:46.477633 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:46.477575    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:56:46.477633 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:46.477612    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:56:47.482495 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:47.482458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" event={"ID":"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7","Type":"ContainerStarted","Data":"fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b"}
Jul 22 04:56:48.301213 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:48.301169    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:48.301418 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:48.301392    2564 patch_prober.go:28] interesting pod/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 22 04:56:48.301507 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:48.301446    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 22 04:56:49.300982 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:49.300942    2564 patch_prober.go:28] interesting pod/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 22 04:56:49.301392 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:49.301003    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 22 04:56:50.300922 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:50.300884    2564 patch_prober.go:28] interesting pod/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 22 04:56:50.301100 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:50.300943    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 22 04:56:51.326313 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:51.326281    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:51.326745 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:51.326601    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:56:51.327395 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:56:51.327374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:57:13.736577 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:13.736541    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"]
Jul 22 04:57:13.737050 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:13.736820    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy" containerID="cri-o://fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b" gracePeriod=30
Jul 22 04:57:18.985001 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:18.984976    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:57:19.017196 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017110    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-socket\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017196 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017153    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnztn\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-kube-api-access-qnztn\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017196 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-token\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017198    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istiod-ca-cert\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017226    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-data\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017289    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-credential-socket\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017332    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-envoy\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017357    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-podinfo\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017410    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-certs\") pod \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\" (UID: \"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7\") "
Jul 22 04:57:19.017486 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017437    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:57:19.017888 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017722    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.017950 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.017927    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:57:19.018140 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.018100    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:57:19.018283 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.018196    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:57:19.018357 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.018267    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:57:19.019982 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.019957    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-kube-api-access-qnztn" (OuterVolumeSpecName: "kube-api-access-qnztn") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "kube-api-access-qnztn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:57:19.020081 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.019985    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:57:19.020081 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.019984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:57:19.020160 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.020097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" (UID: "ed68f792-1b25-4a55-80cd-90c0cf5e8bf7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 04:57:19.118329 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.118294    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.118329 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.118321    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.118329 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.118331    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.118575 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.118341    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.118575 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.118351    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnztn\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-kube-api-access-qnztn\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.118575 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.118359    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.118575 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.118367    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.118575 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.118375    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:19.636556 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.636519    2564 generic.go:356] "Generic (PLEG): container finished" podID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerID="fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b" exitCode=0
Jul 22 04:57:19.636710 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.636589    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"
Jul 22 04:57:19.636710 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.636604    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" event={"ID":"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7","Type":"ContainerDied","Data":"fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b"}
Jul 22 04:57:19.636710 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.636657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm" event={"ID":"ed68f792-1b25-4a55-80cd-90c0cf5e8bf7","Type":"ContainerDied","Data":"0fc9c44700c354354e50944fed6b97027caca85b0824a3e9078275be433990af"}
Jul 22 04:57:19.636710 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.636682    2564 scope.go:117] "RemoveContainer" containerID="fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b"
Jul 22 04:57:19.645871 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.645843    2564 scope.go:117] "RemoveContainer" containerID="5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e"
Jul 22 04:57:19.654327 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.654307    2564 scope.go:117] "RemoveContainer" containerID="fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b"
Jul 22 04:57:19.654608 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:57:19.654578    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b\": container with ID starting with fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b not found: ID does not exist" containerID="fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b"
Jul 22 04:57:19.654696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.654617    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b"} err="failed to get container status \"fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b\": rpc error: code = NotFound desc = could not find container \"fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b\": container with ID starting with fb82523f039a25f415c7f893ac4c4e350f1a8907b1428fa7ff265aa9bec76a6b not found: ID does not exist"
Jul 22 04:57:19.654696 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.654642    2564 scope.go:117] "RemoveContainer" containerID="5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e"
Jul 22 04:57:19.654953 ip-10-0-131-26 kubenswrapper[2564]: E0722 04:57:19.654934    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e\": container with ID starting with 5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e not found: ID does not exist" containerID="5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e"
Jul 22 04:57:19.655002 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.654960    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e"} err="failed to get container status \"5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e\": rpc error: code = NotFound desc = could not find container \"5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e\": container with ID starting with 5a6c75002e87960aa8f30119c4d723194d8949cd616ade1967851cb24f48808e not found: ID does not exist"
Jul 22 04:57:19.655329 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.655312    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"]
Jul 22 04:57:19.658991 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:19.658970    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e7529972-openshift-default-84ffc67dd7-78bcm"]
Jul 22 04:57:21.171347 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:21.171313    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" path="/var/lib/kubelet/pods/ed68f792-1b25-4a55-80cd-90c0cf5e8bf7/volumes"
Jul 22 04:57:41.218871 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.218775    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"]
Jul 22 04:57:41.219412 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.219324    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy"
Jul 22 04:57:41.219412 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.219345    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy"
Jul 22 04:57:41.219412 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.219364    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy"
Jul 22 04:57:41.219412 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.219375    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy"
Jul 22 04:57:41.219625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.219463    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy"
Jul 22 04:57:41.219625 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.219478    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed68f792-1b25-4a55-80cd-90c0cf5e8bf7" containerName="istio-proxy"
Jul 22 04:57:41.222598 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.222574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"
Jul 22 04:57:41.225144 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.225122    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 04:57:41.228835 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.228812    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"]
Jul 22 04:57:41.310392 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.310353    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da5bb25-a327-4966-885a-fc8caed74bcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp\" (UID: \"7da5bb25-a327-4966-885a-fc8caed74bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"
Jul 22 04:57:41.411540 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.411500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da5bb25-a327-4966-885a-fc8caed74bcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp\" (UID: \"7da5bb25-a327-4966-885a-fc8caed74bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"
Jul 22 04:57:41.412341 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.412311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da5bb25-a327-4966-885a-fc8caed74bcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp\" (UID: \"7da5bb25-a327-4966-885a-fc8caed74bcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"
Jul 22 04:57:41.534988 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.534953    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"
Jul 22 04:57:41.672377 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.672285    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"]
Jul 22 04:57:41.675185 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:57:41.675157    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da5bb25_a327_4966_885a_fc8caed74bcf.slice/crio-1d756da3f2cd1edfc80ff2b801838ca74a6363f2ba11c103a81f03a8fcad1e23 WatchSource:0}: Error finding container 1d756da3f2cd1edfc80ff2b801838ca74a6363f2ba11c103a81f03a8fcad1e23: Status 404 returned error can't find the container with id 1d756da3f2cd1edfc80ff2b801838ca74a6363f2ba11c103a81f03a8fcad1e23
Jul 22 04:57:41.737499 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:41.737457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp" event={"ID":"7da5bb25-a327-4966-885a-fc8caed74bcf","Type":"ContainerStarted","Data":"1d756da3f2cd1edfc80ff2b801838ca74a6363f2ba11c103a81f03a8fcad1e23"}
Jul 22 04:57:42.743704 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:42.743664    2564 generic.go:356] "Generic (PLEG): container finished" podID="7da5bb25-a327-4966-885a-fc8caed74bcf" containerID="fbef9c5a2dc5ebcf38842986e16685b71a3ce984d9b1a5b38824b911a8a60427" exitCode=0
Jul 22 04:57:42.744097 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:42.743768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp" event={"ID":"7da5bb25-a327-4966-885a-fc8caed74bcf","Type":"ContainerDied","Data":"fbef9c5a2dc5ebcf38842986e16685b71a3ce984d9b1a5b38824b911a8a60427"}
Jul 22 04:57:43.885231 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:43.885206    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"
Jul 22 04:57:44.034187 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:44.034084    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da5bb25-a327-4966-885a-fc8caed74bcf-maas-api-service-ca\") pod \"7da5bb25-a327-4966-885a-fc8caed74bcf\" (UID: \"7da5bb25-a327-4966-885a-fc8caed74bcf\") "
Jul 22 04:57:44.034445 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:44.034421    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7da5bb25-a327-4966-885a-fc8caed74bcf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7da5bb25-a327-4966-885a-fc8caed74bcf" (UID: "7da5bb25-a327-4966-885a-fc8caed74bcf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:57:44.135025 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:44.134992    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da5bb25-a327-4966-885a-fc8caed74bcf-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 04:57:44.753666 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:44.753633    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"
Jul 22 04:57:44.753666 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:44.753660    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp" event={"ID":"7da5bb25-a327-4966-885a-fc8caed74bcf","Type":"ContainerDied","Data":"1d756da3f2cd1edfc80ff2b801838ca74a6363f2ba11c103a81f03a8fcad1e23"}
Jul 22 04:57:44.753904 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:44.753708    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d756da3f2cd1edfc80ff2b801838ca74a6363f2ba11c103a81f03a8fcad1e23"
Jul 22 04:57:56.288467 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:56.288427    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"]
Jul 22 04:57:56.291032 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:56.291004    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7a6c5591-vg4sp"]
Jul 22 04:57:57.172436 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:57:57.172404    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7da5bb25-a327-4966-885a-fc8caed74bcf" path="/var/lib/kubelet/pods/7da5bb25-a327-4966-885a-fc8caed74bcf/volumes"
Jul 22 04:59:31.144418 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.144384    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"]
Jul 22 04:59:31.144870 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.144754    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da5bb25-a327-4966-885a-fc8caed74bcf" containerName="revoke-keys"
Jul 22 04:59:31.144870 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.144766    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da5bb25-a327-4966-885a-fc8caed74bcf" containerName="revoke-keys"
Jul 22 04:59:31.144870 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.144841    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7da5bb25-a327-4966-885a-fc8caed74bcf" containerName="revoke-keys"
Jul 22 04:59:31.147862 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.147839    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.150235 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.150217    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0c0adb03-openshift-default-dockercfg-gxjlb\""
Jul 22 04:59:31.160788 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.160762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"]
Jul 22 04:59:31.301275 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-podinfo\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.301506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-credential-socket\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.301506 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-certs\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.301632 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-socket\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.301632 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-token\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.301774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301641    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-data\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.301774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-envoy\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.301774 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istiod-ca-cert\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.301921 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.301811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4pcz\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-kube-api-access-r4pcz\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403343 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-socket\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403343 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-token\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403562 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-data\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403562 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-envoy\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403562 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istiod-ca-cert\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403726 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4pcz\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-kube-api-access-r4pcz\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403726 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-podinfo\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403726 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-socket\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403934 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-credential-socket\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403934 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-certs\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.403934 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.403879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-data\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.404054 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.404033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-credential-socket\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.404115 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.404093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-certs\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.404245 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.404227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istiod-ca-cert\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.405919 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.405903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-envoy\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.405991 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.405974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-podinfo\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.411262 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.411237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-token\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.411262 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.411247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4pcz\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-kube-api-access-r4pcz\") pod \"e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") " pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.457501 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.457457    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:31.598283 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.598257    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"]
Jul 22 04:59:31.600045 ip-10-0-131-26 kubenswrapper[2564]: W0722 04:59:31.600019    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf987c82_8fbf_4f5c_bb10_cca3cff71012.slice/crio-374b808c86bcda553d4d8929b60fcd4c4701d4ebda486868b387276ba596a7e3 WatchSource:0}: Error finding container 374b808c86bcda553d4d8929b60fcd4c4701d4ebda486868b387276ba596a7e3: Status 404 returned error can't find the container with id 374b808c86bcda553d4d8929b60fcd4c4701d4ebda486868b387276ba596a7e3
Jul 22 04:59:31.602190 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.602158    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:59:31.602279 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.602224    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:59:31.602279 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:31.602251    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:59:32.261355 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:32.261319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" event={"ID":"bf987c82-8fbf-4f5c-bb10-cca3cff71012","Type":"ContainerStarted","Data":"6bc53a8789567fcf498ab1142a9bc97c8225f23b6243626bf34d4d1d9d10a946"}
Jul 22 04:59:32.261807 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:32.261386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" event={"ID":"bf987c82-8fbf-4f5c-bb10-cca3cff71012","Type":"ContainerStarted","Data":"374b808c86bcda553d4d8929b60fcd4c4701d4ebda486868b387276ba596a7e3"}
Jul 22 04:59:32.282462 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:32.282403    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" podStartSLOduration=1.282384268 podStartE2EDuration="1.282384268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:59:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:59:32.282119113 +0000 UTC m=+2087.565984510" watchObservedRunningTime="2026-07-22 04:59:32.282384268 +0000 UTC m=+2087.566249664"
Jul 22 04:59:32.458505 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:32.458471    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:32.463307 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:32.463282    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:33.265756 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:33.265706    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:33.266611 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:33.266594    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:43.317033 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:43.316946    2564 generic.go:356] "Generic (PLEG): container finished" podID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerID="6bc53a8789567fcf498ab1142a9bc97c8225f23b6243626bf34d4d1d9d10a946" exitCode=0
Jul 22 04:59:43.317033 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:43.317019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" event={"ID":"bf987c82-8fbf-4f5c-bb10-cca3cff71012","Type":"ContainerDied","Data":"6bc53a8789567fcf498ab1142a9bc97c8225f23b6243626bf34d4d1d9d10a946"}
Jul 22 04:59:43.317463 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:43.317402    2564 scope.go:117] "RemoveContainer" containerID="6bc53a8789567fcf498ab1142a9bc97c8225f23b6243626bf34d4d1d9d10a946"
Jul 22 04:59:43.318397 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:43.318363    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:59:43.318455 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:43.318437    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:59:43.318500 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:43.318471    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 04:59:44.331092 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:44.331052    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" event={"ID":"bf987c82-8fbf-4f5c-bb10-cca3cff71012","Type":"ContainerStarted","Data":"a6826b09ffb1b8704946f2b7c76178db52369d96893bfd706a0fd239425c9b99"}
Jul 22 04:59:44.458303 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:44.458257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:44.459476 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:44.459448    2564 patch_prober.go:28] interesting pod/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 04:59:44.459601 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:44.459497    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 04:59:45.226756 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:45.226701    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:59:45.244937 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:45.244912    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 04:59:45.458329 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:45.458297    2564 patch_prober.go:28] interesting pod/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 04:59:45.458689 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:45.458353    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 04:59:46.458289 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:46.458253    2564 patch_prober.go:28] interesting pod/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 04:59:46.458467 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:46.458393    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 04:59:47.458652 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:47.458619    2564 patch_prober.go:28] interesting pod/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 04:59:47.459056 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:47.458673    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 04:59:48.266662 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:48.266624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:48.462264 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:48.462233    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 04:59:48.463293 ip-10-0-131-26 kubenswrapper[2564]: I0722 04:59:48.463271    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 05:00:07.322432 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:07.322390    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"]
Jul 22 05:00:07.323031 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:07.322645    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy" containerID="cri-o://a6826b09ffb1b8704946f2b7c76178db52369d96893bfd706a0fd239425c9b99" gracePeriod=30
Jul 22 05:00:12.470819 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.470786    2564 generic.go:356] "Generic (PLEG): container finished" podID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerID="a6826b09ffb1b8704946f2b7c76178db52369d96893bfd706a0fd239425c9b99" exitCode=0
Jul 22 05:00:12.471236 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.470854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" event={"ID":"bf987c82-8fbf-4f5c-bb10-cca3cff71012","Type":"ContainerDied","Data":"a6826b09ffb1b8704946f2b7c76178db52369d96893bfd706a0fd239425c9b99"}
Jul 22 05:00:12.471236 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.470918    2564 scope.go:117] "RemoveContainer" containerID="6bc53a8789567fcf498ab1142a9bc97c8225f23b6243626bf34d4d1d9d10a946"
Jul 22 05:00:12.568212 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.568188    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 05:00:12.692467 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692364    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-certs\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.692467 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istiod-ca-cert\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.692709 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-credential-socket\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.692709 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692534    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4pcz\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-kube-api-access-r4pcz\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.692709 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692577    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-envoy\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.692709 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692612    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-data\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.692709 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692679    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:00:12.693016 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692771    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-podinfo\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.693016 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692834    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-socket\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.693016 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-token\") pod \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\" (UID: \"bf987c82-8fbf-4f5c-bb10-cca3cff71012\") "
Jul 22 05:00:12.693016 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692892    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:00:12.693016 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.692975    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:00:12.693242 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.693061    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:00:12.693242 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.693210    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:12.693242 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.693226    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:12.693242 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.693240    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:12.693377 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.693254    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:12.693622 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.693600    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:00:12.695027 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.694999    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:00:12.695132 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.695115    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 05:00:12.695329 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.695300    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-kube-api-access-r4pcz" (OuterVolumeSpecName: "kube-api-access-r4pcz") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "kube-api-access-r4pcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:00:12.695329 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.695299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf987c82-8fbf-4f5c-bb10-cca3cff71012" (UID: "bf987c82-8fbf-4f5c-bb10-cca3cff71012"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:00:12.794575 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.794538    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4pcz\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-kube-api-access-r4pcz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:12.794575 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.794570    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:12.794575 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.794579    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:12.794575 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.794587    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:12.794894 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:12.794594    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf987c82-8fbf-4f5c-bb10-cca3cff71012-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:00:13.477053 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:13.476969    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"
Jul 22 05:00:13.477053 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:13.477001    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj" event={"ID":"bf987c82-8fbf-4f5c-bb10-cca3cff71012","Type":"ContainerDied","Data":"374b808c86bcda553d4d8929b60fcd4c4701d4ebda486868b387276ba596a7e3"}
Jul 22 05:00:13.477053 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:13.477052    2564 scope.go:117] "RemoveContainer" containerID="a6826b09ffb1b8704946f2b7c76178db52369d96893bfd706a0fd239425c9b99"
Jul 22 05:00:13.499301 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:13.499269    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"]
Jul 22 05:00:13.504479 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:13.504454    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0c0adb03-openshift-default-6d7f4f9655-csnqj"]
Jul 22 05:00:15.172011 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:15.171975    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" path="/var/lib/kubelet/pods/bf987c82-8fbf-4f5c-bb10-cca3cff71012/volumes"
Jul 22 05:00:26.885423 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.885385    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"]
Jul 22 05:00:26.885833 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.885794    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy"
Jul 22 05:00:26.885833 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.885806    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy"
Jul 22 05:00:26.885833 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.885821    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy"
Jul 22 05:00:26.885833 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.885827    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy"
Jul 22 05:00:26.885979 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.885882    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy"
Jul 22 05:00:26.885979 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.885890    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf987c82-8fbf-4f5c-bb10-cca3cff71012" containerName="istio-proxy"
Jul 22 05:00:26.888946 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.888926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.891453 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.891433    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d559fe69-openshift-default-dockercfg-7bqbq\""
Jul 22 05:00:26.899038 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.899015    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"]
Jul 22 05:00:26.925755 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.925698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-podinfo\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.925904 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.925762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-token\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.925904 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.925796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8b9f\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-kube-api-access-j8b9f\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.925904 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.925832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-socket\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.926039 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.925935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-envoy\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.926039 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.925965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-data\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.926039 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.926000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-credential-socket\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.926155 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.926048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-certs\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:26.926155 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:26.926075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6074e6e-1905-4228-82fd-ac63452ac2cb-istiod-ca-cert\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027131 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-certs\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027302 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6074e6e-1905-4228-82fd-ac63452ac2cb-istiod-ca-cert\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027302 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-podinfo\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027302 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-token\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027430 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8b9f\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-kube-api-access-j8b9f\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027430 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-socket\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027558 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-envoy\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027558 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-data\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027558 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-certs\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027558 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-credential-socket\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027786 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027763    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-socket\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027834 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-data\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.027950 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-credential-socket\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.028007 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.027932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6074e6e-1905-4228-82fd-ac63452ac2cb-istiod-ca-cert\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.029658 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.029636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-envoy\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.029796 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.029720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-podinfo\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.035913 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.035894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-token\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.036212 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.036191    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8b9f\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-kube-api-access-j8b9f\") pod \"e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") " pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.200039 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.199956    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:27.342034 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.342010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"]
Jul 22 05:00:27.344777 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:00:27.344748    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6074e6e_1905_4228_82fd_ac63452ac2cb.slice/crio-4fa1e3c99b0eb986cee91f18e4150ff7c3e3f954f43faa4206685c4910fbb029 WatchSource:0}: Error finding container 4fa1e3c99b0eb986cee91f18e4150ff7c3e3f954f43faa4206685c4910fbb029: Status 404 returned error can't find the container with id 4fa1e3c99b0eb986cee91f18e4150ff7c3e3f954f43faa4206685c4910fbb029
Jul 22 05:00:27.346890 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.346858    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:00:27.346960 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.346927    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:00:27.346960 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.346955    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:00:27.549211 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.549170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" event={"ID":"b6074e6e-1905-4228-82fd-ac63452ac2cb","Type":"ContainerStarted","Data":"de8e0e76063dce4055a22d9156d9a8d6919c1d47cc704140476aa079bf4530f4"}
Jul 22 05:00:27.549396 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.549234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" event={"ID":"b6074e6e-1905-4228-82fd-ac63452ac2cb","Type":"ContainerStarted","Data":"4fa1e3c99b0eb986cee91f18e4150ff7c3e3f954f43faa4206685c4910fbb029"}
Jul 22 05:00:27.569686 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:27.569623    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" podStartSLOduration=1.5695989799999999 podStartE2EDuration="1.56959898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:00:27.56923214 +0000 UTC m=+2142.853097575" watchObservedRunningTime="2026-07-22 05:00:27.56959898 +0000 UTC m=+2142.853464377"
Jul 22 05:00:28.200615 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:28.200578    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:28.205581 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:28.205556    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:28.554350 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:28.554312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:28.555385 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:28.555362    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:39.610049 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:39.610016    2564 generic.go:356] "Generic (PLEG): container finished" podID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerID="de8e0e76063dce4055a22d9156d9a8d6919c1d47cc704140476aa079bf4530f4" exitCode=0
Jul 22 05:00:39.610595 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:39.610093    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" event={"ID":"b6074e6e-1905-4228-82fd-ac63452ac2cb","Type":"ContainerDied","Data":"de8e0e76063dce4055a22d9156d9a8d6919c1d47cc704140476aa079bf4530f4"}
Jul 22 05:00:39.610595 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:39.610590    2564 scope.go:117] "RemoveContainer" containerID="de8e0e76063dce4055a22d9156d9a8d6919c1d47cc704140476aa079bf4530f4"
Jul 22 05:00:39.611672 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:39.611643    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:00:39.611797 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:39.611727    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:00:39.611904 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:39.611828    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:00:40.619947 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:40.619899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" event={"ID":"b6074e6e-1905-4228-82fd-ac63452ac2cb","Type":"ContainerStarted","Data":"eff9f614586f431d5af220c464dbbd9e3ada5824d249c64a0fc3184b288c73c2"}
Jul 22 05:00:41.200954 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:41.200922    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:41.201875 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:41.201850    2564 patch_prober.go:28] interesting pod/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 22 05:00:41.201996 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:41.201895    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 22 05:00:42.200809 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:42.200769    2564 patch_prober.go:28] interesting pod/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 22 05:00:42.201188 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:42.200831    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 22 05:00:43.200898 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:43.200857    2564 patch_prober.go:28] interesting pod/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 22 05:00:43.201344 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:43.200921    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 22 05:00:43.555015 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:43.554980    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:44.200659 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:44.200623    2564 patch_prober.go:28] interesting pod/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 22 05:00:44.200867 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:44.200679    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 22 05:00:45.204226 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:45.204197    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:00:45.205156 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:00:45.205140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:01:07.052449 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.052412    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"]
Jul 22 05:01:07.054715 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.054691    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"
Jul 22 05:01:07.056823 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.056800    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 05:01:07.062517 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.062466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"]
Jul 22 05:01:07.096388 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.096358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a621d438-9d40-4dc6-98d8-98667a069f2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d559fe69-27t4m\" (UID: \"a621d438-9d40-4dc6-98d8-98667a069f2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"
Jul 22 05:01:07.196929 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.196895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a621d438-9d40-4dc6-98d8-98667a069f2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d559fe69-27t4m\" (UID: \"a621d438-9d40-4dc6-98d8-98667a069f2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"
Jul 22 05:01:07.197563 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.197544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a621d438-9d40-4dc6-98d8-98667a069f2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d559fe69-27t4m\" (UID: \"a621d438-9d40-4dc6-98d8-98667a069f2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"
Jul 22 05:01:07.366448 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.366367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"
Jul 22 05:01:07.500531 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.500500    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"]
Jul 22 05:01:07.503646 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:01:07.503619    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda621d438_9d40_4dc6_98d8_98667a069f2d.slice/crio-28b271ec517902752034d6fb154b83db325d61078ea2cf28dca41fb80ce7e6e2 WatchSource:0}: Error finding container 28b271ec517902752034d6fb154b83db325d61078ea2cf28dca41fb80ce7e6e2: Status 404 returned error can't find the container with id 28b271ec517902752034d6fb154b83db325d61078ea2cf28dca41fb80ce7e6e2
Jul 22 05:01:07.754901 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:07.754869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m" event={"ID":"a621d438-9d40-4dc6-98d8-98667a069f2d","Type":"ContainerStarted","Data":"28b271ec517902752034d6fb154b83db325d61078ea2cf28dca41fb80ce7e6e2"}
Jul 22 05:01:08.760764 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:08.760714    2564 generic.go:356] "Generic (PLEG): container finished" podID="a621d438-9d40-4dc6-98d8-98667a069f2d" containerID="1ccc579bfcac27938f83d7385c38198a779fff92b999fc99ddf06e6aca62d050" exitCode=0
Jul 22 05:01:08.761171 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:08.760765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m" event={"ID":"a621d438-9d40-4dc6-98d8-98667a069f2d","Type":"ContainerDied","Data":"1ccc579bfcac27938f83d7385c38198a779fff92b999fc99ddf06e6aca62d050"}
Jul 22 05:01:09.902578 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:09.902554    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"
Jul 22 05:01:09.920636 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:09.920603    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a621d438-9d40-4dc6-98d8-98667a069f2d-maas-api-service-ca\") pod \"a621d438-9d40-4dc6-98d8-98667a069f2d\" (UID: \"a621d438-9d40-4dc6-98d8-98667a069f2d\") "
Jul 22 05:01:09.920953 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:09.920928    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a621d438-9d40-4dc6-98d8-98667a069f2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a621d438-9d40-4dc6-98d8-98667a069f2d" (UID: "a621d438-9d40-4dc6-98d8-98667a069f2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:01:10.022211 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:10.022123    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a621d438-9d40-4dc6-98d8-98667a069f2d-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:01:10.774519 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:10.774484    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"
Jul 22 05:01:10.774519 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:10.774496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m" event={"ID":"a621d438-9d40-4dc6-98d8-98667a069f2d","Type":"ContainerDied","Data":"28b271ec517902752034d6fb154b83db325d61078ea2cf28dca41fb80ce7e6e2"}
Jul 22 05:01:10.774814 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:10.774550    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28b271ec517902752034d6fb154b83db325d61078ea2cf28dca41fb80ce7e6e2"
Jul 22 05:01:27.128476 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:27.128429    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"]
Jul 22 05:01:27.130122 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:27.130098    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d559fe69-27t4m"]
Jul 22 05:01:27.171580 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:01:27.171548    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a621d438-9d40-4dc6-98d8-98667a069f2d" path="/var/lib/kubelet/pods/a621d438-9d40-4dc6-98d8-98667a069f2d/volumes"
Jul 22 05:02:30.933378 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:30.933344    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"]
Jul 22 05:02:30.933835 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:30.933648    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy" containerID="cri-o://eff9f614586f431d5af220c464dbbd9e3ada5824d249c64a0fc3184b288c73c2" gracePeriod=30
Jul 22 05:02:36.189991 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.189962    2564 generic.go:356] "Generic (PLEG): container finished" podID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerID="eff9f614586f431d5af220c464dbbd9e3ada5824d249c64a0fc3184b288c73c2" exitCode=0
Jul 22 05:02:36.190350 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.190043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" event={"ID":"b6074e6e-1905-4228-82fd-ac63452ac2cb","Type":"ContainerDied","Data":"eff9f614586f431d5af220c464dbbd9e3ada5824d249c64a0fc3184b288c73c2"}
Jul 22 05:02:36.190350 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.190100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52" event={"ID":"b6074e6e-1905-4228-82fd-ac63452ac2cb","Type":"ContainerDied","Data":"4fa1e3c99b0eb986cee91f18e4150ff7c3e3f954f43faa4206685c4910fbb029"}
Jul 22 05:02:36.190350 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.190117    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fa1e3c99b0eb986cee91f18e4150ff7c3e3f954f43faa4206685c4910fbb029"
Jul 22 05:02:36.190350 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.190130    2564 scope.go:117] "RemoveContainer" containerID="de8e0e76063dce4055a22d9156d9a8d6919c1d47cc704140476aa079bf4530f4"
Jul 22 05:02:36.209161 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.209142    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:02:36.210653 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.210637    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-podinfo\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.210705 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.210663    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8b9f\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-kube-api-access-j8b9f\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.210705 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.210696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-socket\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.210832 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.210793    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-data\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.210832 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.210821    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-certs\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.210944 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.210864    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-credential-socket\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.210944 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.210907    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-token\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.211054 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.210959    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-envoy\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.211054 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211004    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:02:36.211054 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211020    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6074e6e-1905-4228-82fd-ac63452ac2cb-istiod-ca-cert\") pod \"b6074e6e-1905-4228-82fd-ac63452ac2cb\" (UID: \"b6074e6e-1905-4228-82fd-ac63452ac2cb\") "
Jul 22 05:02:36.211223 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211096    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:02:36.211223 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211169    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:02:36.211348 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211330    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:36.211406 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211353    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:36.211406 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211367    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:36.211690 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211666    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6074e6e-1905-4228-82fd-ac63452ac2cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:02:36.211786 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.211747    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:02:36.212987 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.212952    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 05:02:36.213076 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.213047    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-kube-api-access-j8b9f" (OuterVolumeSpecName: "kube-api-access-j8b9f") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "kube-api-access-j8b9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:02:36.213076 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.213059    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:02:36.213515 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.213480    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6074e6e-1905-4228-82fd-ac63452ac2cb" (UID: "b6074e6e-1905-4228-82fd-ac63452ac2cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:02:36.312707 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.312674    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:36.312707 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.312704    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:36.312707 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.312716    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6074e6e-1905-4228-82fd-ac63452ac2cb-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:36.312990 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.312728    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:36.312990 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.312769    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8b9f\" (UniqueName: \"kubernetes.io/projected/b6074e6e-1905-4228-82fd-ac63452ac2cb-kube-api-access-j8b9f\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:36.312990 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:36.312782    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6074e6e-1905-4228-82fd-ac63452ac2cb-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:02:37.196188 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:37.196160    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"
Jul 22 05:02:37.225862 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:37.225830    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"]
Jul 22 05:02:37.229909 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:37.229882    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d559fe69-openshift-default-56ddcf8bd7-rmp52"]
Jul 22 05:02:39.171372 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:39.171338    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" path="/var/lib/kubelet/pods/b6074e6e-1905-4228-82fd-ac63452ac2cb/volumes"
Jul 22 05:02:45.328131 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:02:45.328098    2564 scope.go:117] "RemoveContainer" containerID="40c8fa5f973e3203f7a62e3b8c963d342d9ff0dc266e2c3a025f2f848cb80543"
Jul 22 05:03:25.954777 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.954728    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"]
Jul 22 05:03:25.955237 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.955119    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy"
Jul 22 05:03:25.955237 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.955131    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy"
Jul 22 05:03:25.955237 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.955144    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy"
Jul 22 05:03:25.955237 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.955150    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy"
Jul 22 05:03:25.955237 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.955157    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a621d438-9d40-4dc6-98d8-98667a069f2d" containerName="revoke-keys"
Jul 22 05:03:25.955237 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.955162    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a621d438-9d40-4dc6-98d8-98667a069f2d" containerName="revoke-keys"
Jul 22 05:03:25.955237 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.955224    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy"
Jul 22 05:03:25.955237 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.955234    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a621d438-9d40-4dc6-98d8-98667a069f2d" containerName="revoke-keys"
Jul 22 05:03:25.958030 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.958007    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.961346 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.961319    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e9e018-openshift-default-dockercfg-s2lbv\""
Jul 22 05:03:25.966348 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d5f3e9-8334-4ddd-a929-95175dffdc38-istiod-ca-cert\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.966445 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-data\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.966445 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-socket\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.966445 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s89fz\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-kube-api-access-s89fz\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.966552 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-certs\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.966552 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-token\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.966552 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-podinfo\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.966659 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-envoy\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.966659 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.966607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-credential-socket\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:25.970530 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:25.970502    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"]
Jul 22 05:03:26.067766 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.067695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s89fz\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-kube-api-access-s89fz\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.067967 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.067772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-certs\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.067967 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.067807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-token\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.067967 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.067837    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-podinfo\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.067967 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.067861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-envoy\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.067967 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.067893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-credential-socket\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.068250 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.067993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d5f3e9-8334-4ddd-a929-95175dffdc38-istiod-ca-cert\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.068250 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.068042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-data\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.068250 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.068071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-socket\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.068417 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.068299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-certs\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.068417 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.068348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-credential-socket\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.068417 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.068401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-data\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.068577 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.068508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-socket\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.068759 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.068722    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d5f3e9-8334-4ddd-a929-95175dffdc38-istiod-ca-cert\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.070100 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.070084    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-envoy\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.070458 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.070442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-podinfo\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.075423 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.075391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-token\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.075565 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.075548    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89fz\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-kube-api-access-s89fz\") pod \"e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") " pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.270430 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.270366    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:26.422993 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.422967    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"]
Jul 22 05:03:26.425338 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:03:26.425312    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d5f3e9_8334_4ddd_a929_95175dffdc38.slice/crio-b0e62164c3f115eb8ef229850d8caebce46eac37ecebeca1f1db10c2f97dc5ae WatchSource:0}: Error finding container b0e62164c3f115eb8ef229850d8caebce46eac37ecebeca1f1db10c2f97dc5ae: Status 404 returned error can't find the container with id b0e62164c3f115eb8ef229850d8caebce46eac37ecebeca1f1db10c2f97dc5ae
Jul 22 05:03:26.427872 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.427838    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:03:26.427949 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.427905    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:03:26.427949 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.427934    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:03:26.437158 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:26.437131    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" event={"ID":"74d5f3e9-8334-4ddd-a929-95175dffdc38","Type":"ContainerStarted","Data":"b0e62164c3f115eb8ef229850d8caebce46eac37ecebeca1f1db10c2f97dc5ae"}
Jul 22 05:03:27.450332 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:27.450294    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" event={"ID":"74d5f3e9-8334-4ddd-a929-95175dffdc38","Type":"ContainerStarted","Data":"417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77"}
Jul 22 05:03:27.470238 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:27.470191    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" podStartSLOduration=2.470177073 podStartE2EDuration="2.470177073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:03:27.468824368 +0000 UTC m=+2322.752689763" watchObservedRunningTime="2026-07-22 05:03:27.470177073 +0000 UTC m=+2322.754042468"
Jul 22 05:03:28.270941 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:28.270903    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:28.275725 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:28.275698    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:28.455595 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:28.455563    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:28.456453 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:28.456436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:37.907416 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.907330    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"]
Jul 22 05:03:37.908062 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.908040    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6074e6e-1905-4228-82fd-ac63452ac2cb" containerName="istio-proxy"
Jul 22 05:03:37.911699 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.911676    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:37.918785 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.918368    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-33bb6b-serving-cert\""
Jul 22 05:03:37.918785 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.918620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tcl88\""
Jul 22 05:03:37.926197 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.926167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"]
Jul 22 05:03:37.978423 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.978393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:37.978608 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.978440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kb8w\" (UniqueName: \"kubernetes.io/projected/a96a8126-2a8d-4470-9f48-76f8de8714fd-kube-api-access-6kb8w\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:37.978608 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:37.978490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a96a8126-2a8d-4470-9f48-76f8de8714fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:38.079781 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:38.079719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a96a8126-2a8d-4470-9f48-76f8de8714fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:38.079960 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:38.079837    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:38.079960 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:38.079872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kb8w\" (UniqueName: \"kubernetes.io/projected/a96a8126-2a8d-4470-9f48-76f8de8714fd-kube-api-access-6kb8w\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:38.080051 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:03:38.079973    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-serving-cert: secret "maas-api-e2e-inf-b-33bb6b-serving-cert" not found
Jul 22 05:03:38.080088 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:03:38.080060    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls podName:a96a8126-2a8d-4470-9f48-76f8de8714fd nodeName:}" failed. No retries permitted until 2026-07-22 05:03:38.580039948 +0000 UTC m=+2333.863905328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls") pod "maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj" (UID: "a96a8126-2a8d-4470-9f48-76f8de8714fd") : secret "maas-api-e2e-inf-b-33bb6b-serving-cert" not found
Jul 22 05:03:38.080373 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:38.080355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a96a8126-2a8d-4470-9f48-76f8de8714fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:38.088403 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:38.088371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kb8w\" (UniqueName: \"kubernetes.io/projected/a96a8126-2a8d-4470-9f48-76f8de8714fd-kube-api-access-6kb8w\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:38.583648 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:38.583612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:38.586166 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:38.586135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:38.844573 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:38.844467    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:39.013930 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:39.011223    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"]
Jul 22 05:03:39.030757 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:39.023148    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 05:03:39.510325 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:39.510284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj" event={"ID":"a96a8126-2a8d-4470-9f48-76f8de8714fd","Type":"ContainerStarted","Data":"18c3132b7a204dbb546c1cc84f49e2fc3b9ba2c5049fe7efa58c7582dca49e78"}
Jul 22 05:03:41.523486 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:41.523449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj" event={"ID":"a96a8126-2a8d-4470-9f48-76f8de8714fd","Type":"ContainerStarted","Data":"62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054"}
Jul 22 05:03:41.523932 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:41.523569    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:41.541615 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:41.541555    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj" podStartSLOduration=3.011481989 podStartE2EDuration="4.541538041s" totalImagesPullingTime="1.530056052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:03:41.539100738 +0000 UTC m=+2336.822966125" watchObservedRunningTime="2026-07-22 05:03:41.541538041 +0000 UTC m=+2336.825403414"
Jul 22 05:03:43.456810 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:43.456776    2564 patch_prober.go:28] interesting pod/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 05:03:43.457236 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:43.456828    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 05:03:43.536746 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:43.536712    2564 generic.go:356] "Generic (PLEG): container finished" podID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerID="417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77" exitCode=0
Jul 22 05:03:43.536926 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:43.536800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" event={"ID":"74d5f3e9-8334-4ddd-a929-95175dffdc38","Type":"ContainerDied","Data":"417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77"}
Jul 22 05:03:43.537213 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:43.537198    2564 scope.go:117] "RemoveContainer" containerID="417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77"
Jul 22 05:03:43.538193 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:43.538164    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:03:43.538245 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:43.538234    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:03:43.538284 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:43.538270    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:03:44.545810 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:44.545774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" event={"ID":"74d5f3e9-8334-4ddd-a929-95175dffdc38","Type":"ContainerStarted","Data":"b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79"}
Jul 22 05:03:45.271361 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:45.271335    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:45.271542 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:45.271526    2564 patch_prober.go:28] interesting pod/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 05:03:45.271592 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:45.271579    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 05:03:45.347160 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:45.347130    2564 scope.go:117] "RemoveContainer" containerID="fbef9c5a2dc5ebcf38842986e16685b71a3ce984d9b1a5b38824b911a8a60427"
Jul 22 05:03:46.270727 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:46.270680    2564 patch_prober.go:28] interesting pod/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 05:03:46.271254 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:46.270745    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 05:03:47.271273 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:47.271213    2564 patch_prober.go:28] interesting pod/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 05:03:47.271273 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:47.271265    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 05:03:47.545094 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:47.545003    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:03:48.271857 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:48.271813    2564 patch_prober.go:28] interesting pod/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 05:03:48.272259 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:48.271879    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 05:03:49.274890 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:49.274857    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:49.275337 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:49.275153    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:03:49.275801 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:03:49.275785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:04:25.677085 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.677052    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"]
Jul 22 05:04:25.680495 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.680471    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.683040 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.683020    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-33bb6b\"/\"openshift-service-ca.crt\""
Jul 22 05:04:25.684284 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.684249    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-33bb6b\"/\"test-model-33bb6b-kserve-self-signed-certs\""
Jul 22 05:04:25.684382 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.684289    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-33bb6b\"/\"kube-root-ca.crt\""
Jul 22 05:04:25.684382 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.684305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-33bb6b\"/\"default-dockercfg-hd9q9\""
Jul 22 05:04:25.689702 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.689681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"]
Jul 22 05:04:25.712159 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.712125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-dshm\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.712320 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.712176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25v7p\" (UniqueName: \"kubernetes.io/projected/be8340dc-02c0-4c83-819d-52ff0173d096-kube-api-access-25v7p\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.712320 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.712243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-model-cache\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.712414 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.712389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-home\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.712456 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.712431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-tmp-dir\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.712491 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.712457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8340dc-02c0-4c83-819d-52ff0173d096-tls-certs\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.813914 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.813856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-home\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.814176 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.814155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-tmp-dir\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.814314 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.814299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8340dc-02c0-4c83-819d-52ff0173d096-tls-certs\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.814431 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.814418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-dshm\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.814567 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.814552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25v7p\" (UniqueName: \"kubernetes.io/projected/be8340dc-02c0-4c83-819d-52ff0173d096-kube-api-access-25v7p\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.814703 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.814689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-model-cache\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.815332 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.815308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-model-cache\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.815769 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.815726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-home\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.816175 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.816133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-tmp-dir\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.820112 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.820090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8340dc-02c0-4c83-819d-52ff0173d096-tls-certs\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.825901 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.825873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-dshm\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.826244 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.826221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25v7p\" (UniqueName: \"kubernetes.io/projected/be8340dc-02c0-4c83-819d-52ff0173d096-kube-api-access-25v7p\") pod \"test-model-33bb6b-kserve-7769df5cd5-qzlbk\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") " pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:25.992190 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:25.992157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:26.129884 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:26.129858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"]
Jul 22 05:04:26.133054 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:04:26.133027    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe8340dc_02c0_4c83_819d_52ff0173d096.slice/crio-d970646d504c0969431d5181258a9b27b2ecdfdb2cb48a142084dc9d6e7b087d WatchSource:0}: Error finding container d970646d504c0969431d5181258a9b27b2ecdfdb2cb48a142084dc9d6e7b087d: Status 404 returned error can't find the container with id d970646d504c0969431d5181258a9b27b2ecdfdb2cb48a142084dc9d6e7b087d
Jul 22 05:04:26.757086 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:26.757053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk" event={"ID":"be8340dc-02c0-4c83-819d-52ff0173d096","Type":"ContainerStarted","Data":"e5e0cff4770c2fa092a65de304f2d7b608868fe72c88f4d4f746ad234a7813b4"}
Jul 22 05:04:26.757484 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:26.757095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk" event={"ID":"be8340dc-02c0-4c83-819d-52ff0173d096","Type":"ContainerStarted","Data":"d970646d504c0969431d5181258a9b27b2ecdfdb2cb48a142084dc9d6e7b087d"}
Jul 22 05:04:26.774710 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:26.774651    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk" podStartSLOduration=1.774635854 podStartE2EDuration="1.774635854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:04:26.773997215 +0000 UTC m=+2382.057862624" watchObservedRunningTime="2026-07-22 05:04:26.774635854 +0000 UTC m=+2382.058501249"
Jul 22 05:04:35.993135 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:35.993094    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:35.993551 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:35.993178    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:36.005457 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:36.005426    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:36.818260 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:36.818229    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:04:45.268523 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:45.268492    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 05:04:45.275868 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:04:45.275845    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 05:05:12.879446 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:12.879408    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"]
Jul 22 05:05:27.901103 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:27.901064    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk" podUID="be8340dc-02c0-4c83-819d-52ff0173d096" containerName="main" containerID="cri-o://e5e0cff4770c2fa092a65de304f2d7b608868fe72c88f4d4f746ad234a7813b4" gracePeriod=45
Jul 22 05:05:28.065196 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.065164    2564 generic.go:356] "Generic (PLEG): container finished" podID="be8340dc-02c0-4c83-819d-52ff0173d096" containerID="e5e0cff4770c2fa092a65de304f2d7b608868fe72c88f4d4f746ad234a7813b4" exitCode=0
Jul 22 05:05:28.065354 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.065235    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk" event={"ID":"be8340dc-02c0-4c83-819d-52ff0173d096","Type":"ContainerDied","Data":"e5e0cff4770c2fa092a65de304f2d7b608868fe72c88f4d4f746ad234a7813b4"}
Jul 22 05:05:28.166589 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.166566    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:05:28.311278 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.311246    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-dshm\") pod \"be8340dc-02c0-4c83-819d-52ff0173d096\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") "
Jul 22 05:05:28.311278 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.311279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-home\") pod \"be8340dc-02c0-4c83-819d-52ff0173d096\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") "
Jul 22 05:05:28.311520 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.311325    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-tmp-dir\") pod \"be8340dc-02c0-4c83-819d-52ff0173d096\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") "
Jul 22 05:05:28.311520 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.311352    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8340dc-02c0-4c83-819d-52ff0173d096-tls-certs\") pod \"be8340dc-02c0-4c83-819d-52ff0173d096\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") "
Jul 22 05:05:28.311520 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.311413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-model-cache\") pod \"be8340dc-02c0-4c83-819d-52ff0173d096\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") "
Jul 22 05:05:28.311520 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.311439    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25v7p\" (UniqueName: \"kubernetes.io/projected/be8340dc-02c0-4c83-819d-52ff0173d096-kube-api-access-25v7p\") pod \"be8340dc-02c0-4c83-819d-52ff0173d096\" (UID: \"be8340dc-02c0-4c83-819d-52ff0173d096\") "
Jul 22 05:05:28.311724 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.311594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-home" (OuterVolumeSpecName: "home") pod "be8340dc-02c0-4c83-819d-52ff0173d096" (UID: "be8340dc-02c0-4c83-819d-52ff0173d096"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:28.311724 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.311602    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "be8340dc-02c0-4c83-819d-52ff0173d096" (UID: "be8340dc-02c0-4c83-819d-52ff0173d096"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:28.314127 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.312184    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-model-cache" (OuterVolumeSpecName: "model-cache") pod "be8340dc-02c0-4c83-819d-52ff0173d096" (UID: "be8340dc-02c0-4c83-819d-52ff0173d096"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:28.314127 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.312289    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:28.314127 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.312316    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:28.320630 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.320408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8340dc-02c0-4c83-819d-52ff0173d096-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "be8340dc-02c0-4c83-819d-52ff0173d096" (UID: "be8340dc-02c0-4c83-819d-52ff0173d096"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:05:28.320630 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.320432    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8340dc-02c0-4c83-819d-52ff0173d096-kube-api-access-25v7p" (OuterVolumeSpecName: "kube-api-access-25v7p") pod "be8340dc-02c0-4c83-819d-52ff0173d096" (UID: "be8340dc-02c0-4c83-819d-52ff0173d096"). InnerVolumeSpecName "kube-api-access-25v7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:05:28.320630 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.320408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-dshm" (OuterVolumeSpecName: "dshm") pod "be8340dc-02c0-4c83-819d-52ff0173d096" (UID: "be8340dc-02c0-4c83-819d-52ff0173d096"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:28.412864 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.412778    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:28.412864 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.412809    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25v7p\" (UniqueName: \"kubernetes.io/projected/be8340dc-02c0-4c83-819d-52ff0173d096-kube-api-access-25v7p\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:28.412864 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.412820    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be8340dc-02c0-4c83-819d-52ff0173d096-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:28.412864 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:28.412829    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8340dc-02c0-4c83-819d-52ff0173d096-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:29.071615 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:29.071590    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"
Jul 22 05:05:29.072068 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:29.071582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk" event={"ID":"be8340dc-02c0-4c83-819d-52ff0173d096","Type":"ContainerDied","Data":"d970646d504c0969431d5181258a9b27b2ecdfdb2cb48a142084dc9d6e7b087d"}
Jul 22 05:05:29.072068 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:29.071718    2564 scope.go:117] "RemoveContainer" containerID="e5e0cff4770c2fa092a65de304f2d7b608868fe72c88f4d4f746ad234a7813b4"
Jul 22 05:05:29.094331 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:29.094299    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"]
Jul 22 05:05:29.098312 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:29.098288    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-33bb6b/test-model-33bb6b-kserve-7769df5cd5-qzlbk"]
Jul 22 05:05:29.171932 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:29.171899    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be8340dc-02c0-4c83-819d-52ff0173d096" path="/var/lib/kubelet/pods/be8340dc-02c0-4c83-819d-52ff0173d096/volumes"
Jul 22 05:05:34.575367 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.575325    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"]
Jul 22 05:05:34.575985 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.575951    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy" containerID="cri-o://b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79" gracePeriod=30
Jul 22 05:05:34.926864 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.926781    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"]
Jul 22 05:05:34.927204 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.927191    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8340dc-02c0-4c83-819d-52ff0173d096" containerName="main"
Jul 22 05:05:34.927258 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.927207    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8340dc-02c0-4c83-819d-52ff0173d096" containerName="main"
Jul 22 05:05:34.927297 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.927274    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="be8340dc-02c0-4c83-819d-52ff0173d096" containerName="main"
Jul 22 05:05:34.931956 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.931926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"
Jul 22 05:05:34.934370 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.934349    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 05:05:34.937777 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.937747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"]
Jul 22 05:05:34.965458 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:34.965418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a218a44a-8224-417a-ba72-1683ab18980b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd\" (UID: \"a218a44a-8224-417a-ba72-1683ab18980b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"
Jul 22 05:05:35.066247 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:35.066217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a218a44a-8224-417a-ba72-1683ab18980b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd\" (UID: \"a218a44a-8224-417a-ba72-1683ab18980b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"
Jul 22 05:05:35.066859 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:35.066840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a218a44a-8224-417a-ba72-1683ab18980b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd\" (UID: \"a218a44a-8224-417a-ba72-1683ab18980b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"
Jul 22 05:05:35.245401 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:35.245360    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"
Jul 22 05:05:35.383926 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:35.383894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"]
Jul 22 05:05:35.386593 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:05:35.386567    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda218a44a_8224_417a_ba72_1683ab18980b.slice/crio-972d977f42ccf6a0d704af302d57c711f5737a3112f90fc04250efa624f2c83f WatchSource:0}: Error finding container 972d977f42ccf6a0d704af302d57c711f5737a3112f90fc04250efa624f2c83f: Status 404 returned error can't find the container with id 972d977f42ccf6a0d704af302d57c711f5737a3112f90fc04250efa624f2c83f
Jul 22 05:05:36.105240 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:36.105202    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd" event={"ID":"a218a44a-8224-417a-ba72-1683ab18980b","Type":"ContainerStarted","Data":"38a30f6d74f08e5d438089b70e049eff0d52396ad11a447e530d9a226727a790"}
Jul 22 05:05:36.105690 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:36.105271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd" event={"ID":"a218a44a-8224-417a-ba72-1683ab18980b","Type":"ContainerStarted","Data":"972d977f42ccf6a0d704af302d57c711f5737a3112f90fc04250efa624f2c83f"}
Jul 22 05:05:36.120120 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:36.120068    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd" podStartSLOduration=2.120040961 podStartE2EDuration="2.120040961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:05:36.118449586 +0000 UTC m=+2451.402314980" watchObservedRunningTime="2026-07-22 05:05:36.120040961 +0000 UTC m=+2451.403906358"
Jul 22 05:05:37.111831 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:37.111795    2564 generic.go:356] "Generic (PLEG): container finished" podID="a218a44a-8224-417a-ba72-1683ab18980b" containerID="38a30f6d74f08e5d438089b70e049eff0d52396ad11a447e530d9a226727a790" exitCode=0
Jul 22 05:05:37.112262 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:37.111869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd" event={"ID":"a218a44a-8224-417a-ba72-1683ab18980b","Type":"ContainerDied","Data":"38a30f6d74f08e5d438089b70e049eff0d52396ad11a447e530d9a226727a790"}
Jul 22 05:05:38.252665 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:38.252641    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"
Jul 22 05:05:38.290545 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:38.290514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a218a44a-8224-417a-ba72-1683ab18980b-maas-api-service-ca\") pod \"a218a44a-8224-417a-ba72-1683ab18980b\" (UID: \"a218a44a-8224-417a-ba72-1683ab18980b\") "
Jul 22 05:05:38.290925 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:38.290899    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a218a44a-8224-417a-ba72-1683ab18980b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a218a44a-8224-417a-ba72-1683ab18980b" (UID: "a218a44a-8224-417a-ba72-1683ab18980b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:05:38.391848 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:38.391728    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a218a44a-8224-417a-ba72-1683ab18980b-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:39.124315 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.124282    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"
Jul 22 05:05:39.124493 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.124315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd" event={"ID":"a218a44a-8224-417a-ba72-1683ab18980b","Type":"ContainerDied","Data":"972d977f42ccf6a0d704af302d57c711f5737a3112f90fc04250efa624f2c83f"}
Jul 22 05:05:39.124493 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.124377    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="972d977f42ccf6a0d704af302d57c711f5737a3112f90fc04250efa624f2c83f"
Jul 22 05:05:39.836620 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.836597    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:05:39.904359 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904268    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-socket\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904359 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-podinfo\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904359 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904340    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-envoy\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904623 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904372    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d5f3e9-8334-4ddd-a929-95175dffdc38-istiod-ca-cert\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904623 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-token\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904623 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-data\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904623 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904466    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-certs\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904623 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s89fz\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-kube-api-access-s89fz\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904623 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904517    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-credential-socket\") pod \"74d5f3e9-8334-4ddd-a929-95175dffdc38\" (UID: \"74d5f3e9-8334-4ddd-a929-95175dffdc38\") "
Jul 22 05:05:39.904623 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904578    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:39.905077 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904811    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:39.905077 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904825    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:39.905077 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.904903    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d5f3e9-8334-4ddd-a929-95175dffdc38-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:05:39.905259 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.905147    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:39.905415 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.905385    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-data" (OuterVolumeSpecName: "istio-data") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:39.906632 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.906601    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 05:05:39.906755 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.906680    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-kube-api-access-s89fz" (OuterVolumeSpecName: "kube-api-access-s89fz") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "kube-api-access-s89fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:05:39.906978 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.906961    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:05:39.907029 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:39.906998    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-token" (OuterVolumeSpecName: "istio-token") pod "74d5f3e9-8334-4ddd-a929-95175dffdc38" (UID: "74d5f3e9-8334-4ddd-a929-95175dffdc38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:05:40.005699 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.005659    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:40.005699 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.005691    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:40.005699 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.005700    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:40.005699 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.005708    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s89fz\" (UniqueName: \"kubernetes.io/projected/74d5f3e9-8334-4ddd-a929-95175dffdc38-kube-api-access-s89fz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:40.006006 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.005719    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:40.006006 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.005727    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:40.006006 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.005755    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74d5f3e9-8334-4ddd-a929-95175dffdc38-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:40.006006 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.005764    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74d5f3e9-8334-4ddd-a929-95175dffdc38-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:40.131810 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.131775    2564 generic.go:356] "Generic (PLEG): container finished" podID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerID="b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79" exitCode=0
Jul 22 05:05:40.131978 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.131835    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"
Jul 22 05:05:40.131978 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.131869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" event={"ID":"74d5f3e9-8334-4ddd-a929-95175dffdc38","Type":"ContainerDied","Data":"b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79"}
Jul 22 05:05:40.131978 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.131960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg" event={"ID":"74d5f3e9-8334-4ddd-a929-95175dffdc38","Type":"ContainerDied","Data":"b0e62164c3f115eb8ef229850d8caebce46eac37ecebeca1f1db10c2f97dc5ae"}
Jul 22 05:05:40.132184 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.131989    2564 scope.go:117] "RemoveContainer" containerID="b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79"
Jul 22 05:05:40.141665 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.141647    2564 scope.go:117] "RemoveContainer" containerID="417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77"
Jul 22 05:05:40.150002 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.149977    2564 scope.go:117] "RemoveContainer" containerID="b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79"
Jul 22 05:05:40.150337 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:05:40.150309    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79\": container with ID starting with b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79 not found: ID does not exist" containerID="b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79"
Jul 22 05:05:40.150462 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.150356    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79"} err="failed to get container status \"b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79\": rpc error: code = NotFound desc = could not find container \"b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79\": container with ID starting with b78c5e528ca9b1072d33425692fcabdaad4200b14438feb6d262309b669cba79 not found: ID does not exist"
Jul 22 05:05:40.150462 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.150387    2564 scope.go:117] "RemoveContainer" containerID="417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77"
Jul 22 05:05:40.151095 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:05:40.151067    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77\": container with ID starting with 417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77 not found: ID does not exist" containerID="417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77"
Jul 22 05:05:40.151181 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.151103    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77"} err="failed to get container status \"417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77\": rpc error: code = NotFound desc = could not find container \"417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77\": container with ID starting with 417ae92fcfdb901795d38ea89459c7057bf14008254042d48ca27f5b2ebadb77 not found: ID does not exist"
Jul 22 05:05:40.152991 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.152972    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"]
Jul 22 05:05:40.156460 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:40.156406    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e9e018-openshift-default-88f8b95b9-ttqtg"]
Jul 22 05:05:41.171519 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:41.171485    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" path="/var/lib/kubelet/pods/74d5f3e9-8334-4ddd-a929-95175dffdc38/volumes"
Jul 22 05:05:45.472439 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.472403    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"]
Jul 22 05:05:45.472935 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.472647    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj" podUID="a96a8126-2a8d-4470-9f48-76f8de8714fd" containerName="maas-api" containerID="cri-o://62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054" gracePeriod=30
Jul 22 05:05:45.730921 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.730894    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:05:45.757547 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.757511    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls\") pod \"a96a8126-2a8d-4470-9f48-76f8de8714fd\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") "
Jul 22 05:05:45.757713 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.757571    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kb8w\" (UniqueName: \"kubernetes.io/projected/a96a8126-2a8d-4470-9f48-76f8de8714fd-kube-api-access-6kb8w\") pod \"a96a8126-2a8d-4470-9f48-76f8de8714fd\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") "
Jul 22 05:05:45.757713 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.757644    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a96a8126-2a8d-4470-9f48-76f8de8714fd-openshift-service-ca\") pod \"a96a8126-2a8d-4470-9f48-76f8de8714fd\" (UID: \"a96a8126-2a8d-4470-9f48-76f8de8714fd\") "
Jul 22 05:05:45.758023 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.758000    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96a8126-2a8d-4470-9f48-76f8de8714fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a96a8126-2a8d-4470-9f48-76f8de8714fd" (UID: "a96a8126-2a8d-4470-9f48-76f8de8714fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:05:45.759819 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.759791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96a8126-2a8d-4470-9f48-76f8de8714fd-kube-api-access-6kb8w" (OuterVolumeSpecName: "kube-api-access-6kb8w") pod "a96a8126-2a8d-4470-9f48-76f8de8714fd" (UID: "a96a8126-2a8d-4470-9f48-76f8de8714fd"). InnerVolumeSpecName "kube-api-access-6kb8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:05:45.759819 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.759804    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a96a8126-2a8d-4470-9f48-76f8de8714fd" (UID: "a96a8126-2a8d-4470-9f48-76f8de8714fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:05:45.859225 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.859187    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a96a8126-2a8d-4470-9f48-76f8de8714fd-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:45.859225 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.859217    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kb8w\" (UniqueName: \"kubernetes.io/projected/a96a8126-2a8d-4470-9f48-76f8de8714fd-kube-api-access-6kb8w\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:45.859225 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:45.859228    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a96a8126-2a8d-4470-9f48-76f8de8714fd-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:05:46.165230 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.165193    2564 generic.go:356] "Generic (PLEG): container finished" podID="a96a8126-2a8d-4470-9f48-76f8de8714fd" containerID="62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054" exitCode=0
Jul 22 05:05:46.165412 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.165235    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"
Jul 22 05:05:46.165412 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.165279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj" event={"ID":"a96a8126-2a8d-4470-9f48-76f8de8714fd","Type":"ContainerDied","Data":"62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054"}
Jul 22 05:05:46.165412 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.165323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj" event={"ID":"a96a8126-2a8d-4470-9f48-76f8de8714fd","Type":"ContainerDied","Data":"18c3132b7a204dbb546c1cc84f49e2fc3b9ba2c5049fe7efa58c7582dca49e78"}
Jul 22 05:05:46.165412 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.165352    2564 scope.go:117] "RemoveContainer" containerID="62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054"
Jul 22 05:05:46.173870 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.173851    2564 scope.go:117] "RemoveContainer" containerID="62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054"
Jul 22 05:05:46.174126 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:05:46.174107    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054\": container with ID starting with 62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054 not found: ID does not exist" containerID="62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054"
Jul 22 05:05:46.174186 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.174134    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054"} err="failed to get container status \"62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054\": rpc error: code = NotFound desc = could not find container \"62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054\": container with ID starting with 62da66c07e29b98e899336e49a27b60fed5e03baf2b92821529af8949459d054 not found: ID does not exist"
Jul 22 05:05:46.186028 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.185872    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"]
Jul 22 05:05:46.187995 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:46.187972    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-33bb6b-75f77448df-77xfj"]
Jul 22 05:05:47.172537 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:47.172502    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a96a8126-2a8d-4470-9f48-76f8de8714fd" path="/var/lib/kubelet/pods/a96a8126-2a8d-4470-9f48-76f8de8714fd/volumes"
Jul 22 05:05:50.000173 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:50.000132    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"]
Jul 22 05:05:50.003600 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:50.003575    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-33bb6b-vl7cd"]
Jul 22 05:05:51.171398 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:51.171352    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a218a44a-8224-417a-ba72-1683ab18980b" path="/var/lib/kubelet/pods/a218a44a-8224-417a-ba72-1683ab18980b/volumes"
Jul 22 05:05:57.262219 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262185    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"]
Jul 22 05:05:57.262817 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262796    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96a8126-2a8d-4470-9f48-76f8de8714fd" containerName="maas-api"
Jul 22 05:05:57.262909 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262819    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96a8126-2a8d-4470-9f48-76f8de8714fd" containerName="maas-api"
Jul 22 05:05:57.262909 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262832    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy"
Jul 22 05:05:57.262909 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262840    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy"
Jul 22 05:05:57.262909 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262861    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a218a44a-8224-417a-ba72-1683ab18980b" containerName="revoke-keys"
Jul 22 05:05:57.262909 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262870    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a218a44a-8224-417a-ba72-1683ab18980b" containerName="revoke-keys"
Jul 22 05:05:57.262909 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262883    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy"
Jul 22 05:05:57.262909 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262892    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy"
Jul 22 05:05:57.263246 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.262988    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a96a8126-2a8d-4470-9f48-76f8de8714fd" containerName="maas-api"
Jul 22 05:05:57.263246 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.263003    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy"
Jul 22 05:05:57.263246 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.263015    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="74d5f3e9-8334-4ddd-a929-95175dffdc38" containerName="istio-proxy"
Jul 22 05:05:57.263246 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.263023    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a218a44a-8224-417a-ba72-1683ab18980b" containerName="revoke-keys"
Jul 22 05:05:57.266250 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.266229    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.268766 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.268722    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e75fa2-openshift-default-dockercfg-26tsn\""
Jul 22 05:05:57.276070 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.276035    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"]
Jul 22 05:05:57.363213 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istiod-ca-cert\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.363213 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-socket\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.363423 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-envoy\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.363423 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-data\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.363423 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-podinfo\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.363423 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363359    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7vbt\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-kube-api-access-h7vbt\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.363576 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-certs\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.363576 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-credential-socket\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.363576 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.363486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-token\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.464890 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.464853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-data\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.464890 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.464893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-podinfo\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465112 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.464913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7vbt\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-kube-api-access-h7vbt\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465112 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.464936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-certs\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465214 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-credential-socket\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465214 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-token\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465321 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istiod-ca-cert\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465321 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-certs\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465321 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-socket\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465488 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-data\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465488 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-envoy\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465488 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-credential-socket\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465654 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-socket\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.465981 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.465959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istiod-ca-cert\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.467361 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.467340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-envoy\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.467564 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.467546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-podinfo\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.473164 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.473144    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-token\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.473279 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.473188    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7vbt\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-kube-api-access-h7vbt\") pod \"e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") " pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.578074 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.577973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:57.718368 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.718310    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"]
Jul 22 05:05:57.725237 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:05:57.725194    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68dc8e10_20e5_4ce7_822a_e68d95d6bc8d.slice/crio-5c06be54ca91bc5436af53b9086e33e420c8b4a4531006df93cd538ebf5aa13b WatchSource:0}: Error finding container 5c06be54ca91bc5436af53b9086e33e420c8b4a4531006df93cd538ebf5aa13b: Status 404 returned error can't find the container with id 5c06be54ca91bc5436af53b9086e33e420c8b4a4531006df93cd538ebf5aa13b
Jul 22 05:05:57.727357 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.727322    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:05:57.727444 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.727393    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:05:57.727444 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:57.727425    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:05:58.225190 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:58.225151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" event={"ID":"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d","Type":"ContainerStarted","Data":"97b7c22a99527843ed6873375d7e03464972325b4f11962cba6ce8f4fd655a27"}
Jul 22 05:05:58.225414 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:58.225210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" event={"ID":"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d","Type":"ContainerStarted","Data":"5c06be54ca91bc5436af53b9086e33e420c8b4a4531006df93cd538ebf5aa13b"}
Jul 22 05:05:58.246753 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:58.246672    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" podStartSLOduration=1.246652527 podStartE2EDuration="1.246652527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:05:58.245595626 +0000 UTC m=+2473.529461050" watchObservedRunningTime="2026-07-22 05:05:58.246652527 +0000 UTC m=+2473.530517923"
Jul 22 05:05:58.578156 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:58.578118    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:58.583122 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:58.583099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:59.230486 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:59.230457    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:05:59.231351 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:05:59.231333    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:06:00.236413 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.236381    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"]
Jul 22 05:06:00.239983 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.239960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.242174 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.242152    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e75fa2-serving-cert\""
Jul 22 05:06:00.242292 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.242215    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tcl88\""
Jul 22 05:06:00.251308 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.251282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"]
Jul 22 05:06:00.289118 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.289080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmxtz\" (UniqueName: \"kubernetes.io/projected/9c3c2364-b0dd-485e-b881-e7dec838d03a-kube-api-access-cmxtz\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.289306 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.289257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.289376 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.289313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3c2364-b0dd-485e-b881-e7dec838d03a-openshift-service-ca\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.390840 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.390800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.391045 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.390862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3c2364-b0dd-485e-b881-e7dec838d03a-openshift-service-ca\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.391045 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:06:00.390946    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-serving-cert: secret "maas-api-e2e-api-a-e75fa2-serving-cert" not found
Jul 22 05:06:00.391045 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:06:00.391016    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls podName:9c3c2364-b0dd-485e-b881-e7dec838d03a nodeName:}" failed. No retries permitted until 2026-07-22 05:06:00.891000053 +0000 UTC m=+2476.174865426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls") pod "maas-api-e2e-api-a-e75fa2-554985465c-c2q5w" (UID: "9c3c2364-b0dd-485e-b881-e7dec838d03a") : secret "maas-api-e2e-api-a-e75fa2-serving-cert" not found
Jul 22 05:06:00.391045 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.391033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmxtz\" (UniqueName: \"kubernetes.io/projected/9c3c2364-b0dd-485e-b881-e7dec838d03a-kube-api-access-cmxtz\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.391438 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.391420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3c2364-b0dd-485e-b881-e7dec838d03a-openshift-service-ca\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.399204 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.399183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmxtz\" (UniqueName: \"kubernetes.io/projected/9c3c2364-b0dd-485e-b881-e7dec838d03a-kube-api-access-cmxtz\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.898693 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:00.898647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:00.898920 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:06:00.898831    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-serving-cert: secret "maas-api-e2e-api-a-e75fa2-serving-cert" not found
Jul 22 05:06:00.898920 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:06:00.898901    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls podName:9c3c2364-b0dd-485e-b881-e7dec838d03a nodeName:}" failed. No retries permitted until 2026-07-22 05:06:01.898885532 +0000 UTC m=+2477.182750905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls") pod "maas-api-e2e-api-a-e75fa2-554985465c-c2q5w" (UID: "9c3c2364-b0dd-485e-b881-e7dec838d03a") : secret "maas-api-e2e-api-a-e75fa2-serving-cert" not found
Jul 22 05:06:01.908245 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:01.908202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:01.910810 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:01.910785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls\") pod \"maas-api-e2e-api-a-e75fa2-554985465c-c2q5w\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:02.052267 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:02.052228    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:02.196368 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:02.196341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"]
Jul 22 05:06:02.198676 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:06:02.198650    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3c2364_b0dd_485e_b881_e7dec838d03a.slice/crio-0f102dd35f230180f6e3f7b00d36add569f6c50a8643003831aad1f3b2817bed WatchSource:0}: Error finding container 0f102dd35f230180f6e3f7b00d36add569f6c50a8643003831aad1f3b2817bed: Status 404 returned error can't find the container with id 0f102dd35f230180f6e3f7b00d36add569f6c50a8643003831aad1f3b2817bed
Jul 22 05:06:02.247512 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:02.247473    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w" event={"ID":"9c3c2364-b0dd-485e-b881-e7dec838d03a","Type":"ContainerStarted","Data":"0f102dd35f230180f6e3f7b00d36add569f6c50a8643003831aad1f3b2817bed"}
Jul 22 05:06:03.253800 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:03.253729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w" event={"ID":"9c3c2364-b0dd-485e-b881-e7dec838d03a","Type":"ContainerStarted","Data":"08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855"}
Jul 22 05:06:03.254264 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:03.253893    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:03.272391 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:03.272335    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w" podStartSLOduration=2.727462999 podStartE2EDuration="3.272316598s" totalImagesPullingTime="544.853599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:06:03.270344054 +0000 UTC m=+2478.554209484" watchObservedRunningTime="2026-07-22 05:06:03.272316598 +0000 UTC m=+2478.556181993"
Jul 22 05:06:08.560125 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.560083    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"]
Jul 22 05:06:08.563836 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.563818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.566284 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.566259    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-db800e-serving-cert\""
Jul 22 05:06:08.576164 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.576136    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"]
Jul 22 05:06:08.673808 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.673762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2z2g\" (UniqueName: \"kubernetes.io/projected/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-kube-api-access-g2z2g\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.673979 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.673911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-maas-api-tls\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.673979 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.673951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-openshift-service-ca\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.774473 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.774436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-maas-api-tls\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.774473 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.774486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-openshift-service-ca\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.774753 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.774539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2z2g\" (UniqueName: \"kubernetes.io/projected/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-kube-api-access-g2z2g\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.775234 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.775211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-openshift-service-ca\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.776957 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.776940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-maas-api-tls\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.782276 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.782249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2z2g\" (UniqueName: \"kubernetes.io/projected/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-kube-api-access-g2z2g\") pod \"maas-api-e2e-api-b-db800e-585b798787-vvpbv\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:08.875308 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:08.875210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:09.018797 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:09.017509    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"]
Jul 22 05:06:09.021267 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:06:09.021228    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbe3dd6_58ee_41e7_8150_01022a1e04ed.slice/crio-cc8270e4ad08e3ef4f2a7fbded4c8c8d4341d7ebe0ea91269d2e191e0b4139f2 WatchSource:0}: Error finding container cc8270e4ad08e3ef4f2a7fbded4c8c8d4341d7ebe0ea91269d2e191e0b4139f2: Status 404 returned error can't find the container with id cc8270e4ad08e3ef4f2a7fbded4c8c8d4341d7ebe0ea91269d2e191e0b4139f2
Jul 22 05:06:09.265178 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:09.265149    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:09.285193 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:09.285161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv" event={"ID":"cbbe3dd6-58ee-41e7-8150-01022a1e04ed","Type":"ContainerStarted","Data":"cc8270e4ad08e3ef4f2a7fbded4c8c8d4341d7ebe0ea91269d2e191e0b4139f2"}
Jul 22 05:06:10.291913 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:10.291878    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv" event={"ID":"cbbe3dd6-58ee-41e7-8150-01022a1e04ed","Type":"ContainerStarted","Data":"5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f"}
Jul 22 05:06:10.292312 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:10.291957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:10.308161 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:10.308108    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv" podStartSLOduration=1.558120738 podStartE2EDuration="2.308089265s" totalImagesPullingTime="749.968527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:06:10.306924228 +0000 UTC m=+2485.590789623" watchObservedRunningTime="2026-07-22 05:06:10.308089265 +0000 UTC m=+2485.591954661"
Jul 22 05:06:15.272932 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:15.272883    2564 patch_prober.go:28] interesting pod/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 05:06:15.273322 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:15.272944    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 05:06:16.302692 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:16.302665    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:06:16.326612 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:16.326582    2564 generic.go:356] "Generic (PLEG): container finished" podID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerID="97b7c22a99527843ed6873375d7e03464972325b4f11962cba6ce8f4fd655a27" exitCode=0
Jul 22 05:06:16.326804 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:16.326657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" event={"ID":"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d","Type":"ContainerDied","Data":"97b7c22a99527843ed6873375d7e03464972325b4f11962cba6ce8f4fd655a27"}
Jul 22 05:06:16.327104 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:16.327085    2564 scope.go:117] "RemoveContainer" containerID="97b7c22a99527843ed6873375d7e03464972325b4f11962cba6ce8f4fd655a27"
Jul 22 05:06:16.328146 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:16.328121    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:06:16.328207 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:16.328194    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:06:16.328249 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:16.328228    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:06:17.334790 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:17.334752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" event={"ID":"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d","Type":"ContainerStarted","Data":"59868cea9787852bc61816b098de54db22cef81c1983b716c90b69741efd2c1e"}
Jul 22 05:06:17.578902 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:17.578853    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:06:17.579229 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:17.579205    2564 patch_prober.go:28] interesting pod/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 05:06:17.579276 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:17.579258    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 05:06:18.578389 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:18.578348    2564 patch_prober.go:28] interesting pod/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 05:06:18.578870 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:18.578408    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 05:06:19.578566 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:19.578531    2564 patch_prober.go:28] interesting pod/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 05:06:19.579012 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:19.578589    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 05:06:20.578605 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:20.578568    2564 patch_prober.go:28] interesting pod/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 05:06:20.579000 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:20.578629    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 05:06:21.579242 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:21.579201    2564 patch_prober.go:28] interesting pod/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 05:06:21.579718 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:21.579267    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 05:06:22.581901 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:22.581869    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:06:22.582284 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:22.582148    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:06:22.582946 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:22.582930    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:06:36.933504 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:36.933467    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"]
Jul 22 05:06:36.934230 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:36.933717    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w" podUID="9c3c2364-b0dd-485e-b881-e7dec838d03a" containerName="maas-api" containerID="cri-o://08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855" gracePeriod=30
Jul 22 05:06:37.199313 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.199244    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:37.244655 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.244618    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmxtz\" (UniqueName: \"kubernetes.io/projected/9c3c2364-b0dd-485e-b881-e7dec838d03a-kube-api-access-cmxtz\") pod \"9c3c2364-b0dd-485e-b881-e7dec838d03a\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") "
Jul 22 05:06:37.244851 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.244715    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3c2364-b0dd-485e-b881-e7dec838d03a-openshift-service-ca\") pod \"9c3c2364-b0dd-485e-b881-e7dec838d03a\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") "
Jul 22 05:06:37.244851 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.244748    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls\") pod \"9c3c2364-b0dd-485e-b881-e7dec838d03a\" (UID: \"9c3c2364-b0dd-485e-b881-e7dec838d03a\") "
Jul 22 05:06:37.245198 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.245164    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c3c2364-b0dd-485e-b881-e7dec838d03a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c3c2364-b0dd-485e-b881-e7dec838d03a" (UID: "9c3c2364-b0dd-485e-b881-e7dec838d03a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:06:37.246965 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.246938    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c3c2364-b0dd-485e-b881-e7dec838d03a" (UID: "9c3c2364-b0dd-485e-b881-e7dec838d03a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:06:37.246965 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.246951    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3c2364-b0dd-485e-b881-e7dec838d03a-kube-api-access-cmxtz" (OuterVolumeSpecName: "kube-api-access-cmxtz") pod "9c3c2364-b0dd-485e-b881-e7dec838d03a" (UID: "9c3c2364-b0dd-485e-b881-e7dec838d03a"). InnerVolumeSpecName "kube-api-access-cmxtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:06:37.346161 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.346125    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3c2364-b0dd-485e-b881-e7dec838d03a-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:37.346161 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.346157    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3c2364-b0dd-485e-b881-e7dec838d03a-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:37.346161 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.346166    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmxtz\" (UniqueName: \"kubernetes.io/projected/9c3c2364-b0dd-485e-b881-e7dec838d03a-kube-api-access-cmxtz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:37.439275 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.439226    2564 generic.go:356] "Generic (PLEG): container finished" podID="9c3c2364-b0dd-485e-b881-e7dec838d03a" containerID="08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855" exitCode=0
Jul 22 05:06:37.439443 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.439276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w" event={"ID":"9c3c2364-b0dd-485e-b881-e7dec838d03a","Type":"ContainerDied","Data":"08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855"}
Jul 22 05:06:37.439443 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.439256    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"
Jul 22 05:06:37.439443 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.439329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w" event={"ID":"9c3c2364-b0dd-485e-b881-e7dec838d03a","Type":"ContainerDied","Data":"0f102dd35f230180f6e3f7b00d36add569f6c50a8643003831aad1f3b2817bed"}
Jul 22 05:06:37.439443 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.439351    2564 scope.go:117] "RemoveContainer" containerID="08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855"
Jul 22 05:06:37.448991 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.448969    2564 scope.go:117] "RemoveContainer" containerID="08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855"
Jul 22 05:06:37.449260 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:06:37.449243    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855\": container with ID starting with 08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855 not found: ID does not exist" containerID="08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855"
Jul 22 05:06:37.449312 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.449269    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855"} err="failed to get container status \"08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855\": rpc error: code = NotFound desc = could not find container \"08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855\": container with ID starting with 08dfaab30c0318681eaff41146783e39acfe1a52eeb7492e7eaafd6b7bb57855 not found: ID does not exist"
Jul 22 05:06:37.460782 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.460685    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"]
Jul 22 05:06:37.463224 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:37.463197    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e75fa2-554985465c-c2q5w"]
Jul 22 05:06:39.171384 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:39.171351    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3c2364-b0dd-485e-b881-e7dec838d03a" path="/var/lib/kubelet/pods/9c3c2364-b0dd-485e-b881-e7dec838d03a/volumes"
Jul 22 05:06:45.392593 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:45.392562    2564 scope.go:117] "RemoveContainer" containerID="eff9f614586f431d5af220c464dbbd9e3ada5824d249c64a0fc3184b288c73c2"
Jul 22 05:06:47.278938 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.278900    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"]
Jul 22 05:06:47.279412 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.279172    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy" containerID="cri-o://59868cea9787852bc61816b098de54db22cef81c1983b716c90b69741efd2c1e" gracePeriod=30
Jul 22 05:06:47.639773 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.639652    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"]
Jul 22 05:06:47.640061 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.640046    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3c2364-b0dd-485e-b881-e7dec838d03a" containerName="maas-api"
Jul 22 05:06:47.640061 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.640061    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3c2364-b0dd-485e-b881-e7dec838d03a" containerName="maas-api"
Jul 22 05:06:47.640211 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.640127    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3c2364-b0dd-485e-b881-e7dec838d03a" containerName="maas-api"
Jul 22 05:06:47.644851 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.644825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"
Jul 22 05:06:47.647334 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.647307    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 05:06:47.648604 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.648577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"]
Jul 22 05:06:47.740443 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.740404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083e7922-0b2b-4712-b745-d423a8ec1fd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-db800e-pqrl5\" (UID: \"083e7922-0b2b-4712-b745-d423a8ec1fd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"
Jul 22 05:06:47.841639 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.841603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083e7922-0b2b-4712-b745-d423a8ec1fd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-db800e-pqrl5\" (UID: \"083e7922-0b2b-4712-b745-d423a8ec1fd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"
Jul 22 05:06:47.842252 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.842232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083e7922-0b2b-4712-b745-d423a8ec1fd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-db800e-pqrl5\" (UID: \"083e7922-0b2b-4712-b745-d423a8ec1fd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"
Jul 22 05:06:47.958706 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:47.958613    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"
Jul 22 05:06:48.300441 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:48.300381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"]
Jul 22 05:06:48.303031 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:06:48.303005    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083e7922_0b2b_4712_b745_d423a8ec1fd3.slice/crio-3a647cba975bc93edf65bdd3ccd4c88ef56941bfa64a7be3f6909193c41abcff WatchSource:0}: Error finding container 3a647cba975bc93edf65bdd3ccd4c88ef56941bfa64a7be3f6909193c41abcff: Status 404 returned error can't find the container with id 3a647cba975bc93edf65bdd3ccd4c88ef56941bfa64a7be3f6909193c41abcff
Jul 22 05:06:48.492414 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:48.492376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5" event={"ID":"083e7922-0b2b-4712-b745-d423a8ec1fd3","Type":"ContainerStarted","Data":"3a647cba975bc93edf65bdd3ccd4c88ef56941bfa64a7be3f6909193c41abcff"}
Jul 22 05:06:49.498857 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:49.498828    2564 generic.go:356] "Generic (PLEG): container finished" podID="083e7922-0b2b-4712-b745-d423a8ec1fd3" containerID="26225782533a106f8a5542dc561f02f5f38690412596259c1bec439967436d70" exitCode=0
Jul 22 05:06:49.499240 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:49.498889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5" event={"ID":"083e7922-0b2b-4712-b745-d423a8ec1fd3","Type":"ContainerDied","Data":"26225782533a106f8a5542dc561f02f5f38690412596259c1bec439967436d70"}
Jul 22 05:06:50.639367 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:50.639337    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"
Jul 22 05:06:50.770166 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:50.770057    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083e7922-0b2b-4712-b745-d423a8ec1fd3-maas-api-service-ca\") pod \"083e7922-0b2b-4712-b745-d423a8ec1fd3\" (UID: \"083e7922-0b2b-4712-b745-d423a8ec1fd3\") "
Jul 22 05:06:50.770423 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:50.770398    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/083e7922-0b2b-4712-b745-d423a8ec1fd3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "083e7922-0b2b-4712-b745-d423a8ec1fd3" (UID: "083e7922-0b2b-4712-b745-d423a8ec1fd3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:06:50.871450 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:50.871412    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/083e7922-0b2b-4712-b745-d423a8ec1fd3-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:51.509899 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:51.509873    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"
Jul 22 05:06:51.510075 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:51.509903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5" event={"ID":"083e7922-0b2b-4712-b745-d423a8ec1fd3","Type":"ContainerDied","Data":"3a647cba975bc93edf65bdd3ccd4c88ef56941bfa64a7be3f6909193c41abcff"}
Jul 22 05:06:51.510075 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:51.509945    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a647cba975bc93edf65bdd3ccd4c88ef56941bfa64a7be3f6909193c41abcff"
Jul 22 05:06:52.518126 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.518090    2564 generic.go:356] "Generic (PLEG): container finished" podID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerID="59868cea9787852bc61816b098de54db22cef81c1983b716c90b69741efd2c1e" exitCode=0
Jul 22 05:06:52.518486 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.518158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" event={"ID":"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d","Type":"ContainerDied","Data":"59868cea9787852bc61816b098de54db22cef81c1983b716c90b69741efd2c1e"}
Jul 22 05:06:52.518486 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.518245    2564 scope.go:117] "RemoveContainer" containerID="97b7c22a99527843ed6873375d7e03464972325b4f11962cba6ce8f4fd655a27"
Jul 22 05:06:52.539344 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.539324    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:06:52.690318 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690225    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-credential-socket\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690318 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690296    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-envoy\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690318 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-podinfo\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690609 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690349    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-certs\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690609 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690372    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-token\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690609 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-data\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690609 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istiod-ca-cert\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690609 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690493    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7vbt\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-kube-api-access-h7vbt\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690609 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690520    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-socket\") pod \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\" (UID: \"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d\") "
Jul 22 05:06:52.690949 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690513    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:52.690949 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690641    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:52.690949 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690840    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:52.690949 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.690910    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:06:52.691826 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.691789    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-data" (OuterVolumeSpecName: "istio-data") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:52.692767 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.692722    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-kube-api-access-h7vbt" (OuterVolumeSpecName: "kube-api-access-h7vbt") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "kube-api-access-h7vbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:06:52.692767 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.692757    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-token" (OuterVolumeSpecName: "istio-token") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:06:52.692904 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.692757    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 05:06:52.692904 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.692854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" (UID: "68dc8e10-20e5-4ce7-822a-e68d95d6bc8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:06:52.792258 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792217    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7vbt\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-kube-api-access-h7vbt\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:52.792258 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792253    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:52.792258 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792262    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:52.792503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792276    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:52.792503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792289    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:52.792503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792296    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:52.792503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792304    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:52.792503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792311    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:52.792503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:52.792318    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:06:53.524104 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:53.524070    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"
Jul 22 05:06:53.524610 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:53.524072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr" event={"ID":"68dc8e10-20e5-4ce7-822a-e68d95d6bc8d","Type":"ContainerDied","Data":"5c06be54ca91bc5436af53b9086e33e420c8b4a4531006df93cd538ebf5aa13b"}
Jul 22 05:06:53.524610 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:53.524202    2564 scope.go:117] "RemoveContainer" containerID="59868cea9787852bc61816b098de54db22cef81c1983b716c90b69741efd2c1e"
Jul 22 05:06:53.554577 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:53.554541    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"]
Jul 22 05:06:53.557750 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:53.557713    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e75fa2-openshift-default-5498bfbcf-jsvlr"]
Jul 22 05:06:55.171868 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:06:55.171838    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" path="/var/lib/kubelet/pods/68dc8e10-20e5-4ce7-822a-e68d95d6bc8d/volumes"
Jul 22 05:07:03.032021 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.031969    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"]
Jul 22 05:07:03.032473 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.032230    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv" podUID="cbbe3dd6-58ee-41e7-8150-01022a1e04ed" containerName="maas-api" containerID="cri-o://5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f" gracePeriod=30
Jul 22 05:07:03.292545 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.292484    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:07:03.388251 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.388199    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-openshift-service-ca\") pod \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") "
Jul 22 05:07:03.388776 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.388276    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-maas-api-tls\") pod \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") "
Jul 22 05:07:03.388776 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.388394    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2z2g\" (UniqueName: \"kubernetes.io/projected/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-kube-api-access-g2z2g\") pod \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\" (UID: \"cbbe3dd6-58ee-41e7-8150-01022a1e04ed\") "
Jul 22 05:07:03.388776 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.388633    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cbbe3dd6-58ee-41e7-8150-01022a1e04ed" (UID: "cbbe3dd6-58ee-41e7-8150-01022a1e04ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:07:03.390306 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.390273    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cbbe3dd6-58ee-41e7-8150-01022a1e04ed" (UID: "cbbe3dd6-58ee-41e7-8150-01022a1e04ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:07:03.390405 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.390383    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-kube-api-access-g2z2g" (OuterVolumeSpecName: "kube-api-access-g2z2g") pod "cbbe3dd6-58ee-41e7-8150-01022a1e04ed" (UID: "cbbe3dd6-58ee-41e7-8150-01022a1e04ed"). InnerVolumeSpecName "kube-api-access-g2z2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:07:03.489518 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.489458    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2z2g\" (UniqueName: \"kubernetes.io/projected/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-kube-api-access-g2z2g\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:07:03.489518 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.489511    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:07:03.489518 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.489526    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe3dd6-58ee-41e7-8150-01022a1e04ed-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:07:03.575154 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.575052    2564 generic.go:356] "Generic (PLEG): container finished" podID="cbbe3dd6-58ee-41e7-8150-01022a1e04ed" containerID="5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f" exitCode=0
Jul 22 05:07:03.575154 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.575102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv" event={"ID":"cbbe3dd6-58ee-41e7-8150-01022a1e04ed","Type":"ContainerDied","Data":"5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f"}
Jul 22 05:07:03.575154 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.575120    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"
Jul 22 05:07:03.575436 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.575169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv" event={"ID":"cbbe3dd6-58ee-41e7-8150-01022a1e04ed","Type":"ContainerDied","Data":"cc8270e4ad08e3ef4f2a7fbded4c8c8d4341d7ebe0ea91269d2e191e0b4139f2"}
Jul 22 05:07:03.575436 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.575193    2564 scope.go:117] "RemoveContainer" containerID="5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f"
Jul 22 05:07:03.584699 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.584678    2564 scope.go:117] "RemoveContainer" containerID="5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f"
Jul 22 05:07:03.585010 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:07:03.584988    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f\": container with ID starting with 5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f not found: ID does not exist" containerID="5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f"
Jul 22 05:07:03.585091 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.585017    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f"} err="failed to get container status \"5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f\": rpc error: code = NotFound desc = could not find container \"5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f\": container with ID starting with 5c15e1f4bd5be8a86b144fa0805c2da1dcfedcf7411d8206ac5b0afea44aa37f not found: ID does not exist"
Jul 22 05:07:03.606869 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.606838    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"]
Jul 22 05:07:03.617518 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:03.617478    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-db800e-585b798787-vvpbv"]
Jul 22 05:07:05.170915 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:05.170887    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbbe3dd6-58ee-41e7-8150-01022a1e04ed" path="/var/lib/kubelet/pods/cbbe3dd6-58ee-41e7-8150-01022a1e04ed/volumes"
Jul 22 05:07:07.713143 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:07.713103    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"]
Jul 22 05:07:07.715560 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:07.715535    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-db800e-pqrl5"]
Jul 22 05:07:09.171264 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:09.171231    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="083e7922-0b2b-4712-b745-d423a8ec1fd3" path="/var/lib/kubelet/pods/083e7922-0b2b-4712-b745-d423a8ec1fd3/volumes"
Jul 22 05:07:14.987520 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.987485    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"]
Jul 22 05:07:14.988153 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988133    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy"
Jul 22 05:07:14.988235 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988155    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy"
Jul 22 05:07:14.988235 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988169    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbe3dd6-58ee-41e7-8150-01022a1e04ed" containerName="maas-api"
Jul 22 05:07:14.988235 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988178    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbe3dd6-58ee-41e7-8150-01022a1e04ed" containerName="maas-api"
Jul 22 05:07:14.988235 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988199    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="083e7922-0b2b-4712-b745-d423a8ec1fd3" containerName="revoke-keys"
Jul 22 05:07:14.988235 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988208    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="083e7922-0b2b-4712-b745-d423a8ec1fd3" containerName="revoke-keys"
Jul 22 05:07:14.988235 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988222    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy"
Jul 22 05:07:14.988235 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988231    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy"
Jul 22 05:07:14.988471 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988327    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy"
Jul 22 05:07:14.988471 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988337    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbe3dd6-58ee-41e7-8150-01022a1e04ed" containerName="maas-api"
Jul 22 05:07:14.988471 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988346    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dc8e10-20e5-4ce7-822a-e68d95d6bc8d" containerName="istio-proxy"
Jul 22 05:07:14.988471 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.988353    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="083e7922-0b2b-4712-b745-d423a8ec1fd3" containerName="revoke-keys"
Jul 22 05:07:14.993258 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.993238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:14.995600 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:14.995580    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-81d7ca-openshift-default-dockercfg-cltgp\""
Jul 22 05:07:15.002554 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.002528    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"]
Jul 22 05:07:15.085371 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-credential-socket\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.085371 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-envoy\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.085589 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-data\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.085589 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-token\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.085589 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgjwz\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-kube-api-access-pgjwz\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.085689 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ee1528-d298-4ffe-ae13-09ab66757dfa-istiod-ca-cert\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.085689 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-certs\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.085689 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-socket\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.085689 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.085673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-podinfo\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.186569 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-credential-socket\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.186569 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-envoy\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.186849 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-data\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.186849 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-token\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.186849 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgjwz\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-kube-api-access-pgjwz\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.186849 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ee1528-d298-4ffe-ae13-09ab66757dfa-istiod-ca-cert\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.186849 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-certs\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.186849 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-socket\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.187154 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.187010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-credential-socket\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.187154 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.187087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-socket\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.187154 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.186953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-podinfo\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.187290 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.187169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-data\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.187290 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.187194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-certs\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.187499 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.187475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ee1528-d298-4ffe-ae13-09ab66757dfa-istiod-ca-cert\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.188808 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.188790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-envoy\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.189424 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.189408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-podinfo\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.194965 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.194945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-token\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.195208 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.195187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgjwz\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-kube-api-access-pgjwz\") pod \"e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") " pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.305506 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.305404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:15.448714 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.448687    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"]
Jul 22 05:07:15.451576 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:07:15.451547    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ee1528_d298_4ffe_ae13_09ab66757dfa.slice/crio-1390b0481f54c9e8c3701b3affeb023d8f2d6be9166aea3b00be81747b0ba3a5 WatchSource:0}: Error finding container 1390b0481f54c9e8c3701b3affeb023d8f2d6be9166aea3b00be81747b0ba3a5: Status 404 returned error can't find the container with id 1390b0481f54c9e8c3701b3affeb023d8f2d6be9166aea3b00be81747b0ba3a5
Jul 22 05:07:15.454271 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.454233    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:07:15.454352 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.454305    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:07:15.454352 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.454335    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:07:15.635320 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.635223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" event={"ID":"73ee1528-d298-4ffe-ae13-09ab66757dfa","Type":"ContainerStarted","Data":"41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487"}
Jul 22 05:07:15.635320 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.635287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" event={"ID":"73ee1528-d298-4ffe-ae13-09ab66757dfa","Type":"ContainerStarted","Data":"1390b0481f54c9e8c3701b3affeb023d8f2d6be9166aea3b00be81747b0ba3a5"}
Jul 22 05:07:15.654971 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:15.654914    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" podStartSLOduration=1.65489781 podStartE2EDuration="1.65489781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:07:15.652472138 +0000 UTC m=+2550.936337554" watchObservedRunningTime="2026-07-22 05:07:15.65489781 +0000 UTC m=+2550.938763205"
Jul 22 05:07:16.305951 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:16.305909    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:16.310922 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:16.310897    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:16.640395 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:16.640313    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:16.641412 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:16.641395    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:17.684638 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.684600    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"]
Jul 22 05:07:17.688300 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.688272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:17.690854 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.690826    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tcl88\""
Jul 22 05:07:17.690994 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.690856    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-81d7ca-serving-cert\""
Jul 22 05:07:17.697723 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.697673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"]
Jul 22 05:07:17.709743 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.709698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvc4d\" (UniqueName: \"kubernetes.io/projected/5a181634-dad4-4ea5-8fda-270a4e054137-kube-api-access-cvc4d\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:17.709929 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.709896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:17.710121 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.709992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a181634-dad4-4ea5-8fda-270a4e054137-openshift-service-ca\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:17.810865 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.810826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvc4d\" (UniqueName: \"kubernetes.io/projected/5a181634-dad4-4ea5-8fda-270a4e054137-kube-api-access-cvc4d\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:17.811073 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.810876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:17.811073 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.810902    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a181634-dad4-4ea5-8fda-270a4e054137-openshift-service-ca\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:17.811073 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:07:17.811026    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-serving-cert: secret "maas-api-e2e-shared-a-81d7ca-serving-cert" not found
Jul 22 05:07:17.811237 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:07:17.811099    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls podName:5a181634-dad4-4ea5-8fda-270a4e054137 nodeName:}" failed. No retries permitted until 2026-07-22 05:07:18.311081865 +0000 UTC m=+2553.594947238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls") pod "maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt" (UID: "5a181634-dad4-4ea5-8fda-270a4e054137") : secret "maas-api-e2e-shared-a-81d7ca-serving-cert" not found
Jul 22 05:07:17.811518 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.811501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a181634-dad4-4ea5-8fda-270a4e054137-openshift-service-ca\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:17.822383 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:17.822346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvc4d\" (UniqueName: \"kubernetes.io/projected/5a181634-dad4-4ea5-8fda-270a4e054137-kube-api-access-cvc4d\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:18.316227 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:18.316187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:18.318797 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:18.318767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls\") pod \"maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:18.600811 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:18.600711    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:18.746989 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:18.746966    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"]
Jul 22 05:07:18.749018 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:07:18.748986    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a181634_dad4_4ea5_8fda_270a4e054137.slice/crio-df800155418e06eb4ba1f07e92e5e676a7087cdc7d9dce24fc1461e5f7066e18 WatchSource:0}: Error finding container df800155418e06eb4ba1f07e92e5e676a7087cdc7d9dce24fc1461e5f7066e18: Status 404 returned error can't find the container with id df800155418e06eb4ba1f07e92e5e676a7087cdc7d9dce24fc1461e5f7066e18
Jul 22 05:07:19.656787 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:19.656750    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt" event={"ID":"5a181634-dad4-4ea5-8fda-270a4e054137","Type":"ContainerStarted","Data":"3a6ec9e1d838e4eb6e04c3d5c5601c608ddea86e39f3b455c1dfa1551d6dbe34"}
Jul 22 05:07:19.656974 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:19.656801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt" event={"ID":"5a181634-dad4-4ea5-8fda-270a4e054137","Type":"ContainerStarted","Data":"df800155418e06eb4ba1f07e92e5e676a7087cdc7d9dce24fc1461e5f7066e18"}
Jul 22 05:07:19.656974 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:19.656866    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:19.684621 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:19.684567    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt" podStartSLOduration=2.3238393090000002 podStartE2EDuration="2.684546519s" totalImagesPullingTime="360.70721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:07:19.682929031 +0000 UTC m=+2554.966794428" watchObservedRunningTime="2026-07-22 05:07:19.684546519 +0000 UTC m=+2554.968411914"
Jul 22 05:07:25.667768 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:25.667715    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:07:25.884442 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:25.884405    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"]
Jul 22 05:07:25.888443 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:25.888415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:25.890935 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:25.890908    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-0c4b46-serving-cert\""
Jul 22 05:07:25.897292 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:25.897247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"]
Jul 22 05:07:25.987254 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:25.987227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:25.987403 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:25.987274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc9b2b0-6c3c-4684-a549-0303ef34e167-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:25.987403 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:25.987302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf8dp\" (UniqueName: \"kubernetes.io/projected/0cc9b2b0-6c3c-4684-a549-0303ef34e167-kube-api-access-gf8dp\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.088488 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.088453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.088646 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.088504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc9b2b0-6c3c-4684-a549-0303ef34e167-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.088646 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.088526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf8dp\" (UniqueName: \"kubernetes.io/projected/0cc9b2b0-6c3c-4684-a549-0303ef34e167-kube-api-access-gf8dp\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.088782 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:07:26.088686    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-serving-cert: secret "maas-api-e2e-shared-b-0c4b46-serving-cert" not found
Jul 22 05:07:26.088828 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:07:26.088798    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls podName:0cc9b2b0-6c3c-4684-a549-0303ef34e167 nodeName:}" failed. No retries permitted until 2026-07-22 05:07:26.588773478 +0000 UTC m=+2561.872638871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls") pod "maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb" (UID: "0cc9b2b0-6c3c-4684-a549-0303ef34e167") : secret "maas-api-e2e-shared-b-0c4b46-serving-cert" not found
Jul 22 05:07:26.089226 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.089206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc9b2b0-6c3c-4684-a549-0303ef34e167-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.099104 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.099076    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf8dp\" (UniqueName: \"kubernetes.io/projected/0cc9b2b0-6c3c-4684-a549-0303ef34e167-kube-api-access-gf8dp\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.594833 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.594793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.597278 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.597257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls\") pod \"maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.802532 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.802496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:26.997049 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:26.997018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"]
Jul 22 05:07:26.999587 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:07:26.999559    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc9b2b0_6c3c_4684_a549_0303ef34e167.slice/crio-38bb75fa3de7c7317db32d7e69bbcf98736bf7c9c85ceddb388a6f76f6d69915 WatchSource:0}: Error finding container 38bb75fa3de7c7317db32d7e69bbcf98736bf7c9c85ceddb388a6f76f6d69915: Status 404 returned error can't find the container with id 38bb75fa3de7c7317db32d7e69bbcf98736bf7c9c85ceddb388a6f76f6d69915
Jul 22 05:07:27.699684 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:27.699598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb" event={"ID":"0cc9b2b0-6c3c-4684-a549-0303ef34e167","Type":"ContainerStarted","Data":"192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4"}
Jul 22 05:07:27.699869 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:27.699856    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:27.699941 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:27.699887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb" event={"ID":"0cc9b2b0-6c3c-4684-a549-0303ef34e167","Type":"ContainerStarted","Data":"38bb75fa3de7c7317db32d7e69bbcf98736bf7c9c85ceddb388a6f76f6d69915"}
Jul 22 05:07:27.717438 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:27.717371    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb" podStartSLOduration=2.312335112 podStartE2EDuration="2.717351986s" totalImagesPullingTime="405.016874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:07:27.716024099 +0000 UTC m=+2562.999889515" watchObservedRunningTime="2026-07-22 05:07:27.717351986 +0000 UTC m=+2563.001217382"
Jul 22 05:07:32.187517 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:32.186778    2564 patch_prober.go:28] interesting pod/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:36590->10.133.0.57:15021: read: connection reset by peer" start-of-body=
Jul 22 05:07:32.187517 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:32.186842    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:36590->10.133.0.57:15021: read: connection reset by peer"
Jul 22 05:07:32.728871 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:32.728839    2564 generic.go:356] "Generic (PLEG): container finished" podID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerID="41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487" exitCode=0
Jul 22 05:07:32.729043 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:32.728916    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" event={"ID":"73ee1528-d298-4ffe-ae13-09ab66757dfa","Type":"ContainerDied","Data":"41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487"}
Jul 22 05:07:32.729318 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:32.729304    2564 scope.go:117] "RemoveContainer" containerID="41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487"
Jul 22 05:07:32.730313 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:32.730284    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:07:32.730420 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:32.730369    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:07:32.730483 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:32.730416    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 05:07:33.710364 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:33.710326    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:07:33.741925 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:33.741872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" event={"ID":"73ee1528-d298-4ffe-ae13-09ab66757dfa","Type":"ContainerStarted","Data":"87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e"}
Jul 22 05:07:34.305948 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:34.305911    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:34.306140 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:34.306121    2564 patch_prober.go:28] interesting pod/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 05:07:34.306232 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:34.306194    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 05:07:35.306401 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:35.306297    2564 patch_prober.go:28] interesting pod/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 05:07:35.306401 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:35.306352    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 05:07:36.306168 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:36.306134    2564 patch_prober.go:28] interesting pod/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 05:07:36.306356 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:36.306200    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 05:07:37.306318 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:37.306289    2564 patch_prober.go:28] interesting pod/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 05:07:37.306795 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:37.306771    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 05:07:38.309036 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:38.309005    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:38.309436 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:38.309349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:38.310269 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:38.310252    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:07:45.420801 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:07:45.420768    2564 scope.go:117] "RemoveContainer" containerID="1ccc579bfcac27938f83d7385c38198a779fff92b999fc99ddf06e6aca62d050"
Jul 22 05:08:09.372451 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.372354    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"]
Jul 22 05:08:09.376031 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.376011    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.379187 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.379150    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"default-dockercfg-bgrpg\""
Jul 22 05:08:09.380245 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.380218    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"auth-test-model-0c4b46-kserve-self-signed-certs\""
Jul 22 05:08:09.380355 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.380223    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"openshift-service-ca.crt\""
Jul 22 05:08:09.380355 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.380268    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0c4b46\"/\"kube-root-ca.crt\""
Jul 22 05:08:09.387714 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.387690    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"]
Jul 22 05:08:09.391047 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.391016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-home\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.391158 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.391099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr79z\" (UniqueName: \"kubernetes.io/projected/5c16b04f-6246-46c4-bc64-a5f7b73ede46-kube-api-access-mr79z\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.391158 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.391150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tls-certs\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.391275 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.391210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-model-cache\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.391275 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.391240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tmp-dir\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.391385 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.391316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-dshm\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.492589 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.492551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-home\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.492825 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.492606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr79z\" (UniqueName: \"kubernetes.io/projected/5c16b04f-6246-46c4-bc64-a5f7b73ede46-kube-api-access-mr79z\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.492825 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.492632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tls-certs\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.492825 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.492665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-model-cache\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.492825 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.492685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tmp-dir\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.496765 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.492863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-dshm\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.496765 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.493488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-model-cache\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.496765 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.493552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-home\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.496765 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.493618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tmp-dir\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.496765 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.496071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tls-certs\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.501431 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.501397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-dshm\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.501718 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.501698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr79z\" (UniqueName: \"kubernetes.io/projected/5c16b04f-6246-46c4-bc64-a5f7b73ede46-kube-api-access-mr79z\") pod \"auth-test-model-0c4b46-kserve-879f88dc5-4jwwp\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") " pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.687994 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.687888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:09.833266 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.833240    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"]
Jul 22 05:08:09.835364 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:08:09.835338    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c16b04f_6246_46c4_bc64_a5f7b73ede46.slice/crio-c2c7a72012b7944d6e6a518d3a7ecad457d3c5c97ce61af37976db12ddf24260 WatchSource:0}: Error finding container c2c7a72012b7944d6e6a518d3a7ecad457d3c5c97ce61af37976db12ddf24260: Status 404 returned error can't find the container with id c2c7a72012b7944d6e6a518d3a7ecad457d3c5c97ce61af37976db12ddf24260
Jul 22 05:08:09.922215 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.922167    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp" event={"ID":"5c16b04f-6246-46c4-bc64-a5f7b73ede46","Type":"ContainerStarted","Data":"253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43"}
Jul 22 05:08:09.922215 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.922219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp" event={"ID":"5c16b04f-6246-46c4-bc64-a5f7b73ede46","Type":"ContainerStarted","Data":"c2c7a72012b7944d6e6a518d3a7ecad457d3c5c97ce61af37976db12ddf24260"}
Jul 22 05:08:09.941758 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:09.941643    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp" podStartSLOduration=0.941626817 podStartE2EDuration="941.626817ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:08:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:08:09.940240511 +0000 UTC m=+2605.224105909" watchObservedRunningTime="2026-07-22 05:08:09.941626817 +0000 UTC m=+2605.225492212"
Jul 22 05:08:19.688190 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:19.688145    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:19.688190 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:19.688202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:19.701238 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:19.701205    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:08:19.984094 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:08:19.984015    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:09:45.298283 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:09:45.298211    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 05:09:45.306471 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:09:45.306444    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 05:10:12.872929 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:12.872884    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"]
Jul 22 05:10:27.894941 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:27.894894    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp" podUID="5c16b04f-6246-46c4-bc64-a5f7b73ede46" containerName="main" containerID="cri-o://253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43" gracePeriod=45
Jul 22 05:10:28.143294 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.143270    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:10:28.179109 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179018    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tmp-dir\") pod \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") "
Jul 22 05:10:28.179272 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179124    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-home\") pod \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") "
Jul 22 05:10:28.179272 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179160    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr79z\" (UniqueName: \"kubernetes.io/projected/5c16b04f-6246-46c4-bc64-a5f7b73ede46-kube-api-access-mr79z\") pod \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") "
Jul 22 05:10:28.179272 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179191    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tls-certs\") pod \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") "
Jul 22 05:10:28.179272 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179236    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-model-cache\") pod \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") "
Jul 22 05:10:28.179506 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179293    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-dshm\") pod \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\" (UID: \"5c16b04f-6246-46c4-bc64-a5f7b73ede46\") "
Jul 22 05:10:28.179506 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179440    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-home" (OuterVolumeSpecName: "home") pod "5c16b04f-6246-46c4-bc64-a5f7b73ede46" (UID: "5c16b04f-6246-46c4-bc64-a5f7b73ede46"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:10:28.179627 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179583    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:10:28.179890 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179846    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c16b04f-6246-46c4-bc64-a5f7b73ede46" (UID: "5c16b04f-6246-46c4-bc64-a5f7b73ede46"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:10:28.179890 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.179863    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c16b04f-6246-46c4-bc64-a5f7b73ede46" (UID: "5c16b04f-6246-46c4-bc64-a5f7b73ede46"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:10:28.181561 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.181533    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c16b04f-6246-46c4-bc64-a5f7b73ede46-kube-api-access-mr79z" (OuterVolumeSpecName: "kube-api-access-mr79z") pod "5c16b04f-6246-46c4-bc64-a5f7b73ede46" (UID: "5c16b04f-6246-46c4-bc64-a5f7b73ede46"). InnerVolumeSpecName "kube-api-access-mr79z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:10:28.181889 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.181866    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-dshm" (OuterVolumeSpecName: "dshm") pod "5c16b04f-6246-46c4-bc64-a5f7b73ede46" (UID: "5c16b04f-6246-46c4-bc64-a5f7b73ede46"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:10:28.182138 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.182119    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c16b04f-6246-46c4-bc64-a5f7b73ede46" (UID: "5c16b04f-6246-46c4-bc64-a5f7b73ede46"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:10:28.280823 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.280779    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr79z\" (UniqueName: \"kubernetes.io/projected/5c16b04f-6246-46c4-bc64-a5f7b73ede46-kube-api-access-mr79z\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:10:28.280823 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.280814    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:10:28.280823 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.280826    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:10:28.280823 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.280834    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:10:28.281096 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.280842    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c16b04f-6246-46c4-bc64-a5f7b73ede46-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:10:28.631096 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.631061    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c16b04f-6246-46c4-bc64-a5f7b73ede46" containerID="253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43" exitCode=0
Jul 22 05:10:28.631253 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.631110    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"
Jul 22 05:10:28.631253 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.631147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp" event={"ID":"5c16b04f-6246-46c4-bc64-a5f7b73ede46","Type":"ContainerDied","Data":"253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43"}
Jul 22 05:10:28.631253 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.631191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp" event={"ID":"5c16b04f-6246-46c4-bc64-a5f7b73ede46","Type":"ContainerDied","Data":"c2c7a72012b7944d6e6a518d3a7ecad457d3c5c97ce61af37976db12ddf24260"}
Jul 22 05:10:28.631253 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.631211    2564 scope.go:117] "RemoveContainer" containerID="253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43"
Jul 22 05:10:28.641056 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.641038    2564 scope.go:117] "RemoveContainer" containerID="253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43"
Jul 22 05:10:28.641305 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:10:28.641276    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43\": container with ID starting with 253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43 not found: ID does not exist" containerID="253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43"
Jul 22 05:10:28.641357 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.641304    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43"} err="failed to get container status \"253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43\": rpc error: code = NotFound desc = could not find container \"253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43\": container with ID starting with 253422f966a23af81a5749d01e60702e40e41cc6ac660a69ff79338148f3da43 not found: ID does not exist"
Jul 22 05:10:28.657793 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.655563    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"]
Jul 22 05:10:28.660004 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:28.659983    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0c4b46/auth-test-model-0c4b46-kserve-879f88dc5-4jwwp"]
Jul 22 05:10:29.171637 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:10:29.171602    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c16b04f-6246-46c4-bc64-a5f7b73ede46" path="/var/lib/kubelet/pods/5c16b04f-6246-46c4-bc64-a5f7b73ede46/volumes"
Jul 22 05:11:45.477218 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:45.477185    2564 scope.go:117] "RemoveContainer" containerID="38a30f6d74f08e5d438089b70e049eff0d52396ad11a447e530d9a226727a790"
Jul 22 05:11:48.658849 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.658811    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"]
Jul 22 05:11:48.659263 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.659249    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c16b04f-6246-46c4-bc64-a5f7b73ede46" containerName="main"
Jul 22 05:11:48.659308 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.659265    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c16b04f-6246-46c4-bc64-a5f7b73ede46" containerName="main"
Jul 22 05:11:48.659354 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.659344    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c16b04f-6246-46c4-bc64-a5f7b73ede46" containerName="main"
Jul 22 05:11:48.663641 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.663620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.667004 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.666980    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"rate-test-model-81d7ca-kserve-self-signed-certs\""
Jul 22 05:11:48.667004 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.666998    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"kube-root-ca.crt\""
Jul 22 05:11:48.667178 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.667004    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"default-dockercfg-srvf4\""
Jul 22 05:11:48.667178 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.666985    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-81d7ca\"/\"openshift-service-ca.crt\""
Jul 22 05:11:48.671928 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.671905    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"]
Jul 22 05:11:48.820609 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.820572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-dshm\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.820799 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.820636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-model-cache\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.820799 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.820717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzwc6\" (UniqueName: \"kubernetes.io/projected/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-kube-api-access-mzwc6\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.820799 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.820792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-home\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.820919 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.820821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tmp-dir\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.820919 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.820840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tls-certs\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.922542 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.922456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-model-cache\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.922542 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.922523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzwc6\" (UniqueName: \"kubernetes.io/projected/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-kube-api-access-mzwc6\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.922799 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.922565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-home\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.922799 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.922602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tmp-dir\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.922799 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.922630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tls-certs\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.922799 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.922681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-dshm\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.923016 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.922905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-model-cache\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.923069 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.923010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-home\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.923069 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.923027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tmp-dir\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.925063 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.925038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-dshm\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.925419 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.925398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tls-certs\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.930685 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.930655    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzwc6\" (UniqueName: \"kubernetes.io/projected/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-kube-api-access-mzwc6\") pod \"rate-test-model-81d7ca-kserve-55d77664c5-tfzjz\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") " pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:48.973804 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:48.973762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:49.111927 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:49.111900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"]
Jul 22 05:11:49.114749 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:11:49.114706    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85d3a6cb_7186_42e7_b3c2_89040e37f4e2.slice/crio-b2f8cafaf93beb205b26a0516c6ce1b402a97501d84e987cf77a2be680680349 WatchSource:0}: Error finding container b2f8cafaf93beb205b26a0516c6ce1b402a97501d84e987cf77a2be680680349: Status 404 returned error can't find the container with id b2f8cafaf93beb205b26a0516c6ce1b402a97501d84e987cf77a2be680680349
Jul 22 05:11:50.034157 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:50.034115    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz" event={"ID":"85d3a6cb-7186-42e7-b3c2-89040e37f4e2","Type":"ContainerStarted","Data":"bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e"}
Jul 22 05:11:50.034619 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:50.034186    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz" event={"ID":"85d3a6cb-7186-42e7-b3c2-89040e37f4e2","Type":"ContainerStarted","Data":"b2f8cafaf93beb205b26a0516c6ce1b402a97501d84e987cf77a2be680680349"}
Jul 22 05:11:50.051276 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:50.051222    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz" podStartSLOduration=2.051206318 podStartE2EDuration="2.051206318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:11:50.048983371 +0000 UTC m=+2825.332848768" watchObservedRunningTime="2026-07-22 05:11:50.051206318 +0000 UTC m=+2825.335071713"
Jul 22 05:11:58.974483 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:58.974432    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:58.974483 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:58.974488    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:58.987245 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:58.987216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:11:59.089108 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:11:59.089072    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:13:01.503037 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:01.502956    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"]
Jul 22 05:13:16.523410 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.523368    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz" podUID="85d3a6cb-7186-42e7-b3c2-89040e37f4e2" containerName="main" containerID="cri-o://bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e" gracePeriod=45
Jul 22 05:13:16.780440 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.780376    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:13:16.946053 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946018    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-dshm\") pod \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") "
Jul 22 05:13:16.946053 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946050    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-model-cache\") pod \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") "
Jul 22 05:13:16.946307 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946097    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tls-certs\") pod \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") "
Jul 22 05:13:16.946307 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946116    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-home\") pod \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") "
Jul 22 05:13:16.946307 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzwc6\" (UniqueName: \"kubernetes.io/projected/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-kube-api-access-mzwc6\") pod \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") "
Jul 22 05:13:16.946307 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946214    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tmp-dir\") pod \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\" (UID: \"85d3a6cb-7186-42e7-b3c2-89040e37f4e2\") "
Jul 22 05:13:16.946527 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946379    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-model-cache" (OuterVolumeSpecName: "model-cache") pod "85d3a6cb-7186-42e7-b3c2-89040e37f4e2" (UID: "85d3a6cb-7186-42e7-b3c2-89040e37f4e2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:16.946527 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946382    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-home" (OuterVolumeSpecName: "home") pod "85d3a6cb-7186-42e7-b3c2-89040e37f4e2" (UID: "85d3a6cb-7186-42e7-b3c2-89040e37f4e2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:16.946638 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946524    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-model-cache\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:16.946638 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946546    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-home\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:16.946638 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.946597    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85d3a6cb-7186-42e7-b3c2-89040e37f4e2" (UID: "85d3a6cb-7186-42e7-b3c2-89040e37f4e2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:16.948293 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.948267    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-dshm" (OuterVolumeSpecName: "dshm") pod "85d3a6cb-7186-42e7-b3c2-89040e37f4e2" (UID: "85d3a6cb-7186-42e7-b3c2-89040e37f4e2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:16.948652 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.948627    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85d3a6cb-7186-42e7-b3c2-89040e37f4e2" (UID: "85d3a6cb-7186-42e7-b3c2-89040e37f4e2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:13:16.948764 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:16.948663    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-kube-api-access-mzwc6" (OuterVolumeSpecName: "kube-api-access-mzwc6") pod "85d3a6cb-7186-42e7-b3c2-89040e37f4e2" (UID: "85d3a6cb-7186-42e7-b3c2-89040e37f4e2"). InnerVolumeSpecName "kube-api-access-mzwc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:13:17.047503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.047423    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-dshm\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.047503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.047452    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tls-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.047503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.047464    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzwc6\" (UniqueName: \"kubernetes.io/projected/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-kube-api-access-mzwc6\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.047503 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.047472    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d3a6cb-7186-42e7-b3c2-89040e37f4e2-tmp-dir\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:17.475529 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.475429    2564 generic.go:356] "Generic (PLEG): container finished" podID="85d3a6cb-7186-42e7-b3c2-89040e37f4e2" containerID="bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e" exitCode=0
Jul 22 05:13:17.475529 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.475496    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"
Jul 22 05:13:17.475529 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.475511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz" event={"ID":"85d3a6cb-7186-42e7-b3c2-89040e37f4e2","Type":"ContainerDied","Data":"bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e"}
Jul 22 05:13:17.475855 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.475564    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz" event={"ID":"85d3a6cb-7186-42e7-b3c2-89040e37f4e2","Type":"ContainerDied","Data":"b2f8cafaf93beb205b26a0516c6ce1b402a97501d84e987cf77a2be680680349"}
Jul 22 05:13:17.475855 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.475585    2564 scope.go:117] "RemoveContainer" containerID="bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e"
Jul 22 05:13:17.489059 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.489040    2564 scope.go:117] "RemoveContainer" containerID="bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e"
Jul 22 05:13:17.489401 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:13:17.489377    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e\": container with ID starting with bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e not found: ID does not exist" containerID="bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e"
Jul 22 05:13:17.489465 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.489413    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e"} err="failed to get container status \"bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e\": rpc error: code = NotFound desc = could not find container \"bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e\": container with ID starting with bcb868b68a5c37aa530486d68c599be63d7546203da15ee7b8eace88747cc08e not found: ID does not exist"
Jul 22 05:13:17.497456 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.497331    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"]
Jul 22 05:13:17.499998 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:17.499975    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-81d7ca/rate-test-model-81d7ca-kserve-55d77664c5-tfzjz"]
Jul 22 05:13:19.171359 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:19.171324    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d3a6cb-7186-42e7-b3c2-89040e37f4e2" path="/var/lib/kubelet/pods/85d3a6cb-7186-42e7-b3c2-89040e37f4e2/volumes"
Jul 22 05:13:32.339948 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.339913    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"]
Jul 22 05:13:32.340579 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.340134    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt" podUID="5a181634-dad4-4ea5-8fda-270a4e054137" containerName="maas-api" containerID="cri-o://3a6ec9e1d838e4eb6e04c3d5c5601c608ddea86e39f3b455c1dfa1551d6dbe34" gracePeriod=30
Jul 22 05:13:32.550606 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.550574    2564 generic.go:356] "Generic (PLEG): container finished" podID="5a181634-dad4-4ea5-8fda-270a4e054137" containerID="3a6ec9e1d838e4eb6e04c3d5c5601c608ddea86e39f3b455c1dfa1551d6dbe34" exitCode=0
Jul 22 05:13:32.550804 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.550653    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt" event={"ID":"5a181634-dad4-4ea5-8fda-270a4e054137","Type":"ContainerDied","Data":"3a6ec9e1d838e4eb6e04c3d5c5601c608ddea86e39f3b455c1dfa1551d6dbe34"}
Jul 22 05:13:32.595359 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.595283    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:13:32.689524 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.689485    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a181634-dad4-4ea5-8fda-270a4e054137-openshift-service-ca\") pod \"5a181634-dad4-4ea5-8fda-270a4e054137\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") "
Jul 22 05:13:32.689700 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.689548    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvc4d\" (UniqueName: \"kubernetes.io/projected/5a181634-dad4-4ea5-8fda-270a4e054137-kube-api-access-cvc4d\") pod \"5a181634-dad4-4ea5-8fda-270a4e054137\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") "
Jul 22 05:13:32.689700 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.689619    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls\") pod \"5a181634-dad4-4ea5-8fda-270a4e054137\" (UID: \"5a181634-dad4-4ea5-8fda-270a4e054137\") "
Jul 22 05:13:32.689906 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.689881    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a181634-dad4-4ea5-8fda-270a4e054137-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a181634-dad4-4ea5-8fda-270a4e054137" (UID: "5a181634-dad4-4ea5-8fda-270a4e054137"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:13:32.691665 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.691645    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a181634-dad4-4ea5-8fda-270a4e054137" (UID: "5a181634-dad4-4ea5-8fda-270a4e054137"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:13:32.691780 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.691700    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a181634-dad4-4ea5-8fda-270a4e054137-kube-api-access-cvc4d" (OuterVolumeSpecName: "kube-api-access-cvc4d") pod "5a181634-dad4-4ea5-8fda-270a4e054137" (UID: "5a181634-dad4-4ea5-8fda-270a4e054137"). InnerVolumeSpecName "kube-api-access-cvc4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:13:32.790612 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.790572    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a181634-dad4-4ea5-8fda-270a4e054137-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:32.790612 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.790606    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a181634-dad4-4ea5-8fda-270a4e054137-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:32.790612 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:32.790616    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvc4d\" (UniqueName: \"kubernetes.io/projected/5a181634-dad4-4ea5-8fda-270a4e054137-kube-api-access-cvc4d\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:33.557699 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:33.557655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt" event={"ID":"5a181634-dad4-4ea5-8fda-270a4e054137","Type":"ContainerDied","Data":"df800155418e06eb4ba1f07e92e5e676a7087cdc7d9dce24fc1461e5f7066e18"}
Jul 22 05:13:33.558159 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:33.557722    2564 scope.go:117] "RemoveContainer" containerID="3a6ec9e1d838e4eb6e04c3d5c5601c608ddea86e39f3b455c1dfa1551d6dbe34"
Jul 22 05:13:33.558159 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:33.557679    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"
Jul 22 05:13:33.574968 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:33.574942    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"]
Jul 22 05:13:33.582272 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:33.582246    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-81d7ca-58c6c7db56-wr6lt"]
Jul 22 05:13:35.172673 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:35.172639    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a181634-dad4-4ea5-8fda-270a4e054137" path="/var/lib/kubelet/pods/5a181634-dad4-4ea5-8fda-270a4e054137/volumes"
Jul 22 05:13:43.234795 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.234761    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"]
Jul 22 05:13:43.235285 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.234963    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy" containerID="cri-o://87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e" gracePeriod=30
Jul 22 05:13:43.629493 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.629458    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"]
Jul 22 05:13:43.629954 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.629936    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d3a6cb-7186-42e7-b3c2-89040e37f4e2" containerName="main"
Jul 22 05:13:43.630075 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.629956    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d3a6cb-7186-42e7-b3c2-89040e37f4e2" containerName="main"
Jul 22 05:13:43.630075 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.629992    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a181634-dad4-4ea5-8fda-270a4e054137" containerName="maas-api"
Jul 22 05:13:43.630075 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.630001    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a181634-dad4-4ea5-8fda-270a4e054137" containerName="maas-api"
Jul 22 05:13:43.630277 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.630100    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d3a6cb-7186-42e7-b3c2-89040e37f4e2" containerName="main"
Jul 22 05:13:43.630277 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.630119    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a181634-dad4-4ea5-8fda-270a4e054137" containerName="maas-api"
Jul 22 05:13:43.634520 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.634494    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"
Jul 22 05:13:43.638140 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.638117    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-65v9v\""
Jul 22 05:13:43.647639 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.647615    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"]
Jul 22 05:13:43.797252 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.797216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b491fd-3e7e-4954-8afe-be76caa460f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4\" (UID: \"f5b491fd-3e7e-4954-8afe-be76caa460f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"
Jul 22 05:13:43.898466 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.898371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b491fd-3e7e-4954-8afe-be76caa460f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4\" (UID: \"f5b491fd-3e7e-4954-8afe-be76caa460f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"
Jul 22 05:13:43.899026 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.899007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b491fd-3e7e-4954-8afe-be76caa460f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4\" (UID: \"f5b491fd-3e7e-4954-8afe-be76caa460f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"
Jul 22 05:13:43.945130 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:43.945097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"
Jul 22 05:13:44.324840 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:44.324813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"]
Jul 22 05:13:44.327046 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:13:44.327020    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b491fd_3e7e_4954_8afe_be76caa460f0.slice/crio-829f1064119f1984071fa8d48622267d77e082a63e9de58d409193937420b688 WatchSource:0}: Error finding container 829f1064119f1984071fa8d48622267d77e082a63e9de58d409193937420b688: Status 404 returned error can't find the container with id 829f1064119f1984071fa8d48622267d77e082a63e9de58d409193937420b688
Jul 22 05:13:44.613005 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:44.612901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4" event={"ID":"f5b491fd-3e7e-4954-8afe-be76caa460f0","Type":"ContainerStarted","Data":"a5c8db9cb36d456eaa36dce921c526695f2d17ae1e5bbe6fcf5c67e7d60570f8"}
Jul 22 05:13:44.613005 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:44.612966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4" event={"ID":"f5b491fd-3e7e-4954-8afe-be76caa460f0","Type":"ContainerStarted","Data":"829f1064119f1984071fa8d48622267d77e082a63e9de58d409193937420b688"}
Jul 22 05:13:44.634435 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:44.634385    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4" podStartSLOduration=1.634366567 podStartE2EDuration="1.634366567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:13:44.631489341 +0000 UTC m=+2939.915354739" watchObservedRunningTime="2026-07-22 05:13:44.634366567 +0000 UTC m=+2939.918231961"
Jul 22 05:13:45.506638 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:45.506609    2564 scope.go:117] "RemoveContainer" containerID="26225782533a106f8a5542dc561f02f5f38690412596259c1bec439967436d70"
Jul 22 05:13:45.620080 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:45.620045    2564 generic.go:356] "Generic (PLEG): container finished" podID="f5b491fd-3e7e-4954-8afe-be76caa460f0" containerID="a5c8db9cb36d456eaa36dce921c526695f2d17ae1e5bbe6fcf5c67e7d60570f8" exitCode=0
Jul 22 05:13:45.620255 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:45.620094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4" event={"ID":"f5b491fd-3e7e-4954-8afe-be76caa460f0","Type":"ContainerDied","Data":"a5c8db9cb36d456eaa36dce921c526695f2d17ae1e5bbe6fcf5c67e7d60570f8"}
Jul 22 05:13:46.764065 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:46.764037    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"
Jul 22 05:13:46.926313 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:46.926222    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b491fd-3e7e-4954-8afe-be76caa460f0-maas-api-service-ca\") pod \"f5b491fd-3e7e-4954-8afe-be76caa460f0\" (UID: \"f5b491fd-3e7e-4954-8afe-be76caa460f0\") "
Jul 22 05:13:46.926592 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:46.926570    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b491fd-3e7e-4954-8afe-be76caa460f0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f5b491fd-3e7e-4954-8afe-be76caa460f0" (UID: "f5b491fd-3e7e-4954-8afe-be76caa460f0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:13:47.027779 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:47.027716    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b491fd-3e7e-4954-8afe-be76caa460f0-maas-api-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:47.631821 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:47.631790    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"
Jul 22 05:13:47.632006 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:47.631795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4" event={"ID":"f5b491fd-3e7e-4954-8afe-be76caa460f0","Type":"ContainerDied","Data":"829f1064119f1984071fa8d48622267d77e082a63e9de58d409193937420b688"}
Jul 22 05:13:47.632006 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:47.631906    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="829f1064119f1984071fa8d48622267d77e082a63e9de58d409193937420b688"
Jul 22 05:13:48.487212 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.487187    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:13:48.637853 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.637762    2564 generic.go:356] "Generic (PLEG): container finished" podID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerID="87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e" exitCode=0
Jul 22 05:13:48.637853 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.637803    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" event={"ID":"73ee1528-d298-4ffe-ae13-09ab66757dfa","Type":"ContainerDied","Data":"87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e"}
Jul 22 05:13:48.637853 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.637828    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"
Jul 22 05:13:48.638078 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.637864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d" event={"ID":"73ee1528-d298-4ffe-ae13-09ab66757dfa","Type":"ContainerDied","Data":"1390b0481f54c9e8c3701b3affeb023d8f2d6be9166aea3b00be81747b0ba3a5"}
Jul 22 05:13:48.638078 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.637891    2564 scope.go:117] "RemoveContainer" containerID="87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e"
Jul 22 05:13:48.643307 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643281    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-token\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643446 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643340    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-certs\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643446 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643368    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-socket\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643446 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643399    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-envoy\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643617 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ee1528-d298-4ffe-ae13-09ab66757dfa-istiod-ca-cert\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643617 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643484    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-credential-socket\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643617 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643507    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-data\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643617 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643535    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgjwz\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-kube-api-access-pgjwz\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643849 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643705    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:48.643911 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-podinfo\") pod \"73ee1528-d298-4ffe-ae13-09ab66757dfa\" (UID: \"73ee1528-d298-4ffe-ae13-09ab66757dfa\") "
Jul 22 05:13:48.643911 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643893    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:48.644017 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ee1528-d298-4ffe-ae13-09ab66757dfa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:13:48.644017 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.643929    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:48.644557 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.644265    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-certs\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.644557 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.644287    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-workload-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.644557 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.644301    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73ee1528-d298-4ffe-ae13-09ab66757dfa-istiod-ca-cert\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.644557 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.644314    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-credential-socket\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.644557 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.644506    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-data" (OuterVolumeSpecName: "istio-data") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:48.649419 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.649318    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:13:48.649419 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.649326    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 05:13:48.649419 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.649394    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-token" (OuterVolumeSpecName: "istio-token") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:13:48.649419 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.649406    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-kube-api-access-pgjwz" (OuterVolumeSpecName: "kube-api-access-pgjwz") pod "73ee1528-d298-4ffe-ae13-09ab66757dfa" (UID: "73ee1528-d298-4ffe-ae13-09ab66757dfa"). InnerVolumeSpecName "kube-api-access-pgjwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:13:48.650012 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.649991    2564 scope.go:117] "RemoveContainer" containerID="41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487"
Jul 22 05:13:48.663884 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.663866    2564 scope.go:117] "RemoveContainer" containerID="87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e"
Jul 22 05:13:48.664173 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:13:48.664154    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e\": container with ID starting with 87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e not found: ID does not exist" containerID="87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e"
Jul 22 05:13:48.664249 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.664187    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e"} err="failed to get container status \"87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e\": rpc error: code = NotFound desc = could not find container \"87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e\": container with ID starting with 87979c2b0185f372ac6988878ac18b2a5d29767c323ed29d7543581ef2820f4e not found: ID does not exist"
Jul 22 05:13:48.664249 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.664214    2564 scope.go:117] "RemoveContainer" containerID="41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487"
Jul 22 05:13:48.664461 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:13:48.664445    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487\": container with ID starting with 41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487 not found: ID does not exist" containerID="41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487"
Jul 22 05:13:48.664515 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.664469    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487"} err="failed to get container status \"41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487\": rpc error: code = NotFound desc = could not find container \"41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487\": container with ID starting with 41649c8f38af7fe720833e77ebac237477a252ea2260bdc640a2da55b9288487 not found: ID does not exist"
Jul 22 05:13:48.745360 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.745329    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-token\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.745360 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.745359    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-envoy\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.745360 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.745368    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-data\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.745626 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.745377    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgjwz\" (UniqueName: \"kubernetes.io/projected/73ee1528-d298-4ffe-ae13-09ab66757dfa-kube-api-access-pgjwz\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.745626 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.745386    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73ee1528-d298-4ffe-ae13-09ab66757dfa-istio-podinfo\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:48.959887 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.959852    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"]
Jul 22 05:13:48.963362 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:48.963338    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-81d7ca-openshift-default-6955f7cddc-np86d"]
Jul 22 05:13:49.171240 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:49.171205    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" path="/var/lib/kubelet/pods/73ee1528-d298-4ffe-ae13-09ab66757dfa/volumes"
Jul 22 05:13:54.075611 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.075570    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"]
Jul 22 05:13:54.076009 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.075823    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb" podUID="0cc9b2b0-6c3c-4684-a549-0303ef34e167" containerName="maas-api" containerID="cri-o://192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4" gracePeriod=30
Jul 22 05:13:54.327438 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.327371    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:13:54.402412 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.402378    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls\") pod \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") "
Jul 22 05:13:54.402412 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.402415    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf8dp\" (UniqueName: \"kubernetes.io/projected/0cc9b2b0-6c3c-4684-a549-0303ef34e167-kube-api-access-gf8dp\") pod \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") "
Jul 22 05:13:54.402641 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.402469    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc9b2b0-6c3c-4684-a549-0303ef34e167-openshift-service-ca\") pod \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\" (UID: \"0cc9b2b0-6c3c-4684-a549-0303ef34e167\") "
Jul 22 05:13:54.402858 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.402833    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cc9b2b0-6c3c-4684-a549-0303ef34e167-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0cc9b2b0-6c3c-4684-a549-0303ef34e167" (UID: "0cc9b2b0-6c3c-4684-a549-0303ef34e167"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:13:54.404506 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.404486    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc9b2b0-6c3c-4684-a549-0303ef34e167-kube-api-access-gf8dp" (OuterVolumeSpecName: "kube-api-access-gf8dp") pod "0cc9b2b0-6c3c-4684-a549-0303ef34e167" (UID: "0cc9b2b0-6c3c-4684-a549-0303ef34e167"). InnerVolumeSpecName "kube-api-access-gf8dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:13:54.404600 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.404523    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0cc9b2b0-6c3c-4684-a549-0303ef34e167" (UID: "0cc9b2b0-6c3c-4684-a549-0303ef34e167"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:13:54.503169 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.503116    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc9b2b0-6c3c-4684-a549-0303ef34e167-maas-api-tls\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:54.503169 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.503163    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf8dp\" (UniqueName: \"kubernetes.io/projected/0cc9b2b0-6c3c-4684-a549-0303ef34e167-kube-api-access-gf8dp\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:54.503169 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.503178    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc9b2b0-6c3c-4684-a549-0303ef34e167-openshift-service-ca\") on node \"ip-10-0-131-26.ec2.internal\" DevicePath \"\""
Jul 22 05:13:54.666760 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.666646    2564 generic.go:356] "Generic (PLEG): container finished" podID="0cc9b2b0-6c3c-4684-a549-0303ef34e167" containerID="192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4" exitCode=0
Jul 22 05:13:54.666760 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.666695    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"
Jul 22 05:13:54.666941 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.666760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb" event={"ID":"0cc9b2b0-6c3c-4684-a549-0303ef34e167","Type":"ContainerDied","Data":"192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4"}
Jul 22 05:13:54.666941 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.666824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb" event={"ID":"0cc9b2b0-6c3c-4684-a549-0303ef34e167","Type":"ContainerDied","Data":"38bb75fa3de7c7317db32d7e69bbcf98736bf7c9c85ceddb388a6f76f6d69915"}
Jul 22 05:13:54.666941 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.666849    2564 scope.go:117] "RemoveContainer" containerID="192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4"
Jul 22 05:13:54.676330 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.676310    2564 scope.go:117] "RemoveContainer" containerID="192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4"
Jul 22 05:13:54.676606 ip-10-0-131-26 kubenswrapper[2564]: E0722 05:13:54.676580    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4\": container with ID starting with 192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4 not found: ID does not exist" containerID="192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4"
Jul 22 05:13:54.676684 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.676614    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4"} err="failed to get container status \"192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4\": rpc error: code = NotFound desc = could not find container \"192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4\": container with ID starting with 192ce4e991fc9e7efdde15387e768e78c6821203edcfdfe9d9b881f775539dd4 not found: ID does not exist"
Jul 22 05:13:54.689320 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.689293    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"]
Jul 22 05:13:54.693393 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:54.693371    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0c4b46-5d7fb66848-fzljb"]
Jul 22 05:13:55.171519 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:55.171486    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc9b2b0-6c3c-4684-a549-0303ef34e167" path="/var/lib/kubelet/pods/0cc9b2b0-6c3c-4684-a549-0303ef34e167/volumes"
Jul 22 05:13:58.686538 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:58.686504    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"]
Jul 22 05:13:58.690064 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:58.690032    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0c4b46-slnc4"]
Jul 22 05:13:59.170945 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:13:59.170913    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b491fd-3e7e-4954-8afe-be76caa460f0" path="/var/lib/kubelet/pods/f5b491fd-3e7e-4954-8afe-be76caa460f0/volumes"
Jul 22 05:14:11.044548 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:11.044457    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d7xbk_6512fe5d-839d-482c-b8c8-28e351827d00/manager/0.log"
Jul 22 05:14:11.160258 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:11.160223    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-c9nsr_2d518e5b-e537-4597-a05c-391bad138f7e/manager/0.log"
Jul 22 05:14:11.286043 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:11.286012    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58cbd5b4c4-m7lvb_ef5c3e59-4193-4300-b62d-1e185f0b23d1/manager/0.log"
Jul 22 05:14:11.416958 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:11.416883    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8bm5n_a04f94ca-49c8-4149-8040-a5b9d51f6729/server/0.log"
Jul 22 05:14:11.531458 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:11.531429    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z4r2r_dbdaeb51-ae4e-445c-8922-3405a5334afa/manager/0.log"
Jul 22 05:14:11.769318 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:11.769292    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5676cbf8df-8tx22_99bff39b-20e1-468d-95c4-320df8124174/copy-manifests/0.log"
Jul 22 05:14:11.780633 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:11.780602    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5676cbf8df-8tx22_99bff39b-20e1-468d-95c4-320df8124174/manager/0.log"
Jul 22 05:14:12.561331 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:12.561268    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4mnzp_c06ea0f3-19d2-4416-b04c-b3627b0dcf4c/postgres/0.log"
Jul 22 05:14:13.940201 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:13.940169    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zlpgb_85d8c642-1ffd-41d9-95ca-f6a5fec98584/manager/0.log"
Jul 22 05:14:14.052277 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:14.052246    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tnsrg_7859cd74-2e30-4fc1-bc4f-87359c89a9c0/manager/0.log"
Jul 22 05:14:14.274177 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:14.274144    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-99wvf_502f8546-5e48-4820-a60c-43c662391207/registry-server/0.log"
Jul 22 05:14:14.386935 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:14.386903    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9n8gj_7f602906-71e5-467e-95a1-4ebb044f020e/manager/0.log"
Jul 22 05:14:14.607728 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:14.607648    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-226b9_690e3913-0ccc-4fda-95e4-d11a8d4748a9/manager/0.log"
Jul 22 05:14:15.164935 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:15.164907    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86559b66b8-pdgwd_32e25a94-8993-4151-8dde-cc9331f8e55f/kube-auth-proxy/0.log"
Jul 22 05:14:15.388081 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:15.388042    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5n4q_fc415b1e-575c-4c32-81ee-fc2acd699833/istio-proxy/1.log"
Jul 22 05:14:15.503120 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:15.503091    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gvg6g_1454bef6-8b27-4579-828f-192f25d381de/payload-pre-processing/0.log"
Jul 22 05:14:16.140484 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:16.140452    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xx8pp_e3b566fd-7ac5-4975-aece-8924bd9005a6/main/0.log"
Jul 22 05:14:16.246786 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:16.246754    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lt9jl_da29f7ae-9ad2-4074-af3f-23a555a6d9ec/main/0.log"
Jul 22 05:14:22.082615 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.082582    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7bkb/must-gather-hq5dj"]
Jul 22 05:14:22.083034 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083018    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy"
Jul 22 05:14:22.083034 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083036    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy"
Jul 22 05:14:22.083115 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083046    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc9b2b0-6c3c-4684-a549-0303ef34e167" containerName="maas-api"
Jul 22 05:14:22.083115 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083051    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc9b2b0-6c3c-4684-a549-0303ef34e167" containerName="maas-api"
Jul 22 05:14:22.083115 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083058    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b491fd-3e7e-4954-8afe-be76caa460f0" containerName="revoke-keys"
Jul 22 05:14:22.083115 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083064    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b491fd-3e7e-4954-8afe-be76caa460f0" containerName="revoke-keys"
Jul 22 05:14:22.083115 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083071    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy"
Jul 22 05:14:22.083115 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083077    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy"
Jul 22 05:14:22.083321 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083141    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b491fd-3e7e-4954-8afe-be76caa460f0" containerName="revoke-keys"
Jul 22 05:14:22.083321 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083151    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc9b2b0-6c3c-4684-a549-0303ef34e167" containerName="maas-api"
Jul 22 05:14:22.083321 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083157    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy"
Jul 22 05:14:22.083321 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.083163    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ee1528-d298-4ffe-ae13-09ab66757dfa" containerName="istio-proxy"
Jul 22 05:14:22.087694 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.087673    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7bkb/must-gather-hq5dj"
Jul 22 05:14:22.090515 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.090496    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7bkb\"/\"kube-root-ca.crt\""
Jul 22 05:14:22.090620 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.090496    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c7bkb\"/\"default-dockercfg-c4nsx\""
Jul 22 05:14:22.091376 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.091361    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7bkb\"/\"openshift-service-ca.crt\""
Jul 22 05:14:22.099897 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.099876    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7bkb/must-gather-hq5dj"]
Jul 22 05:14:22.148609 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.148532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ccb50873-e4bc-4f00-844c-e6aad287ff1f-must-gather-output\") pod \"must-gather-hq5dj\" (UID: \"ccb50873-e4bc-4f00-844c-e6aad287ff1f\") " pod="openshift-must-gather-c7bkb/must-gather-hq5dj"
Jul 22 05:14:22.148772 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.148651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46c78\" (UniqueName: \"kubernetes.io/projected/ccb50873-e4bc-4f00-844c-e6aad287ff1f-kube-api-access-46c78\") pod \"must-gather-hq5dj\" (UID: \"ccb50873-e4bc-4f00-844c-e6aad287ff1f\") " pod="openshift-must-gather-c7bkb/must-gather-hq5dj"
Jul 22 05:14:22.249908 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.249879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46c78\" (UniqueName: \"kubernetes.io/projected/ccb50873-e4bc-4f00-844c-e6aad287ff1f-kube-api-access-46c78\") pod \"must-gather-hq5dj\" (UID: \"ccb50873-e4bc-4f00-844c-e6aad287ff1f\") " pod="openshift-must-gather-c7bkb/must-gather-hq5dj"
Jul 22 05:14:22.250074 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.249924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ccb50873-e4bc-4f00-844c-e6aad287ff1f-must-gather-output\") pod \"must-gather-hq5dj\" (UID: \"ccb50873-e4bc-4f00-844c-e6aad287ff1f\") " pod="openshift-must-gather-c7bkb/must-gather-hq5dj"
Jul 22 05:14:22.250281 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.250262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ccb50873-e4bc-4f00-844c-e6aad287ff1f-must-gather-output\") pod \"must-gather-hq5dj\" (UID: \"ccb50873-e4bc-4f00-844c-e6aad287ff1f\") " pod="openshift-must-gather-c7bkb/must-gather-hq5dj"
Jul 22 05:14:22.261992 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.261962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46c78\" (UniqueName: \"kubernetes.io/projected/ccb50873-e4bc-4f00-844c-e6aad287ff1f-kube-api-access-46c78\") pod \"must-gather-hq5dj\" (UID: \"ccb50873-e4bc-4f00-844c-e6aad287ff1f\") " pod="openshift-must-gather-c7bkb/must-gather-hq5dj"
Jul 22 05:14:22.396458 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.396422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7bkb/must-gather-hq5dj"
Jul 22 05:14:22.550343 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.550311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7bkb/must-gather-hq5dj"]
Jul 22 05:14:22.553451 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:14:22.553423    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccb50873_e4bc_4f00_844c_e6aad287ff1f.slice/crio-c79001ad9aea173dc0d3114aedacc06ef3f04550eb6cea700b44402f08257833 WatchSource:0}: Error finding container c79001ad9aea173dc0d3114aedacc06ef3f04550eb6cea700b44402f08257833: Status 404 returned error can't find the container with id c79001ad9aea173dc0d3114aedacc06ef3f04550eb6cea700b44402f08257833
Jul 22 05:14:22.555310 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.555292    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 05:14:22.801144 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:22.801105    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7bkb/must-gather-hq5dj" event={"ID":"ccb50873-e4bc-4f00-844c-e6aad287ff1f","Type":"ContainerStarted","Data":"c79001ad9aea173dc0d3114aedacc06ef3f04550eb6cea700b44402f08257833"}
Jul 22 05:14:23.808445 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:23.808410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7bkb/must-gather-hq5dj" event={"ID":"ccb50873-e4bc-4f00-844c-e6aad287ff1f","Type":"ContainerStarted","Data":"40dfb9a0927989762d4385b4220038968d235a616203e001718a62844f624874"}
Jul 22 05:14:23.808947 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:23.808454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7bkb/must-gather-hq5dj" event={"ID":"ccb50873-e4bc-4f00-844c-e6aad287ff1f","Type":"ContainerStarted","Data":"d90eae81b6fa95381c5bbc80fd94094637403b21d85b487acc465121b229d2d9"}
Jul 22 05:14:25.153726 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:25.153678    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8g68t_7db9fc18-6ab0-4f65-8622-6e9f0c3c36de/global-pull-secret-syncer/0.log"
Jul 22 05:14:25.384507 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:25.384476    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kwph5_1ccf3d05-fde7-4768-9984-dfd91465e72e/konnectivity-agent/0.log"
Jul 22 05:14:25.437209 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:25.437112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-26.ec2.internal_8278c981d94520c88dce0403440d011e/haproxy/0.log"
Jul 22 05:14:30.422497 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:30.422466    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zlpgb_85d8c642-1ffd-41d9-95ca-f6a5fec98584/manager/0.log"
Jul 22 05:14:30.476547 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:30.476505    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tnsrg_7859cd74-2e30-4fc1-bc4f-87359c89a9c0/manager/0.log"
Jul 22 05:14:30.546794 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:30.546761    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-99wvf_502f8546-5e48-4820-a60c-43c662391207/registry-server/0.log"
Jul 22 05:14:30.743760 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:30.743713    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9n8gj_7f602906-71e5-467e-95a1-4ebb044f020e/manager/0.log"
Jul 22 05:14:30.856472 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:30.856433    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-226b9_690e3913-0ccc-4fda-95e4-d11a8d4748a9/manager/0.log"
Jul 22 05:14:33.126816 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.126753    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxhpj_1c924fbb-5448-49f9-88f6-9a78279379a9/node-exporter/0.log"
Jul 22 05:14:33.152422 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.152386    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxhpj_1c924fbb-5448-49f9-88f6-9a78279379a9/kube-rbac-proxy/0.log"
Jul 22 05:14:33.173354 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.173265    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxhpj_1c924fbb-5448-49f9-88f6-9a78279379a9/init-textfile/0.log"
Jul 22 05:14:33.298187 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.298124    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32924019-c9f6-4d23-87b3-701d435ea62f/prometheus/0.log"
Jul 22 05:14:33.323659 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.323630    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32924019-c9f6-4d23-87b3-701d435ea62f/config-reloader/0.log"
Jul 22 05:14:33.348095 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.348060    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32924019-c9f6-4d23-87b3-701d435ea62f/thanos-sidecar/0.log"
Jul 22 05:14:33.370493 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.370422    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32924019-c9f6-4d23-87b3-701d435ea62f/kube-rbac-proxy-web/0.log"
Jul 22 05:14:33.398730 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.398696    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32924019-c9f6-4d23-87b3-701d435ea62f/kube-rbac-proxy/0.log"
Jul 22 05:14:33.424881 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.424792    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32924019-c9f6-4d23-87b3-701d435ea62f/kube-rbac-proxy-thanos/0.log"
Jul 22 05:14:33.451616 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:33.451590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_32924019-c9f6-4d23-87b3-701d435ea62f/init-config-reloader/0.log"
Jul 22 05:14:35.553198 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.553118    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7bkb/must-gather-hq5dj" podStartSLOduration=12.505657753 podStartE2EDuration="13.553081162s" totalImagesPullingTime="1.047423409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:14:23.826645888 +0000 UTC m=+2979.110511285" watchObservedRunningTime="2026-07-22 05:14:35.553081162 +0000 UTC m=+2990.836946559"
Jul 22 05:14:35.553837 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.553536    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"]
Jul 22 05:14:35.567145 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.567114    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.571746 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.571700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"]
Jul 22 05:14:35.612524 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.612486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-proc\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.612801 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.612781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9b7q\" (UniqueName: \"kubernetes.io/projected/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-kube-api-access-z9b7q\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.612922 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.612910    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-lib-modules\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.613176 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.613139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-podres\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.613284 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.613272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-sys\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715053 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.715008    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-lib-modules\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715251 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.714813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-lib-modules\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715366 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.715343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-podres\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715431 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.715393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-podres\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715492 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.715440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-sys\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715548 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.715507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-sys\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715675 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.715655    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-proc\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715757 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.715693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-proc\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.715825 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.715762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9b7q\" (UniqueName: \"kubernetes.io/projected/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-kube-api-access-z9b7q\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.724374 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.724346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9b7q\" (UniqueName: \"kubernetes.io/projected/79f2c1e8-dac8-4df5-8f10-f252ee40ebe3-kube-api-access-z9b7q\") pod \"perf-node-gather-daemonset-llxt8\" (UID: \"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3\") " pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:35.896815 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:35.896705    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:36.089451 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:36.089359    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"]
Jul 22 05:14:36.095443 ip-10-0-131-26 kubenswrapper[2564]: W0722 05:14:36.095417    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod79f2c1e8_dac8_4df5_8f10_f252ee40ebe3.slice/crio-5b6ff1f61bcc981974d5b053c77037a961f2f2ec42bdc9f79ca241b7c70c9a9e WatchSource:0}: Error finding container 5b6ff1f61bcc981974d5b053c77037a961f2f2ec42bdc9f79ca241b7c70c9a9e: Status 404 returned error can't find the container with id 5b6ff1f61bcc981974d5b053c77037a961f2f2ec42bdc9f79ca241b7c70c9a9e
Jul 22 05:14:36.911761 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:36.911697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8" event={"ID":"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3","Type":"ContainerStarted","Data":"4f3409d8dcd83d8819cf95deac742e9dc7ea098703a3b736f086a0c9344ad810"}
Jul 22 05:14:36.912262 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:36.911782    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8" event={"ID":"79f2c1e8-dac8-4df5-8f10-f252ee40ebe3","Type":"ContainerStarted","Data":"5b6ff1f61bcc981974d5b053c77037a961f2f2ec42bdc9f79ca241b7c70c9a9e"}
Jul 22 05:14:36.912262 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:36.911902    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:36.929265 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:36.929210    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8" podStartSLOduration=1.929190246 podStartE2EDuration="1.929190246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 05:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:14:36.927940367 +0000 UTC m=+2992.211805778" watchObservedRunningTime="2026-07-22 05:14:36.929190246 +0000 UTC m=+2992.213055640"
Jul 22 05:14:37.866785 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:37.866723    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xsd82_3612a551-96e1-4faa-9366-5de9ab0f948b/dns/0.log"
Jul 22 05:14:37.889063 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:37.889031    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xsd82_3612a551-96e1-4faa-9366-5de9ab0f948b/kube-rbac-proxy/0.log"
Jul 22 05:14:37.969406 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:37.969376    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cm2hm_ebc87cf6-25fd-4215-8bcb-98a5a3e9abc6/dns-node-resolver/0.log"
Jul 22 05:14:38.552512 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:38.552478    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f8b4c7d56-mjbkm_63724cac-1e11-4194-845e-e1e0a3ef462d/registry/0.log"
Jul 22 05:14:38.594937 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:38.594905    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fwqq6_0d672265-00a0-46f3-a9a7-a5c0882ccc5c/node-ca/0.log"
Jul 22 05:14:39.708661 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:39.708633    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86559b66b8-pdgwd_32e25a94-8993-4151-8dde-cc9331f8e55f/kube-auth-proxy/0.log"
Jul 22 05:14:39.772378 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:39.772348    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5n4q_fc415b1e-575c-4c32-81ee-fc2acd699833/istio-proxy/0.log"
Jul 22 05:14:39.807013 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:39.806969    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5n4q_fc415b1e-575c-4c32-81ee-fc2acd699833/istio-proxy/1.log"
Jul 22 05:14:39.846045 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:39.845991    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gvg6g_1454bef6-8b27-4579-828f-192f25d381de/payload-pre-processing/0.log"
Jul 22 05:14:40.620319 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:40.620288    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mxv98_c70a1040-b1ff-41cd-a105-ae23df85535a/serve-healthcheck-canary/0.log"
Jul 22 05:14:41.112928 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:41.112881    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjxcv_8a0f3caf-5cc3-4b70-9530-5804c069fbc5/kube-rbac-proxy/0.log"
Jul 22 05:14:41.132914 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:41.132882    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjxcv_8a0f3caf-5cc3-4b70-9530-5804c069fbc5/exporter/0.log"
Jul 22 05:14:41.154728 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:41.154704    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjxcv_8a0f3caf-5cc3-4b70-9530-5804c069fbc5/extractor/0.log"
Jul 22 05:14:42.928092 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:42.928065    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c7bkb/perf-node-gather-daemonset-llxt8"
Jul 22 05:14:43.368996 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:43.368964    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d7xbk_6512fe5d-839d-482c-b8c8-28e351827d00/manager/0.log"
Jul 22 05:14:43.610260 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:43.610225    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-c9nsr_2d518e5b-e537-4597-a05c-391bad138f7e/manager/0.log"
Jul 22 05:14:43.769756 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:43.769158    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58cbd5b4c4-m7lvb_ef5c3e59-4193-4300-b62d-1e185f0b23d1/manager/0.log"
Jul 22 05:14:43.791044 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:43.791016    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8bm5n_a04f94ca-49c8-4149-8040-a5b9d51f6729/server/0.log"
Jul 22 05:14:43.878394 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:43.878358    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z4r2r_dbdaeb51-ae4e-445c-8922-3405a5334afa/manager/0.log"
Jul 22 05:14:44.024752 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:44.024604    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5676cbf8df-8tx22_99bff39b-20e1-468d-95c4-320df8124174/manager/0.log"
Jul 22 05:14:44.041936 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:44.041903    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5676cbf8df-8tx22_99bff39b-20e1-468d-95c4-320df8124174/copy-manifests/0.log"
Jul 22 05:14:45.365156 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:45.365083    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 05:14:45.367471 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:45.367447    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2b5f4_9a446c1d-dbbf-43c3-8878-140d992fa52c/ovn-acl-logging/0.log"
Jul 22 05:14:46.189919 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:46.189893    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86559b66b8-pdgwd_32e25a94-8993-4151-8dde-cc9331f8e55f/kube-auth-proxy/0.log"
Jul 22 05:14:46.234883 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:46.234843    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5n4q_fc415b1e-575c-4c32-81ee-fc2acd699833/istio-proxy/0.log"
Jul 22 05:14:46.267877 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:46.267842    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5n4q_fc415b1e-575c-4c32-81ee-fc2acd699833/istio-proxy/1.log"
Jul 22 05:14:46.296947 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:46.296905    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gvg6g_1454bef6-8b27-4579-828f-192f25d381de/payload-pre-processing/0.log"
Jul 22 05:14:47.763658 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:47.763633    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86559b66b8-pdgwd_32e25a94-8993-4151-8dde-cc9331f8e55f/kube-auth-proxy/0.log"
Jul 22 05:14:47.809117 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:47.809086    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5n4q_fc415b1e-575c-4c32-81ee-fc2acd699833/istio-proxy/0.log"
Jul 22 05:14:47.849214 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:47.849168    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5n4q_fc415b1e-575c-4c32-81ee-fc2acd699833/istio-proxy/1.log"
Jul 22 05:14:47.881709 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:47.881609    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gvg6g_1454bef6-8b27-4579-828f-192f25d381de/payload-pre-processing/0.log"
Jul 22 05:14:52.453318 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.453291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rv2fl_dad8fcac-e29e-4878-a3d9-9f787bf3551e/kube-multus-additional-cni-plugins/0.log"
Jul 22 05:14:52.473494 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.473467    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rv2fl_dad8fcac-e29e-4878-a3d9-9f787bf3551e/egress-router-binary-copy/0.log"
Jul 22 05:14:52.492307 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.492283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rv2fl_dad8fcac-e29e-4878-a3d9-9f787bf3551e/cni-plugins/0.log"
Jul 22 05:14:52.511550 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.511526    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rv2fl_dad8fcac-e29e-4878-a3d9-9f787bf3551e/bond-cni-plugin/0.log"
Jul 22 05:14:52.531481 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.531456    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rv2fl_dad8fcac-e29e-4878-a3d9-9f787bf3551e/routeoverride-cni/0.log"
Jul 22 05:14:52.552576 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.552548    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rv2fl_dad8fcac-e29e-4878-a3d9-9f787bf3551e/whereabouts-cni-bincopy/0.log"
Jul 22 05:14:52.572784 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.572758    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rv2fl_dad8fcac-e29e-4878-a3d9-9f787bf3551e/whereabouts-cni/0.log"
Jul 22 05:14:52.611831 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.611800    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rr745_e3882e8b-fa29-4881-815c-a21b8c61fbf2/kube-multus/0.log"
Jul 22 05:14:52.757720 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.757693    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xms64_206eec8a-5ac8-477f-9797-cec90e3236da/network-metrics-daemon/0.log"
Jul 22 05:14:52.774595 ip-10-0-131-26 kubenswrapper[2564]: I0722 05:14:52.774574    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xms64_206eec8a-5ac8-477f-9797-cec90e3236da/kube-rbac-proxy/0.log"